{"_id": {"$oid": "6ab1687f1481417a2aae4aa9"}, "test_id": "T0686", "benchmark": "library_cards", "date": "2026-03-16", "tags": {"document-type": ["index-card"], "writing": ["typed", "printed", "handwritten"], "century": [20, 19], "language": ["de", "fr", "en", "la", "el", "fi", "sv", "pl"], "layout": ["index"], "entry-type": ["bibliographic"], "task": ["information-extraction"]}, "contributors": ["gabriel_muller", "maximilian_hindermann"], "hidden": false, "config": {"provider": "genai", "model": "gemini-3.1-pro-preview", "dataclass": "Document", "temperature": 0.0, "role_description": "You are a historian with keyword knowledge", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract the bibliographic information about a historical dissertation from this index card and return it as a structured JSON object with the following exact format:\n\n```json\n{\n  \"type\": {\n    \"type\": \"Dissertation or thesis\" OR \"Reference\"\n  },\n  \"author\": {\n    \"last_name\": \"string\",\n    \"first_name\": \"string\"\n  },\n  \"publication\": {\n    \"title\": \"string\",\n    \"year\": integer,\n    \"place\": \"string or empty string\",\n    \"pages\": \"string or empty string\",\n    \"publisher\": \"string or empty string\",\n    \"format\": \"string or empty string\"\n  },\n  \"library_reference\": {\n    \"shelfmark\": \"string or empty string\",\n    \"subjects\": \"string or empty string\"\n  }\n}\n```\n\nEXTRACTION RULES:\n1. **Card Type**: If a card contains the note \"s.\" on a separate line, it is a \"Reference\". Otherwise, it is a \"Dissertation or thesis\".\n\n2. **Author**: Extract last_name and first_name. If only one name is given, put it in last_name and leave first_name empty.\n\n3. **Publication**:\n   - title: The main title of the work\n   - year: Publication year as integer\n   - place: Publication place\n   - pages: Page count (remove \" S.\" suffix if present)\n   - publisher: Publishing house/institution\n   - format: Usually \"8\u00b0\", \"8'\", or \"4\u00b0\" - single value only\n\n4. **Library Reference**:\n   - shelfmark: Often begins with \"Diss.\" or \"AT\", may be marked with \"Standort:\"\n   - subjects: Subject classifications or keywords\n\n5. **Missing Information**: Use empty string \"\" for missing text fields, omit year fields entirely if not present.\n\n6. **Ignore**: Disregard any information that doesn't fit into these categories.\n\nReturn ONLY the JSON object, no additional text or explanation.", "results": {"text": "{\"type\":{\"type\":\"Reference\"},\"author\":{\"last_name\":\"Montaghemi\",\"first_name\":\"Nourhomadeh\"},\"publication\":{\"title\":\"Sonnenbichler - Montaghemi, Nourhomadeh\",\"year\":\"\",\"place\":\"\",\"pages\":\"\",\"publisher\":\"\",\"format\":\"\",\"editor\":\"\"},\"library_reference\":{\"shelfmark\":\"\",\"subjects\":\"\"}}", "model": "gemini-3.1-pro-preview", "provider": "genai", "finish_reason": "STOP", "usage": {"input_tokens": 1529, "output_tokens": 143, "total_tokens": 3235, "input_cost_usd": 0.003058, "output_cost_usd": 0.001716, "estimated_cost_usd": 0.02353, "reasoning_tokens": 1563, "reasoning_cost_usd": 0.018756}, "duration": 16.49842357635498, "timestamp": "2026-03-16T19:26:38.035263", "parsed": {"type": {"type": "Reference"}, "author": {"last_name": "Montaghemi", "first_name": "Nourhomadeh"}, "publication": {"title": "Sonnenbichler - Montaghemi, Nourhomadeh", "year": "", "place": "", "pages": "", "publisher": "", "format": "", "editor": ""}, "library_reference": {"shelfmark": "", "subjects": ""}}, "conversation_id": "0ed015de-3214-438a-aef4-802cb4754975", "score": {"f1_score": 0.29, "precision": 0.25, "recall": 0.3333333333333333, "true_positives": 1, "false_positives": 3, "false_negatives": 2, "field_scores": {"author.last_name": {"response": "Montaghemi", "ground_truth": "Sonnenbichler", "score": 0.34782608695652173}, "library_reference.shelfmark": {"response": null, "ground_truth": null, "score": 1.0}, "publication.pages": {"response": null, "ground_truth": null, "score": 1.0}, "publication.format": {"response": null, "ground_truth": null, "score": 1.0}, "publication.year": {"response": null, "ground_truth": null, "score": 1.0}, "publication.editor": {"response": null, "ground_truth": null, "score": 1.0}, "publication.title": {"response": "Sonnenbichler - Montaghemi, Nourhomadeh", "ground_truth": "Montaghemi, Nourhomadeh", "score": 0.7419354838709676}, "publication.publisher": {"response": null, "ground_truth": null, "score": 1.0}, "author.first_name": {"response": "Nourhomadeh", "ground_truth": null, "score": 0.0}, "library_reference.subjects": {"response": null, "ground_truth": null, "score": 1.0}, "type.type": {"response": "Reference", "ground_truth": "Reference", "score": 1.0}, "publication.place": {"response": null, "ground_truth": null, "score": 1.0}}, "total_fields": 12}, "raw_response": "{\"sdk_http_response\":{\"headers\":{\"content-type\":\"application/json; charset=UTF-8\",\"vary\":\"Origin, X-Origin, Referer\",\"content-encoding\":\"gzip\",\"date\":\"Mon, 16 Mar 2026 18:26:44 GMT\",\"server\":\"scaffolding on HTTPServer2\",\"x-xss-protection\":\"0\",\"x-frame-options\":\"SAMEORIGIN\",\"x-content-type-options\":\"nosniff\",\"server-timing\":\"gfet4t7; dur=16397\",\"alt-svc\":\"h3=\\\":443\\\"; ma=2592000,h3-29=\\\":443\\\"; ma=2592000\",\"transfer-encoding\":\"chunked\"},\"body\":null},\"candidates\":[{\"content\":{\"parts\":[{\"media_resolution\":null,\"code_execution_result\":null,\"executable_code\":null,\"file_data\":null,\"function_call\":null,\"function_response\":null,\"inline_data\":null,\"text\":\"{\\n  \\\"type\\\": {\\n    \\\"type\\\": \\\"Reference\\\"\\n  },\\n  \\\"author\\\": {\\n    \\\"last_name\\\": \\\"Montaghemi\\\",\\n    \\\"first_name\\\": \\\"Nourhomadeh\\\"\\n  },\\n  \\\"publication\\\": {\\n    \\\"title\\\": \\\"Sonnenbichler - Montaghemi, Nourhomadeh\\\",\\n    \\\"year\\\": \\\"\\\",\\n    \\\"place\\\": \\\"\\\",\\n    \\\"pages\\\": \\\"\\\",\\n    \\\"publisher\\\": \\\"\\\",\\n    \\\"format\\\": \\\"\\\",\\n    \\\"editor\\\": \\\"\\\"\\n  },\\n  \\\"library_reference\\\": {\\n    \\\"shelfmark\\\": \\\"\\\",\\n    \\\"subjects\\\": \\\"\\\"\\n  }\\n}\",\"thought\":null,\"thought_signature\":\"EvQqCvEqAb4-9vspR0l3gMw7-E4aZs2292OGrZZZCpG9e0xI6CiVAmLr_gZOLEEcZcPnNAa20Wx5bzMWA6XMAb7XwT-8eOOWw3h6Vk9rxpDumXSD0Y_FD_zELHwD5k94JSNFoEAuuzVj8KNaL83r9whOj5uy7OmlHyaDeyYSie0-G139gOi4HWeRA1u94XUGGCUoEhJ1MeFn7vf3SnttzSrJy3dG5SjsMuXLKkVG3_bqLDQ37OwCdQjS8U3gvJWoX-bFQRtj5zmBCsN0Edba-CI1Nq2ROWi6cUkC72jfmNxLOXdiVxRbDE8Jv9cRFuNIJlZTK-x-ERGpjJsSU-hQTR-2BK1HJGTolSQdDAocXHulQhT_4pTGIpdfKzKGyT0AjKRrcVSY2OGjhnrlM9kAr0YQwlghHIcUvwsZlnXptRZklNinaPfvAGYya8vHCMTK5dFC_I9D_V2EfrakT-jT9I_VDQYwFnJIugEUzkXh-9z5_Hly9ZAN-4rt0lmfPBNlayWhkC1s_o9ritiKo5gMaBX_GvKHbgrAhjK-2xjOGRFdEhqspB-0SW-Ze6ORWnTCbHuAHrBg448X2oZTVH6PcxR6E-3V7dpR49BGCrB9lweV_DyN1XQjZAZDokMPqm21jk8Kf9QDa_GH_DoAb_S2R8roE7UjNKdX00R3y36UOAOTqoa7Qb930Mk3Qpu61H9xDGO7rhCAyMb8LtX1JEqz_KhyI3KvPkcwfE5rL1QpWAnZohUGce_g6zqdrPPqH0iO8q0UGufXuXO15YQqMi_U-LNyjuCvrsUm8-V0kQhJ2JbxmsRTb0k8QES1-LYTVN5VsWuyr7G5peRIFhNrccngSgDhML_un0jrcuepOSR42gTxzYpd-Gyrpffbu0bNawF03X96ypnS8OKMsQ9qUzdf0Y_chlB2JvH6jj3hI6Q8SQFZMcgoqhPa5eVhfZ61_hLT5pglG8xJXbhO7bSWSIFYxjJ4I-ZdQpAkiTr-6EkOUHKKa2imtsXCSZLnhj03SCnhgHBQIHweCOmMWxFIZ51__gwoyvbsqyd5PIT9OI68gabssPeAVhsEhmlRklvgjbbWFIQHnTsFMFE5ak9f1Vd5hyJ2Pd_bXa-SrzbzEOi56guFfWcM7NfYrIza6-nRqQHR9TTRQBwahJ3n36IXoiT0S9ppvFlXt15QtKh-XE3M6-sfJY-MZ9SxH2qwrvXFeySrPqzgNUYbeKaMy2etnvx4qYqDaDdMA0LriCoyicsJGLtwzLDfY-yWHd0xNE8iefALPSoLVwCv_mG4DxLZHhi_Cob7_B304Dpfl35IX9PvQg5cjBYoG4Zn1LNdFHSVJMx4mWrchk8S2V9hfrLeJPSqSetkMlWbMETeLTgfh_vE33Utk_JaoR6Mx9saywLNqb3DMGjhGDMFi060k-lx_BIT9SxrzVkdvUKOECmX5bXQWkFPVgGsN7XGRqlqBjs7LnpTJBQRwWyfCgebha8lFrgXvdA13ToFqfaPkiTD42161y9zDUNtjy25tWYgIF32VLGzGTDGv-eYfE7ph-Q-mSxnHnn2cIpimqJXXs5frm1AIY6Q_IBxW-EBRYV2yNAZmp4toXxtdn6hWWNHdZnXCMvEIEf5NhSWns93FEzgQqvdabGiqXGwfsP5P6rn5oJ_ucGTd-jWE0rq6AXR-nBY718Lx7f0Kxq_cgvvp_OgpLcwpoFeJHTovhlrR1bfczeQWT523Ql0MWFn1-hZS200XihS4M6og5Mndq5iWlSabEhb-4BTufRDTSYXGz5Cn1TA6NiyZiXjLD_-6PESmfD00_LHzTnLi-gvTYIa9bKb6RtifbhxwzTXwnwym8jPBuJM6EZ_yrVrgoOycpcyrJGZhK-_dlLENLbUTAFwgsx2yHcoESXWNQc3k8YBauqY1_Ve7Yh6sbBhgkHXN_LXgsFlf3NVMNOd0Z7oU70LssSoMXa48Q2DZS8JnDJ1o2oH-SnRT7qSHHvUivguEHrs0Q1pz7dFZLeFJU8hluTUFZvg9asyQrG4vZDlZylIwjtAKfYUVuRzK6AICpHNvRHtILwOdpGU4yM2dllq1JQmtYofk9a7CBw_KKwa6K0vNY71hyawgaWmAmkMvy2xSVRpEAhJY5U7eWOhLb7_wgbJwMPB_e9XuCNixPs9TCeDEj3a4zcIeT313181yvVDbkZF26J1i9qp-3x16lbCPLu799eb3XTvZ8Tds7P-ku3_bRS80neYbYqhKpz7oOhlLC6AoWUq6sKxXwOwiSsEj8EVgZmM8_VaLtcDZQLOQtU9k4iJQfknGbN3VA9npS_GFYvrPO96XxMvyxOCn8UjhIG_GysEb8q1fHh3J-mWcy021zDd5tfUx8z1hbinuuZWPnFhdtINLnuOxzEjdsdZgfSdQMAtm_WrgERJltP8MRDacZds1hR6RCwDQSBf_qeP6v-S2q8lKh16m9gQok5AmHJcH4EVWdY7GSRU_Wt-QxLy_UrzG_c0KTS6_FUkV6appriTT8c6k_B0HH9ugZB0WEzUkM2tROispiXjWBSNa6P5-TuxnqciOuAvq7EScFMge5GJFxtLzpdzzV-bgNeaQt_10QpIgaPKBs1ungxsCc_tT2lOrfs1RXLBF0Pfc6rFwBheSfSwtTEXL9Zxv6ExjrxTMhzVwVXKDB0iXGZQQUMioVIEV93PikFQ-7OfHJrjqF1GNWeak7Wz9p3KA9_5KtdYObNYcZ6b44j_FdNwDCxl8KyKZebMbld9AKjidJSWmeKp5jmTEWhOpvlx7-bMtGTv0D1G4Ex90yC4w34Y3KdsEDEB7x9ZiySRC98dFnXbpVbXe0VAVe9l6c9DZcUkfTBMjJHA54iXc3bH2Lh4NXicYr9DeOr8DQUPubPLtaTgQi9wt3Mo-LbhdIdUARgFavexoeF9xa8qYt4HgXrKmxEd5BlS_h1sUwcfAZx0xCp96UzLwjEkaQJFL4ENY9PekLIHdIbBsOSYwlrcffkleMeuINBvDx-YIr97-PCb1tBFyroDMtcSod4ol22H0V4J870P4gVTtlUWWNAVb7bqI1mP5E13vW6oPjUg6bbCFC1DWIxEJKwjMYCvmMsszUgY0tk602fcjfAHuFotR_hp_1QdzCDlw287BYhUvFDx1Q_TsJ1urqUEFsYHBqk41MFZFXr3eNpR4lGrzZGU5fmrX7TWm7MQSoJ3Eo-6bebh1w4_szSJ_gVQelLFnpfzpUBiwe-UBZ55RhxA86d1WVBimgLDEx4fEZFjHpxPuhwTGSI3SQfAorGzJIo4bYZLfsjikL6uUUUMhIv8at8bTyhqcQSdSaDyLL_AHnn1iozkU6wjXemtvSfmFmaZk9Q1-O8DzNRsMsdoM7907S88QPN_2ecBHpNh92lP0DoRQe9tYvX5y1A58G1Ua3YOkOOmm3kMVL2HxERhZ_eo2Vj5fakeS8fUy-iS00al35DbeY260jQeCKDqpp3PSrQkB110t30jLDo0ioBYAljEJgpuGLgD14k6G6O9rrQdY6tJb62JnZda6k3m7TrWJbsSXmJezxJXnUMIRWZAw-RIUqxgK1gFmhFOLfmBZuC-1k8A_vd32K8WHQ2EQ7mFrrJinYLmd0gtOi2ZvH86rhQqynC3ylVPsAszVAWABFGH5OZmoOi2lydKcHxr8aINRvoTsaO5wlrbSOngCTv8f2ECFaQy57AVNM3A7AGMR0ghiLNAud_ypcflbbxIm1ehoXqITV9j0hQEa9wT7hu-RE108li9XSHLHyU05pQRHrm6McYDKAKEaZeLsfB1R7U3RtVsRvjkyjjpiRM6ymoKA_q01le79mZATx0mvzDjwyJmQSEKHLxOXJtV8DPT4PifcguWYC_R5fmiMBHM0TKg95U2e-oHMSqrmvLQVW15Vl8quO5g5sPZ-WVB748srtjNYm5i-tRMBQZL-ZN1iifdrIBy8ydSyl9Df6mBE5mjUDbBdGkUpwdt3C4Be9arZeytG09vR7GzI1sEKV6td3a5cLh2qBkdcP-vAHwWF5TDnRHUJwuySzgj_dkFMTlWtpUe4yFudM2N4SlzBgtcVDrUxjJy5IYO0i7hgZS63kup-iyZq6oapXXKkIYiJj_cglnRgRBGOYlhXMjJs6pLpBEwrJZXF5EQDsfv9AaVNb5dBKvUJdqPApjhgnpRGkDuFRXlnln6VXgsijyyWM-kU2geqbzoCzqRvg0mIlGNo-32fBQUjBQHjWMq_AUcrtlv3TfHChmYj8EUPgriVq4Slup24gJJ48hBqOzM19-j2lsteEu-q9NQA_S_G0rs-A5vdEol4gaWsITzZXEWQ9cGZoh0FHp5UJ31jUIVy9OMWMd8ppfyhg6Dx9h9YdACpposu7w7f9tzj72zMo4IjWFu9P51sdziz9hjlCb0MUw96xu6nFDp9RaoNs9V7RXvqQvso01mpEwT4re9cV8OSQr7scKRMrepQWVVGJU79voM_MeJZSffyaLXIzSjuOVDH8w_gbOvWR004gMgxoFT24F-69P4GbCmCnPeANW3AxCS1qP-a-ojf93zE3DuNvYSnu9oUOqOA9Zto2_rulzKO5htGg6zj29T1NIt6P3jLt9X5KC1dLEDaVlVn_SecYb1uAVpm9goatdp2Ugcvv0aMFjBdgoa0SbWupAJWqYqw3odKoVjrxjtuebaK_fkTEyaT4ZNQB94Uc7jbaRm-mEVZrEs05UAPoafBwMsc8sgiK1yuxqeQZplu36X7D7CdU0HL3XGoqKMLdSO7WoLD1Z1by1JxSR7pr1SjzMrlPU5FU8v-mREp6x_ipXiD3Ru6dWBrtV3FpfKK2GOkX743bsaVU4paiKSlCS-okuTc97nax6w_IUutWPnEU6EzcW-wmq4ZN4zL646YQqVgOWpWgwxjTFqtt7PyWagsq3ly_2sc93mmt4lzGUcm-bdpr7Nyf4Y1ODUzuksin0_pjVd-S8510TFmxt1ptDTWhCVnSaHVCRHzF50u4eOcrdK1q7_7CBKiOMA_hYt2ADpg2O6axlMrJHB7288gWBjmsz-0kVq1r5QCB3Tmg7CAd-NXcb18wfPCbmVw-fuJmKyOnelncXOsA_yLg9JcgQLgfVqhVdz9ipk2dufNv2Ghzk3bhhNPS9olV6PMcKnT76hgSzRuaNf6clO-Odm-tZhnSIKXDjl3uGGe2fUjzYO55L8VvGGsDGnO3XpaBSVBY7opeL0prfiNzMnsfNc2gJ8Hq07ISjjBk_Kx0tuvlaZxMDbmvqF0-Lvs95Dcd5AxIwN5KcyrdbbcJ5ko17OHGLBfkspB7wD8kZjWnZJOd3uLXjBtFQqpDf7PtAAF2E5mCJOjtIyiF2-yFAWGNJe-GO-Dmv3NeZcP1x_Dg4Ku3Hi7rkPqEBTN-Rf9BzbkQ_mSz_HfSDz9R5RTKfw6Y7y5m6MFVCJlZQVUu0a8X4JNbtQ7QxvP9wQN8gTKPBDwXucBmI8I-7X_IlFjsGAWfM01ChDHLubF0LZ7jEFWJ7SQu5EeyUxmurdRy7owlaQODOytkjdanEqzRvY1s75XNd8i2Y0eZKMIYdoHCLmqvo4pu0eU-Ot_1RxnXyb2wkjRWvlwX_01RqP6Cd2ukeRZ8YR6mgUOIZ0WrERF3y3QI_KFAgP2xWk7J4U3xnWybp2JcnK4veko3aLLCKmpGEwWpPwmCt3Px3T50wuCP7MR5pB-89FpSSUXib-3ye8Pf59upoB8F5PJdO8yxtqRkAY1zEYk6Xk0gXIarPryGAvpLcfHpiw38KFfeAU-Fq4OmrSopVvVB7f6zhk3vSPKOXSFh4sQfDLulVlN9AdKt9-FPOqRbBM6cEn-__hdnlw6WXqJNse2lxp0g4-31ID6tIje3LVdx2dhzwT1NOzwOF8O7165T4G2Lb8Gb_g7cDCM0k3sm4dCgve0i2w7oEfNqp75LJgd1iIc69EcBgO_xpLXSFPgecY0Pyhhs-xLaNpezpU9vGM0GxSbVv-m78zPfq6kgpQd7mxc0zIAAjhuITsVKz5sSza1yvKrUCNV7resa0tgFIJUAYh1OV0VruJNWBHJ9oRGpGQjzKZXhRENKbcfhGowSbws0-GdHfT_cD1Y6JDelav3hnbRKceF59qQhFoyDvZPfhEt-JZRuBKaZwn39ejz4ltKsD-yecFxKw-2l2YusS69MFlhfAIoaOL0Pg8x25vOXrXJp3ysoiQCrBNPkf0I3YLGmi-UXGRXwFqjI4McNG4hjbSYuGUpcqn7hhHsAWg9GEfSe372uwpaI5N8x-3hP5e4B2ROWCQknGXw4VORHj3jARZIl8qITDg96GwfO6J-n33Ml-Hgu1nuIlfcni9yElHGZPF-zjpI9job5oaw5fu7opjMKmrepYvjUv6o-NK8yhjXxvERpeWTGSETHxuPs9TXSZZoguBAuIHYRLKA3MOKoSHz1qtrqlOe5s8V_Y8dzgR9u1zTREri515MavfT07xr6vuU-jSn-kQIHvMWEEPtEhc6gWvg093ZqWeApvOUu3cQOk3OHMAH1bjCnNTV4p3pL7m-Tj0g5xOYw5ek-EwOa-VhBW88xYMA4BGM0ANGCccIDf6DgKfSw2rokqWNXHpaNTxH7WM2eZiEoi7Fne5DwwNEC4dVB3BtZ_gBPbDVgiTcItUe_HalcFvLoiAMWjisE0xTHBsQf4Tejz-3lGi3Nc52_Xbvs5yAlDAPl2aYTBU5cfnXEMvCchRX5w4-olApZyTSTrtEh8vffzAcjDab0Ew3DkUC0JoIKMmusLD8zyQ41K2uf5N7V_NaP5M7lzRdLVmC5YlEGO_SMKV9u1ohNfHQ3DbTgyviGtMg1KohAp6Hh497RhllEXVgcoawGsHcCKeP8qr11Bb4fSw7ctSaLB05mzm_7HpjT-voswuUgJplK32nvVa1z1ygI7ozIgDZPf4PS9SQET1XIiR45lRLd4TwJDoOcjYxDGP6CmvFEG0ROFmfImn8x6FN63XYthp2cQ99LzBhRP1IPePBfNuDOjLUUyaQS0RYPFNVPtUMphHAZIc7C6kUMMK-BpUHWHdXELLmREm2F5uEuNRm2R_lnxe5SgYxr8sbTchJCVkCg0x7aH_xGF7FZvFSIF34kfs5kE8gvju550HRvtC3aWScbQwlxtZPQqLPwmJJyOOya7x_ybzdN3iNUG6sFDW9oMnD9gv_wwtb8E0e2mBio3lMaUtwDrumn9H_3bYhL5S6ud_jgHl3FUW9YE62johOu8wY0hgEZb5UnpbOJUTdlZ5b2bvPIM_UYkA4VlwbSgp50tMordt7mZJjPUz74If-jdGxFLxdSAf4ACd43nAdvYD3SM9zu8SKdK2O8c=\",\"video_metadata\":null}],\"role\":\"model\"},\"citation_metadata\":null,\"finish_message\":null,\"token_count\":null,\"finish_reason\":\"STOP\",\"avg_logprobs\":null,\"grounding_metadata\":null,\"index\":0,\"logprobs_result\":null,\"safety_ratings\":null,\"url_context_metadata\":null}],\"create_time\":null,\"model_version\":\"gemini-3.1-pro-preview\",\"prompt_feedback\":null,\"response_id\":\"ZEu4aZeANfPMnsEP67if4AI\",\"usage_metadata\":{\"cache_tokens_details\":null,\"cached_content_token_count\":null,\"candidates_token_count\":143,\"candidates_tokens_details\":null,\"prompt_token_count\":1529,\"prompt_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":454},{\"modality\":\"IMAGE\",\"token_count\":1075}],\"thoughts_token_count\":1563,\"tool_use_prompt_token_count\":null,\"tool_use_prompt_tokens_details\":null,\"total_token_count\":3235,\"traffic_type\":null},\"automatic_function_calling_history\":[],\"parsed\":{\"type\":{\"type\":\"Reference\"},\"author\":{\"last_name\":\"Montaghemi\",\"first_name\":\"Nourhomadeh\"},\"publication\":{\"title\":\"Sonnenbichler - Montaghemi, Nourhomadeh\",\"year\":\"\",\"place\":\"\",\"pages\":\"\",\"publisher\":\"\",\"format\":\"\",\"editor\":\"\"},\"library_reference\":{\"shelfmark\":\"\",\"subjects\":\"\"}}}"}, "scoring": {"f1_micro": 0.89019926799512, "f1_macro": 0.8801140684410647, "micro_precision": 0.8745505393527767, "micro_recall": 0.9064182194616978, "total_instances": 263, "total_tp": 2189, "total_fp": 314, "total_fn": 226, "cost_summary": {"total_input_tokens": 406240, "total_output_tokens": 48633, "total_tokens": 454873, "input_cost_usd": 0.812479999999998, "output_cost_usd": 0.5835960000000002, "total_cost_usd": 6.637484, "total_reasoning_tokens": 436784, "reasoning_cost_usd": 5.241408}}, "pricing": {"bucket_date": "2026-03-16", "age_days": 0, "input_price_per_million": 2.0, "output_price_per_million": 12.0}, "timing": {"total_response_s": 4451.08, "mean_response_s": 16.92, "slowest_response_s": 462.22, "inputs_timed": 263, "inputs_stored": 263, "span_s": 631.44}, "normalized_score": 88.01140684410646}