[{"_id": {"$oid": "69d4eb12b877594bc5718d46"}, "test_id": "T0877", "benchmark": "personnel_cards", "date": "2026-03-25", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "alibaba", "model": "qwen3.5-397b-a17b", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "rules": "{\"base_url\": \"https://ws-wkjpbv6ov7sqlgqe.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1\"}", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4800.-\",\"interpretation\":\"4800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"17. Dez. 45\",\"interpretation\":\"1945-12-17\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "qwen3.5-397b-a17b", "provider": "alibaba", "finish_reason": "stop", "usage": {"input_tokens": 4354, "output_tokens": 305, "total_tokens": 4659, "input_cost_usd": 0.0026124, "output_cost_usd": 0.001098, "estimated_cost_usd": 0.0037104}, "duration": 8.745896816253662, "timestamp": "2026-03-25T10:54:05.965074", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": "5", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4800.-", "interpretation": "4800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "17. Dez. 45", "interpretation": "1945-12-17", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "47f37e2e-2145-42ff-ab6c-89883496df84", "score": {"f1_score": 0.92, "precision": 0.8571428571428571, "recall": 1.0, "true_positives": 12, "false_positives": 2, "false_negatives": 0, "field_scores": {"rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-12-17", "ground_truth": "1945-12-17", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": "5", "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4800.-", "ground_truth": "4800.-", "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "17. Dez. 45", "ground_truth": "17. Dez. 45", "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4800", "ground_truth": "4800", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 19}, "raw_response": "{\"id\":\"chatcmpl-9c64c4eb-b7a5-9cb9-bc96-e308971d8734\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": \\\"5\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4800.-\\\",\\n \\\"interpretation\\\": \\\"4800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"17. Dez. 45\\\",\\n \\\"interpretation\\\": \\\"1945-12-17\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"reasoning_content\":\"\"}}],\"created\":1774432446,\"model\":\"qwen3.5-397b-a17b\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":305,\"prompt_tokens\":4354,\"total_tokens\":4659,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":null,\"reasoning_tokens\":null,\"rejected_prediction_tokens\":null,\"text_tokens\":305},\"prompt_tokens_details\":{\"audio_tokens\":null,\"cached_tokens\":null,\"image_tokens\":2522,\"text_tokens\":1832}}}"}, "scoring": {"f1_micro": 0.9666534339023423, "f1_macro": 0.9124590163934425, "micro_precision": 0.9662698412698413, "micro_recall": 0.9670373312152502, "total_instances": 61, "total_tp": 2435, "total_fp": 85, "total_fn": 83, "cost_summary": {"total_input_tokens": 264893, "total_output_tokens": 61065, "total_tokens": 325958, "input_cost_usd": 0.1589357999999999, "output_cost_usd": 0.21983400000000003, "total_cost_usd": 0.37876979999999993}}, "normalized_score": 96.66534339023423}, {"_id": {"$oid": "69d4eb12b877594bc5718d5f"}, "test_id": "T0890", "benchmark": "personnel_cards", "date": "2026-03-25", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "alibaba", "model": "qwen3.5-flash-2026-02-23", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "rules": "{\"base_url\": \"https://ws-wkjpbv6ov7sqlgqe.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1\"}", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"-\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'140.-\",\"interpretation\":\"3140\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Dez. 1943\",\"interpretation\":\"1943-12-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.Fr.200.-techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'155.-\",\"interpretation\":\"3155\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl Fr.200.- techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.525.-\",\"interpretation\":\"4525\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.200.-\",\"interpretation\":\"5200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1945\",\"interpretation\":\"1945-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"/\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5420.-\",\"interpretation\":\"5420\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Betr. Techn.\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4700.-\",\"interpretation\":\"4700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Nov. 1946\",\"interpretation\":\"1946-11-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "qwen3.5-flash-2026-02-23", "provider": "alibaba", "finish_reason": "stop", "usage": {"input_tokens": 4354, "output_tokens": 1763, "total_tokens": 6117, "input_cost_usd": 0.00043540000000000007, "output_cost_usd": 0.0007052, "estimated_cost_usd": 0.0011406}, "duration": 31.9622700214386, "timestamp": "2026-03-25T11:04:03.563497", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "-", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'140.-", "interpretation": "3140", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Dez. 1943", "interpretation": "1943-12-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl.Fr.200.-techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'155.-", "interpretation": "3155", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl Fr.200.- techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.525.-", "interpretation": "4525", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Lagerleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.200.-", "interpretation": "5200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1945", "interpretation": "1945-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "/", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5420.-", "interpretation": "5420", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "Betr. Techn.", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4700.-", "interpretation": "4700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Nov. 1946", "interpretation": "1946-11-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "6c781dd6-ff21-46d3-8d52-65c34a127a90", "score": {"f1_score": 0.96, "precision": 0.96, "recall": 0.96, "true_positives": 72, "false_positives": 3, "false_negatives": 3, "field_scores": {"rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'140.-", "ground_truth": "3'140.-", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "inkl.Fr.200.-techn.Z.", "ground_truth": "inkl.Fr.200.-techn.Z.", "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1946", "ground_truth": "1.Januar 1946", "score": 0.962962962962963}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5200", "ground_truth": "5200", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1946-01-01", "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "Betr. Techn.", "ground_truth": "Betr. Techn.", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1.Jan.1944", "score": 0.9090909090909091}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4525", "ground_truth": "4525", "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1.Januar 1945", "score": 0.962962962962963}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "inkl Fr.200.- techn.Z.", "ground_truth": "inkl.Fr.200.- techn.Z.", "score": 0.9545454545454546}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.525.-", "ground_truth": "4.525.--", "score": 0.9333333333333332}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4700", "ground_truth": "4700", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3155", "ground_truth": "3155", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-12-01", "ground_truth": "1943-12-01", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5420", "ground_truth": "5420", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Betriebs-Techniker", "score": 0.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Lagerleiter", "ground_truth": "Lagerleiter", "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-11-01", "ground_truth": "1946-11-01", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "-", "ground_truth": "-", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3140", "ground_truth": "3140", "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-07-01", "ground_truth": "1945-07-01", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'155.-", "ground_truth": "3'155.-", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Nov. 1946", "ground_truth": "1.Nov.1946", "score": 0.9090909090909091}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5420.-", "ground_truth": "5420.-", "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Dez. 1943", "ground_truth": "1.Dez. 1943", "score": 0.9565217391304348}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.200.-", "ground_truth": "5.200.-", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1945", "ground_truth": "1.Juli 1945", "score": 0.9565217391304348}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": "/", "ground_truth": null, "score": 0.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4700.-", "ground_truth": "4700.-", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 114}, "raw_response": "{\"id\":\"chatcmpl-689e0281-93d0-9b86-add5-dcc746814d4e\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"-\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'140.-\\\",\\n \\\"interpretation\\\": \\\"3140\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Dez. 1943\\\",\\n \\\"interpretation\\\": \\\"1943-12-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl.Fr.200.-techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'155.-\\\",\\n \\\"interpretation\\\": \\\"3155\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl Fr.200.- techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.525.-\\\",\\n \\\"interpretation\\\": \\\"4525\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1945\\\",\\n \\\"interpretation\\\": \\\"1945-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Lagerleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.200.-\\\",\\n \\\"interpretation\\\": \\\"5200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1945\\\",\\n \\\"interpretation\\\": \\\"1945-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"/\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5420.-\\\",\\n \\\"interpretation\\\": \\\"5420\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 6,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Betr. Techn.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4700.-\\\",\\n \\\"interpretation\\\": \\\"4700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Nov. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-11-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"reasoning_content\":\"\"}}],\"created\":1774433044,\"model\":\"qwen3.5-flash-2026-02-23\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":1763,\"prompt_tokens\":4354,\"total_tokens\":6117,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":null,\"reasoning_tokens\":null,\"rejected_prediction_tokens\":null,\"text_tokens\":1763},\"prompt_tokens_details\":{\"audio_tokens\":null,\"cached_tokens\":null,\"image_tokens\":2522,\"text_tokens\":1832}}}"}, "scoring": {"f1_micro": 0.8554655870445345, "f1_macro": 0.7822950819672131, "micro_precision": 0.8724194880264244, "micro_recall": 0.8391580619539317, "total_instances": 61, "total_tp": 2113, "total_fp": 309, "total_fn": 405, "cost_summary": {"total_input_tokens": 238889, "total_output_tokens": 56080, "total_tokens": 294969, "input_cost_usd": 0.02388889999999999, "output_cost_usd": 0.022432000000000007, "total_cost_usd": 0.046320900000000005}}, "normalized_score": 85.54655870445345}, {"_id": {"$oid": "69d4eb12b877594bc5718d67"}, "test_id": "T0838", "benchmark": "personnel_cards", "date": "2026-03-25", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "alibaba", "model": "qwen3.5-35b-a3b", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "rules": "{\"base_url\": \"https://ws-wkjpbv6ov7sqlgqe.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1\"}", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Angestellter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"B e r n\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"15\",\"interpretation\":\"15\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.975.-\",\"interpretation\":\"4975\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"14. April 1947\",\"interpretation\":\"1947-04-14\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"15\",\"interpretation\":\"15\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.600.-\",\"interpretation\":\"5600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1947\",\"interpretation\":\"1947-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"11\",\"interpretation\":\"11\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"6.000.-\",\"interpretation\":\"6000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Oktober 1947\",\"interpretation\":\"1947-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"11\",\"interpretation\":\"11\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"6.221.-\",\"interpretation\":\"6221\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"11\",\"interpretation\":\"11\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"6442.-\",\"interpretation\":\"6442\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1949\",\"interpretation\":\"1949-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "qwen3.5-35b-a3b", "provider": "alibaba", "finish_reason": "stop", "usage": {"input_tokens": 4354, "output_tokens": 1473, "total_tokens": 5827, "input_cost_usd": 0.0010885, "output_cost_usd": 0.002946, "estimated_cost_usd": 0.0040345}, "duration": 19.88174271583557, "timestamp": "2026-03-25T11:09:16.993507", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Angestellter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "B e r n", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "15", "interpretation": "15", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.975.-", "interpretation": "4975", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "14. April 1947", "interpretation": "1947-04-14", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "15", "interpretation": "15", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.600.-", "interpretation": "5600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1947", "interpretation": "1947-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "11", "interpretation": "11", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "6.000.-", "interpretation": "6000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Oktober 1947", "interpretation": "1947-10-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "11", "interpretation": "11", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "6.221.-", "interpretation": "6221", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1948", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "11", "interpretation": "11", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "6442.-", "interpretation": "6442", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1949", "interpretation": "1949-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "22a99140-9529-467b-86d5-2c7160e2cdf8", "score": {"f1_score": 0.99, "precision": 0.9850746268656716, "recall": 0.9850746268656716, "true_positives": 66, "false_positives": 1, "false_negatives": 1, "field_scores": {"rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1948", "ground_truth": "1. Januar 1948", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6442", "ground_truth": "6442", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5600", "ground_truth": "5600", "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": "1948-01-01", "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1949", "ground_truth": "1. Januar 1949", "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1949-01-01", "ground_truth": "1949-01-01", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": "15", "ground_truth": "15", "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "6.221.-", "ground_truth": "6.221.-", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6000", "ground_truth": "6000", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "6442.-", "ground_truth": "6442.-", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "15", "ground_truth": "15", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.600.-", "ground_truth": "5.600.-", "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": "11", "ground_truth": "11", "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "15", "ground_truth": "15", "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": "11", "ground_truth": "11", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.975.-", "ground_truth": "4.975.-", "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "14. April 1947", "ground_truth": "14. April 1947", "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-07-01", "ground_truth": "1947-07-01", "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4975", "ground_truth": "4975", "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": "11", "ground_truth": "11", "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "11", "ground_truth": "11", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-10-01", "ground_truth": "1947-10-01", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Angestellter", "ground_truth": "Angestellter", "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "6.000.-", "ground_truth": "6.000.-", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Oktober 1947", "ground_truth": "1. Oktober 1947", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6221", "ground_truth": "6221", "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "B e r n", "ground_truth": "Bern", "score": 0.7272727272727273}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-04-14", "ground_truth": "1947-04-14", "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "11", "ground_truth": "11", "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": "11", "ground_truth": "11", "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": "15", "ground_truth": "15", "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1947", "ground_truth": "1. Juli 1947", "score": 1.0}}, "total_fields": 95}, "raw_response": "{\"id\":\"chatcmpl-32071ff8-d42c-99e9-b020-30122bbaa9d8\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Angestellter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"B e r n\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"15\\\",\\n \\\"interpretation\\\": \\\"15\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.975.-\\\",\\n \\\"interpretation\\\": \\\"4975\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"14. April 1947\\\",\\n \\\"interpretation\\\": \\\"1947-04-14\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"15\\\",\\n \\\"interpretation\\\": \\\"15\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.600.-\\\",\\n \\\"interpretation\\\": \\\"5600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1947\\\",\\n \\\"interpretation\\\": \\\"1947-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"11\\\",\\n \\\"interpretation\\\": \\\"11\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"6.000.-\\\",\\n \\\"interpretation\\\": \\\"6000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Oktober 1947\\\",\\n \\\"interpretation\\\": \\\"1947-10-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"11\\\",\\n \\\"interpretation\\\": \\\"11\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"6.221.-\\\",\\n \\\"interpretation\\\": \\\"6221\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1948\\\",\\n \\\"interpretation\\\": \\\"1948-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"11\\\",\\n \\\"interpretation\\\": \\\"11\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"6442.-\\\",\\n \\\"interpretation\\\": \\\"6442\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1949\\\",\\n \\\"interpretation\\\": \\\"1949-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"reasoning_content\":\"\"}}],\"created\":1774433357,\"model\":\"qwen3.5-35b-a3b\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":1473,\"prompt_tokens\":4354,\"total_tokens\":5827,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":null,\"reasoning_tokens\":null,\"rejected_prediction_tokens\":null,\"text_tokens\":1473},\"prompt_tokens_details\":{\"audio_tokens\":null,\"cached_tokens\":null,\"image_tokens\":2522,\"text_tokens\":1832}}}"}, "scoring": {"f1_micro": 0.9650595354284599, "f1_macro": 0.9040983606557377, "micro_precision": 0.9489443378119002, "micro_recall": 0.9817315329626688, "total_instances": 61, "total_tp": 2472, "total_fp": 133, "total_fn": 46, "cost_summary": {"total_input_tokens": 264893, "total_output_tokens": 62136, "total_tokens": 327029, "input_cost_usd": 0.06622325, "output_cost_usd": 0.12427200000000002, "total_cost_usd": 0.19049525}}, "normalized_score": 96.50595354284599}, {"_id": {"$oid": "69d4eb12b877594bc5718d6d"}, "test_id": "T0864", "benchmark": "personnel_cards", "date": "2026-03-25", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "alibaba", "model": "qwen3.5-122b-a10b", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "rules": "{\"base_url\": \"https://ws-wkjpbv6ov7sqlgqe.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1\"}", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"K\u00fcchenchef\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"/\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"18. November46\",\"interpretation\":\"1946-11-18\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "qwen3.5-122b-a10b", "provider": "alibaba", "finish_reason": "stop", "usage": {"input_tokens": 4354, "output_tokens": 873, "total_tokens": 5227, "input_cost_usd": 0.0017416000000000003, "output_cost_usd": 0.0027936000000000002, "estimated_cost_usd": 0.0045352000000000005}, "duration": 17.595956563949585, "timestamp": "2026-03-25T10:44:59.109960", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "K\u00fcchenchef", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "/", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "18. November46", "interpretation": "1946-11-18", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1948", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "b6f49829-6112-4954-a2a2-612a34a149e4", "score": {"f1_score": 0.96, "precision": 0.9428571428571428, "recall": 0.9705882352941176, "true_positives": 33, "false_positives": 2, "false_negatives": 1, "field_scores": {"rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-11-18", "ground_truth": "1946-11-18", "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4600", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "/", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.600.-", "ground_truth": "4.600.-", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": "1948-01-01", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.600.-", "ground_truth": "4.600.-", "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4600", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": "1. Jan. 1947", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "K\u00fcchenchef", "ground_truth": "K\u00fcchenchef", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1948", "ground_truth": "1. Jan. 1948", "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4680", "score": 0.75}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "18. November46", "ground_truth": "18. November 46", "score": 0.9655172413793103}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.600.-", "ground_truth": "4.600.-", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}}, "total_fields": 57}, "raw_response": "{\"id\":\"chatcmpl-91989007-1e70-9816-8a31-ee48d204cd58\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"K\u00fcchenchef\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"/\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.600.-\\\",\\n \\\"interpretation\\\": \\\"4600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"18. November46\\\",\\n \\\"interpretation\\\": \\\"1946-11-18\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.600.-\\\",\\n \\\"interpretation\\\": \\\"4600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1947\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.600.-\\\",\\n \\\"interpretation\\\": \\\"4600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1948\\\",\\n \\\"interpretation\\\": \\\"1948-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"reasoning_content\":\"\"}}],\"created\":1774431899,\"model\":\"qwen3.5-122b-a10b\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":873,\"prompt_tokens\":4354,\"total_tokens\":5227,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":null,\"reasoning_tokens\":null,\"rejected_prediction_tokens\":null,\"text_tokens\":873},\"prompt_tokens_details\":{\"audio_tokens\":null,\"cached_tokens\":null,\"image_tokens\":2522,\"text_tokens\":1832}}}"}, "scoring": {"f1_micro": 0.9768545994065281, "f1_macro": 0.9172131147540984, "micro_precision": 0.9731966890027591, "micro_recall": 0.9805401111993646, "total_instances": 61, "total_tp": 2469, "total_fp": 68, "total_fn": 49, "cost_summary": {"total_input_tokens": 264893, "total_output_tokens": 61296, "total_tokens": 326189, "input_cost_usd": 0.10595719999999995, "output_cost_usd": 0.1961472, "total_cost_usd": 0.3021044000000001}}, "normalized_score": 97.6854599406528}, {"_id": {"$oid": "69d4eb12b877594bc5718d77"}, "test_id": "T0851", "benchmark": "personnel_cards", "date": "2026-03-25", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "alibaba", "model": "qwen3.5-27b", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "rules": "{\"base_url\": \"https://ws-wkjpbv6ov7sqlgqe.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1\"}", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3340.-\",\"interpretation\":\"3340\",\"is_crossed_out\":true},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"6. April 1943\",\"interpretation\":\"1943-04-06\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3460.-\",\"interpretation\":\"3460\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Feb. 1944\",\"interpretation\":\"1944-02-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"(inkl.400.- tech.Zl.)\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.830.-\",\"interpretation\":\"4830\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "qwen3.5-27b", "provider": "alibaba", "finish_reason": "stop", "usage": {"input_tokens": 4354, "output_tokens": 887, "total_tokens": 5241, "input_cost_usd": 0.0013062, "output_cost_usd": 0.0021287999999999997, "estimated_cost_usd": 0.0034349999999999997}, "duration": 35.07227087020874, "timestamp": "2026-03-25T10:53:27.304475", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3340.-", "interpretation": "3340", "is_crossed_out": true}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "6. April 1943", "interpretation": "1943-04-06", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3460.-", "interpretation": "3460", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Feb. 1944", "interpretation": "1944-02-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "(inkl.400.- tech.Zl.)", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.830.-", "interpretation": "4830", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "ca250bf6-c01e-4f6f-bf8e-be166bacaee3", "score": {"f1_score": 0.92, "precision": 0.8918918918918919, "recall": 0.9428571428571428, "true_positives": 33, "false_positives": 4, "false_negatives": 2, "field_scores": {"rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3340", "ground_truth": "3340", "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-02-01", "ground_truth": "1944-02-01", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "6. April 1943", "ground_truth": "6. April 1943", "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3340.-", "ground_truth": "3340.-", "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4830", "ground_truth": "4830", "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3460", "ground_truth": "3460", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3460.-", "ground_truth": "3460.-", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Feb. 1944", "ground_truth": "1. Feb. 1944", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-04-06", "ground_truth": "1943-04-06", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.830.-", "ground_truth": "4.830.--", "score": 0.9333333333333332}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "Hilfsleiter", "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": null, "score": 0.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": true, "ground_truth": false, "score": 0.2222222222222222}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "(inkl.400.- tech.Zl.)", "ground_truth": "(inkl.400.- tech.Zl.)", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 57}, "raw_response": "{\"id\":\"chatcmpl-45d3779c-a7b5-9213-8202-e2a9761534e8\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3340.-\\\",\\n \\\"interpretation\\\": \\\"3340\\\",\\n \\\"is_crossed_out\\\": true\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"6. April 1943\\\",\\n \\\"interpretation\\\": \\\"1943-04-06\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3460.-\\\",\\n \\\"interpretation\\\": \\\"3460\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Feb. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-02-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"(inkl.400.- tech.Zl.)\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.830.-\\\",\\n \\\"interpretation\\\": \\\"4830\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1945\\\",\\n \\\"interpretation\\\": \\\"1945-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"reasoning_content\":\"\"}}],\"created\":1774432407,\"model\":\"qwen3.5-27b\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":887,\"prompt_tokens\":4354,\"total_tokens\":5241,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":null,\"reasoning_tokens\":null,\"rejected_prediction_tokens\":null,\"text_tokens\":887},\"prompt_tokens_details\":{\"audio_tokens\":null,\"cached_tokens\":null,\"image_tokens\":2522,\"text_tokens\":1832}}}"}, "scoring": {"f1_micro": 0.9696006358036955, "f1_macro": 0.9127868852459017, "micro_precision": 0.9701789264413518, "micro_recall": 0.9690230341540905, "total_instances": 61, "total_tp": 2440, "total_fp": 75, "total_fn": 78, "cost_summary": {"total_input_tokens": 264893, "total_output_tokens": 61031, "total_tokens": 325924, "input_cost_usd": 0.07946789999999995, "output_cost_usd": 0.14647439999999998, "total_cost_usd": 0.22594229999999998}}, "normalized_score": 96.96006358036955}, {"_id": {"$oid": "69d4eb12b877594bc5718d32"}, "test_id": "T0825", "benchmark": "personnel_cards", "date": "2026-03-24", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "alibaba", "model": "qwen3.5-plus-2026-02-15", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "rules": "{\"base_url\": \"https://ws-wkjpbv6ov7sqlgqe.ap-southeast-1.maas.aliyuncs.com/compatible-mode/v1\"}", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Kursleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4800.--\",\"interpretation\":\"4800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"15. Aug. 1944\",\"interpretation\":\"1944-08-15\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Kursleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4874.-\",\"interpretation\":\"4874\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 45\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"ZL Kursleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5000.-\",\"interpretation\":\"5000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1946\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5054.-\",\"interpretation\":\"5054\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1946\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"11\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5275.-\",\"interpretation\":\"5275\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "qwen3.5-plus", "provider": "alibaba", "finish_reason": "stop", "usage": {"input_tokens": 4335, "output_tokens": 1451, "total_tokens": 5786, "input_cost_usd": 0.0017340000000000003, "output_cost_usd": 0.0034824, "estimated_cost_usd": 0.0052164}, "duration": 28.133882999420166, "timestamp": "2026-03-24T22:26:33.635406", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Kursleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4800.--", "interpretation": "4800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "15. Aug. 1944", "interpretation": "1944-08-15", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Kursleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4874.-", "interpretation": "4874", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 45", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "ZL Kursleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5000.-", "interpretation": "5000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1946", "interpretation": "1946-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5054.-", "interpretation": "5054", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1946", "interpretation": "1946-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "11", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5275.-", "interpretation": "5275", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "33fce118-4710-4139-87c0-41ee3fc4b7f7", "score": {"f1_score": 0.99, "precision": 1.0, "recall": 0.9836065573770492, "true_positives": 60, "false_positives": 0, "false_negatives": 1, "field_scores": {"rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": "1. Jan. 1947", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5000", "ground_truth": "5000", "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": "11", "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Kursleiter", "ground_truth": "Kursleiter", "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Kursleiter", "ground_truth": "Kursleiter", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4874.-", "ground_truth": "4874.--", "score": 0.923076923076923}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 45", "ground_truth": "1. Jan. 45", "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-07-01", "ground_truth": "1946-07-01", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1946", "ground_truth": "1. Juli 1946", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5275.-", "ground_truth": "5275.-", "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-08-15", "ground_truth": "1944-08-15", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1946", "ground_truth": "1. Juli 1946", "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5000.-", "ground_truth": "5000.--", "score": 0.923076923076923}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5275", "ground_truth": "5275", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "15. Aug. 1944", "ground_truth": "15. Aug. 1944", "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5054.-", "ground_truth": "5054.-", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-07-01", "ground_truth": "1946-07-01", "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "ZL Kursleiter", "ground_truth": "ZL Kursleiter", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5054", "ground_truth": "5054", "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": "11", "ground_truth": "11", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4874", "ground_truth": "4874", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4800", "ground_truth": "4800", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4800.--", "ground_truth": "4800.--", "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 95}, "raw_response": "{\"id\":\"chatcmpl-0219e214-1e41-9ceb-8c11-17c9a5cf83f8\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Kursleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4800.--\\\",\\n \\\"interpretation\\\": \\\"4800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"15. Aug. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-08-15\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Kursleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4874.-\\\",\\n \\\"interpretation\\\": \\\"4874\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 45\\\",\\n \\\"interpretation\\\": \\\"1945-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"ZL Kursleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5000.-\\\",\\n \\\"interpretation\\\": \\\"5000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1946\\\",\\n \\\"interpretation\\\": \\\"1946-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5054.-\\\",\\n \\\"interpretation\\\": \\\"5054\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1946\\\",\\n \\\"interpretation\\\": \\\"1946-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"11\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5275.-\\\",\\n \\\"interpretation\\\": \\\"5275\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1947\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"reasoning_content\":\"\"}}],\"created\":1774387593,\"model\":\"qwen3.5-plus\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":1451,\"prompt_tokens\":4335,\"total_tokens\":5786,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":null,\"reasoning_tokens\":null,\"rejected_prediction_tokens\":null,\"text_tokens\":1451},\"prompt_tokens_details\":{\"audio_tokens\":null,\"cached_tokens\":null,\"image_tokens\":2503,\"text_tokens\":1832}}}"}, "scoring": {"f1_micro": 0.9666136724960254, "f1_macro": 0.9118032786885245, "micro_precision": 0.9673826571201273, "micro_recall": 0.965845909451946, "total_instances": 61, "total_tp": 2432, "total_fp": 82, "total_fn": 86, "cost_summary": {"total_input_tokens": 264893, "total_output_tokens": 61048, "total_tokens": 325941, "input_cost_usd": 0.10595719999999995, "output_cost_usd": 0.14651519999999998, "total_cost_usd": 0.2524724}}, "normalized_score": 96.66136724960253}, {"_id": {"$oid": "69d4eb12b877594bc5718cee"}, "test_id": "T0729", "benchmark": "personnel_cards", "date": "2026-03-23", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "x-ai", "model": "grok-4.20-0309-reasoning", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Angestellter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"15\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.975.-\",\"interpretation\":\"4975\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"14. April 1947\",\"interpretation\":\"1947-04-14\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"15\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.600.-\",\"interpretation\":\"5600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1947\",\"interpretation\":\"1947-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"11\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"6.000.-\",\"interpretation\":\"6000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Oktober 1947\",\"interpretation\":\"1947-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"11\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"6.221.-\",\"interpretation\":\"6221\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"11\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"6.442.-\",\"interpretation\":\"6442\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1949\",\"interpretation\":\"1949-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "grok-4.20-0309-reasoning", "provider": "x-ai", "finish_reason": "stop", "usage": {"input_tokens": 2613, "output_tokens": 1261, "total_tokens": 6708, "cached_tokens": 2368, "input_cost_usd": 0.005226, "output_cost_usd": 0.007566, "estimated_cost_usd": 0.012792}, "duration": 36.987292766571045, "timestamp": "2026-03-23T15:04:39.975876", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Angestellter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "15", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.975.-", "interpretation": "4975", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "14. April 1947", "interpretation": "1947-04-14", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "15", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.600.-", "interpretation": "5600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1947", "interpretation": "1947-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "11", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "6.000.-", "interpretation": "6000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Oktober 1947", "interpretation": "1947-10-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "11", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "6.221.-", "interpretation": "6221", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1948", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "11", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "6.442.-", "interpretation": "6442", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1949", "interpretation": "1949-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "f0b1836e-9d2c-48f1-9b62-3165f65485ec", "score": {"f1_score": 0.96, "precision": 1.0, "recall": 0.9253731343283582, "true_positives": 62, "false_positives": 0, "false_negatives": 5, "field_scores": {"rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "6.221.-", "ground_truth": "6.221.-", "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": "11", "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-04-14", "ground_truth": "1947-04-14", "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.600.-", "ground_truth": "5.600.-", "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1949-01-01", "ground_truth": "1949-01-01", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": "15", "score": 0.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": "Bern", "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "15", "ground_truth": "15", "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.975.-", "ground_truth": "4.975.-", "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "11", "ground_truth": "11", "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1947", "ground_truth": "1. Juli 1947", "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": "11", "ground_truth": "11", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5600", "ground_truth": "5600", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "14. April 1947", "ground_truth": "14. April 1947", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1948", "ground_truth": "1. Januar 1948", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-10-01", "ground_truth": "1947-10-01", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6000", "ground_truth": "6000", "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "11", "ground_truth": "11", "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "6.000.-", "ground_truth": "6.000.-", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": "11", "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-07-01", "ground_truth": "1947-07-01", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": "11", "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4975", "ground_truth": "4975", "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": "1948-01-01", "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6442", "ground_truth": "6442", "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1949", "ground_truth": "1. Januar 1949", "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Angestellter", "ground_truth": "Angestellter", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Oktober 1947", "ground_truth": "1. Oktober 1947", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6221", "ground_truth": "6221", "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "6.442.-", "ground_truth": "6442.-", "score": 0.923076923076923}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "15", "ground_truth": "15", "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": "15", "score": 0.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 95}, "raw_response": "{\"id\":\"5aa6f200-c230-9ae6-9ff7-437dd4d7ba47\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Angestellter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"15\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.975.-\\\",\\n \\\"interpretation\\\": \\\"4975\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"14. April 1947\\\",\\n \\\"interpretation\\\": \\\"1947-04-14\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"15\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.600.-\\\",\\n \\\"interpretation\\\": \\\"5600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1947\\\",\\n \\\"interpretation\\\": \\\"1947-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"11\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"6.000.-\\\",\\n \\\"interpretation\\\": \\\"6000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Oktober 1947\\\",\\n \\\"interpretation\\\": \\\"1947-10-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"11\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"6.221.-\\\",\\n \\\"interpretation\\\": \\\"6221\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1948\\\",\\n \\\"interpretation\\\": \\\"1948-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"11\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"6.442.-\\\",\\n \\\"interpretation\\\": \\\"6442\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1949\\\",\\n \\\"interpretation\\\": \\\"1949-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Angestellter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"15\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.975.-\",\"interpretation\":\"4975\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"14. April 1947\",\"interpretation\":\"1947-04-14\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"15\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.600.-\",\"interpretation\":\"5600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1947\",\"interpretation\":\"1947-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"11\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"6.000.-\",\"interpretation\":\"6000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Oktober 1947\",\"interpretation\":\"1947-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"11\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"6.221.-\",\"interpretation\":\"6221\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"11\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"6.442.-\",\"interpretation\":\"6442\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1949\",\"interpretation\":\"1949-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1774274671,\"model\":\"grok-4.20-0309-reasoning\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":\"fp_d6e36c82c2\",\"usage\":{\"completion_tokens\":1261,\"prompt_tokens\":2613,\"total_tokens\":6708,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":2834,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":2368,\"text_tokens\":2421,\"image_tokens\":192},\"num_sources_used\":0,\"cost_in_usd_ticks\":255336000}}"}, "scoring": {"f1_micro": 0.823976023976024, "f1_macro": 0.8118032786885246, "micro_precision": 0.8291113791716928, "micro_recall": 0.8189038919777601, "total_instances": 61, "total_tp": 2062, "total_fp": 425, "total_fn": 456, "cost_summary": {"total_input_tokens": 159217, "total_output_tokens": 51305, "total_tokens": 210522, "input_cost_usd": 0.31843400000000016, "output_cost_usd": 0.30783000000000005, "total_cost_usd": 0.626264}}, "normalized_score": 82.3976023976024}, {"_id": {"$oid": "69d4eb12b877594bc5718d02"}, "test_id": "T0704", "benchmark": "personnel_cards", "date": "2026-03-23", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5.3-codex", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "rules": "{\"api_style\":\"responses\"}", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"Techn.Hilfsleiter\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"3'160.-\",\n \"interpretation\": \"3160\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"16. Aug. 1943\",\n \"interpretation\": \"1943-08-16\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"inkl. 400.- techn.Z.\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 2,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\\\"\",\n \"interpretation\": \"Techn.Hilfsleiter\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"3'220.-\",\n \"interpretation\": \"3220\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"1. Jan. 1944\",\n \"interpretation\": \"1944-01-01\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"inkl. 400.- techn.Z.\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 3,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\\\"\",\n \"interpretation\": \"Techn.Hilfsleiter\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"3'490.-\",\n \"interpretation\": \"3490\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"1. Juli 1944\",\n \"interpretation\": \"1944-07-01\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"inkl. 400.-techn.Z.\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 4,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"Techn. Leiter\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"4'090.-\",\n \"interpretation\": \"4090\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"1. Aug. 1944\",\n \"interpretation\": \"1944-08-01\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"inkl. 400.-techn.Z.\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 5,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"20. Okt. 1944\",\n \"interpretation\": \"1944-10-20\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"1/2 Haushaltungszul.\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 6,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\\\"\",\n \"interpretation\": \"Techn. Leiter\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"5.500.-\",\n \"interpretation\": \"5500\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"1. Januar 1945\",\n \"interpretation\": \"1945-01-01\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"+ Zulagen\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 7,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"5'720.-\",\n \"interpretation\": \"5720\",\n \"is_crossed_out\": true\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"?\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"+ Zulagen\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 8,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"1/10 47\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"+ Fr. 160.- pro Monat\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n }\n ]\n}", "model": "gpt-5.3-codex", "provider": "openai", "finish_reason": "completed", "usage": {"input_tokens": 3512, "output_tokens": 2031, "total_tokens": 5543, "input_cost_usd": 0.0061459999999999996, "output_cost_usd": 0.028433999999999997, "estimated_cost_usd": 0.03458}, "duration": 20.94781804084778, "timestamp": "2026-03-23T21:16:55.700433", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Techn.Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'160.-", "interpretation": "3160", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "16. Aug. 1943", "interpretation": "1943-08-16", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.- techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn.Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'220.-", "interpretation": "3220", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.- techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn.Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'490.-", "interpretation": "3490", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1944", "interpretation": "1944-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.-techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Techn. Leiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'090.-", "interpretation": "4090", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Aug. 1944", "interpretation": "1944-08-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.-techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "20. Okt. 1944", "interpretation": "1944-10-20", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "1/2 Haushaltungszul.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn. Leiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.500.-", "interpretation": "5500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5'720.-", "interpretation": "5720", "is_crossed_out": true}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "?", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 8, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1/10 47", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Fr. 160.- pro Monat", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "99d76eea-67c5-4a61-9804-0f548d3d976f", "score": {"f1_score": 0.92, "precision": 0.9333333333333333, "recall": 0.9032258064516129, "true_positives": 84, "false_positives": 6, "false_negatives": 9, "field_scores": {"rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1944", "ground_truth": "1. Juli 1944", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Aug. 1944", "ground_truth": "1. Aug. 1944", "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Technischer Leiter", "score": 0.0}, "rows[5].dienstliche_stellung.interpretation": {"response": "Techn. Leiter", "ground_truth": "Technischer Leiter", "score": 0.7741935483870968}, "rows[7].bemerkungen.diplomatic_transcript": {"response": "+ Fr. 160.- pro Monat", "ground_truth": "+ FZ Fr. 60.- pro Monat", "score": 0.9090909090909091}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'490.-", "ground_truth": "3'490.-", "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Techn.Hilfsleiter", "ground_truth": "Technischer Hilfsleiter", "score": 0.8}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.-techn.Z.", "ground_truth": "inkl. 400.-techn.Z .", "score": 0.9743589743589743}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "?", "ground_truth": "?", "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.- techn.Z.", "ground_truth": "inkl. 400.- techn.Z.", "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": true, "ground_truth": false, "score": 0.2222222222222222}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.500.-", "ground_truth": "5.500.-", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "20. Okt. 1944", "ground_truth": "20. Okt. 1944", "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Techn. Leiter", "ground_truth": "Techn. Leiter", "score": 1.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3160", "ground_truth": "3160", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3490", "ground_truth": "3490", "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5500", "ground_truth": "5500", "score": 1.0}, "rows[7].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1947-10-01", "score": 0.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 1.0}, "rows[7].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1/10 47", "ground_truth": "1' 10 47", "score": 0.8}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-08-01", "ground_truth": "1944-08-01", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4090", "ground_truth": "4090", "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[7].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Techn.Hilfsleiter", "ground_truth": "Techn. Hilfsleiter", "score": 0.9714285714285714}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.- techn.Z.", "ground_truth": "inkl. 400.- techn.Z.", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-08-16", "ground_truth": "1943-08-16", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3220", "ground_truth": "3220", "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5720", "ground_truth": "5720", "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'160.-", "ground_truth": "3'160.-", "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5'720.-", "ground_truth": "5'720.-", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'220.-", "ground_truth": "3'220.-", "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-10-20", "ground_truth": "1944-10-20", "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'090.-", "ground_truth": "4'090.-", "score": 1.0}, "rows[6].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Technischer Hilfsleiter", "score": 0.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Techn.Hilfsleiter", "ground_truth": "Technischer Hilfsleiter", "score": 0.8}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "1/2 Haushaltungszul.", "ground_truth": "1/2 Haushaltungszul.", "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "16. Aug. 1943", "ground_truth": "16. Aug. 1943", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-07-01", "ground_truth": "1944-07-01", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.-techn.Z.", "ground_truth": "inkl. 400.-techn.Z .", "score": 0.9743589743589743}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}}, "total_fields": 152}, "raw_response": "{\"id\":\"resp_0982119b0a787f8d0069c19fa40f6c8190a4c10db834d3bf25\",\"created_at\":1774296996.0,\"error\":null,\"incomplete_details\":null,\"instructions\":\"You are a historian specializing in 20th century personnel records and administrative documents\",\"metadata\":{},\"model\":\"gpt-5.3-codex\",\"object\":\"response\",\"output\":[{\"id\":\"msg_0982119b0a787f8d0069c19fa4adc88190a8dc6e83cd4ae06d\",\"content\":[{\"annotations\":[],\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Techn.Hilfsleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'160.-\\\",\\n \\\"interpretation\\\": \\\"3160\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"16. Aug. 1943\\\",\\n \\\"interpretation\\\": \\\"1943-08-16\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl. 400.- techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Techn.Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'220.-\\\",\\n \\\"interpretation\\\": \\\"3220\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl. 400.- techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Techn.Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'490.-\\\",\\n \\\"interpretation\\\": \\\"3490\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1944\\\",\\n \\\"interpretation\\\": \\\"1944-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl. 400.-techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Techn. Leiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4'090.-\\\",\\n \\\"interpretation\\\": \\\"4090\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Aug. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-08-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl. 400.-techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"20. Okt. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-10-20\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1/2 Haushaltungszul.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 6,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Techn. Leiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.500.-\\\",\\n \\\"interpretation\\\": \\\"5500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1945\\\",\\n \\\"interpretation\\\": \\\"1945-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 7,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5'720.-\\\",\\n \\\"interpretation\\\": \\\"5720\\\",\\n \\\"is_crossed_out\\\": true\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"?\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 8,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1/10 47\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Fr. 160.- pro Monat\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"type\":\"output_text\",\"logprobs\":[]}],\"role\":\"assistant\",\"status\":\"completed\",\"type\":\"message\",\"phase\":\"final_answer\"}],\"parallel_tool_calls\":true,\"temperature\":0.0,\"tool_choice\":\"auto\",\"tools\":[],\"top_p\":0.98,\"background\":false,\"completed_at\":1774297016.0,\"conversation\":null,\"max_output_tokens\":null,\"max_tool_calls\":null,\"previous_response_id\":null,\"prompt\":null,\"prompt_cache_key\":null,\"prompt_cache_retention\":null,\"reasoning\":{\"effort\":\"none\",\"generate_summary\":null,\"summary\":null},\"safety_identifier\":null,\"service_tier\":\"default\",\"status\":\"completed\",\"text\":{\"format\":{\"type\":\"text\"},\"verbosity\":\"medium\"},\"top_logprobs\":0,\"truncation\":\"disabled\",\"usage\":{\"input_tokens\":3512,\"input_tokens_details\":{\"cached_tokens\":1536},\"output_tokens\":2031,\"output_tokens_details\":{\"reasoning_tokens\":0},\"total_tokens\":5543},\"user\":null,\"billing\":{\"payer\":\"developer\"},\"frequency_penalty\":0.0,\"presence_penalty\":0.0,\"store\":true}"}, "scoring": {"f1_micro": 0.9670634920634921, "f1_macro": 0.9119672131147541, "micro_precision": 0.9662965900079302, "micro_recall": 0.9678316123907863, "total_instances": 61, "total_tp": 2437, "total_fp": 85, "total_fn": 81, "cost_summary": {"total_input_tokens": 215826, "total_output_tokens": 51725, "total_tokens": 267551, "input_cost_usd": 0.3776955000000002, "output_cost_usd": 0.72415, "total_cost_usd": 1.1018455000000003}}, "normalized_score": 96.7063492063492}, {"_id": {"$oid": "69d4eb12b877594bc5718d0b"}, "test_id": "T0602", "benchmark": "personnel_cards", "date": "2026-03-23", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "mistral", "model": "mistral-medium-2508", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "", "model": "mistral-medium-2508", "provider": "mistral", "finish_reason": "error", "usage": {"input_tokens": 0, "output_tokens": 0, "total_tokens": 0}, "duration": 2162.00714635849, "timestamp": "2026-03-23T15:27:57.665834", "score": {"f1_score": 0.0, "precision": 0.0, "recall": 0.0, "true_positives": 0, "false_positives": 0, "false_negatives": 0, "field_scores": {"": {"response": null, "ground_truth": null, "score": 1.0}}, "total_fields": 1}}, "scoring": {"f1_micro": 0.00860832137733142, "f1_macro": 0.0013114754098360656, "micro_precision": 0.044444444444444446, "micro_recall": 0.004765687053216839, "total_instances": 61, "total_tp": 12, "total_fp": 258, "total_fn": 2506, "cost_summary": {"total_input_tokens": 1854, "total_output_tokens": 5036, "total_tokens": 6890, "input_cost_usd": 0.0007416, "output_cost_usd": 0.010072, "total_cost_usd": 0.0108136}}, "normalized_score": 0.860832137733142}, {"_id": {"$oid": "69d4eb12b877594bc5718cd2"}, "test_id": "T0704", "benchmark": "personnel_cards", "date": "2026-03-17", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5.3-codex", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "rules": "{\"api_style\":\"responses\"}", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"Techn.Hilfsleiter\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"3'160.-\",\n \"interpretation\": \"3160\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"16. Aug. 1943\",\n \"interpretation\": \"1943-08-16\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"inkl. 400.- techn.Z.\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 2,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\\\"\",\n \"interpretation\": \"Techn.Hilfsleiter\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"3'220.-\",\n \"interpretation\": \"3220\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"1. Jan. 1944\",\n \"interpretation\": \"1944-01-01\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"inkl. 400.- techn.Z.\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 3,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\\\"\",\n \"interpretation\": \"Techn.Hilfsleiter\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"3'490.-\",\n \"interpretation\": \"3490\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"1. Juli 1944\",\n \"interpretation\": \"1944-07-01\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"inkl. 400.-techn.Z.\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 4,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"Techn. Leiter\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"4'090.-\",\n \"interpretation\": \"4090\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"1. Aug. 1944\",\n \"interpretation\": \"1944-08-01\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"inkl. 400.-techn.Z.\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 5,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"20. Okt. 1944\",\n \"interpretation\": \"1944-10-20\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"1/2 Haushaltungszul.\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 6,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\\\"\",\n \"interpretation\": \"Techn. Leiter\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"5.500.-\",\n \"interpretation\": \"5500\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"1. Januar 1945\",\n \"interpretation\": \"1945-01-01\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"+ Zulagen\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 7,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"5'720.-\",\n \"interpretation\": \"5720\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"?\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"+ Zulagen\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n },\n {\n \"row_number\": 8,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"1/10 47\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"+ Fr. 160.- pro Monat\",\n \"interpretation\": null,\n \"is_crossed_out\": false\n }\n }\n ]\n}", "model": "gpt-5.3-codex", "provider": "openai", "finish_reason": "completed", "usage": {"input_tokens": 3512, "output_tokens": 2031, "total_tokens": 5543, "input_cost_usd": 0.0061459999999999996, "output_cost_usd": 0.028433999999999997, "estimated_cost_usd": 0.03458}, "duration": 26.21785068511963, "timestamp": "2026-03-17T22:48:15.390545", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Techn.Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'160.-", "interpretation": "3160", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "16. Aug. 1943", "interpretation": "1943-08-16", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.- techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn.Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'220.-", "interpretation": "3220", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.- techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn.Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'490.-", "interpretation": "3490", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1944", "interpretation": "1944-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.-techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Techn. Leiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'090.-", "interpretation": "4090", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Aug. 1944", "interpretation": "1944-08-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.-techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "20. Okt. 1944", "interpretation": "1944-10-20", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "1/2 Haushaltungszul.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn. Leiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.500.-", "interpretation": "5500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5'720.-", "interpretation": "5720", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "?", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 8, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1/10 47", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Fr. 160.- pro Monat", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "758bb869-3df7-4c3a-8dac-ef417ead6c24", "score": {"f1_score": 0.93, "precision": 0.9444444444444444, "recall": 0.9139784946236559, "true_positives": 85, "false_positives": 5, "false_negatives": 8, "field_scores": {"rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "20. Okt. 1944", "ground_truth": "20. Okt. 1944", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "1/2 Haushaltungszul.", "ground_truth": "1/2 Haushaltungszul.", "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": "Techn. Leiter", "ground_truth": "Technischer Leiter", "score": 0.7741935483870968}, "rows[7].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-07-01", "ground_truth": "1944-07-01", "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'490.-", "ground_truth": "3'490.-", "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'160.-", "ground_truth": "3'160.-", "score": 1.0}, "rows[6].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3490", "ground_truth": "3490", "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1/10 47", "ground_truth": "1' 10 47", "score": 0.8}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-08-01", "ground_truth": "1944-08-01", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3220", "ground_truth": "3220", "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5500", "ground_truth": "5500", "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5'720.-", "ground_truth": "5'720.-", "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.- techn.Z.", "ground_truth": "inkl. 400.- techn.Z.", "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1944", "ground_truth": "1. Juli 1944", "score": 1.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1947-10-01", "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4090", "ground_truth": "4090", "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.-techn.Z.", "ground_truth": "inkl. 400.-techn.Z .", "score": 0.9743589743589743}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3160", "ground_truth": "3160", "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Techn. Leiter", "ground_truth": "Techn. Leiter", "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5720", "ground_truth": "5720", "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "?", "ground_truth": "?", "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.-techn.Z.", "ground_truth": "inkl. 400.-techn.Z .", "score": 0.9743589743589743}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-10-20", "ground_truth": "1944-10-20", "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'090.-", "ground_truth": "4'090.-", "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-08-16", "ground_truth": "1943-08-16", "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].bemerkungen.diplomatic_transcript": {"response": "+ Fr. 160.- pro Monat", "ground_truth": "+ FZ Fr. 60.- pro Monat", "score": 0.9090909090909091}, "rows[7].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Aug. 1944", "ground_truth": "1. Aug. 1944", "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Techn.Hilfsleiter", "ground_truth": "Technischer Hilfsleiter", "score": 0.8}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Techn.Hilfsleiter", "ground_truth": "Techn. Hilfsleiter", "score": 0.9714285714285714}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.500.-", "ground_truth": "5.500.-", "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Techn.Hilfsleiter", "ground_truth": "Technischer Hilfsleiter", "score": 0.8}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.- techn.Z.", "ground_truth": "inkl. 400.- techn.Z.", "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Technischer Hilfsleiter", "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'220.-", "ground_truth": "3'220.-", "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "16. Aug. 1943", "ground_truth": "16. Aug. 1943", "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Technischer Leiter", "score": 0.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 152}, "raw_response": "{\"id\":\"resp_09ba60e7397eaf5a0069b9cc04714c8197823d686593a1bec4\",\"created_at\":1773784068.0,\"error\":null,\"incomplete_details\":null,\"instructions\":\"You are a historian specializing in 20th century personnel records and administrative documents\",\"metadata\":{},\"model\":\"gpt-5.3-codex\",\"object\":\"response\",\"output\":[{\"id\":\"msg_09ba60e7397eaf5a0069b9cc050c2c819782864093944527d9\",\"content\":[{\"annotations\":[],\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Techn.Hilfsleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'160.-\\\",\\n \\\"interpretation\\\": \\\"3160\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"16. Aug. 1943\\\",\\n \\\"interpretation\\\": \\\"1943-08-16\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl. 400.- techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Techn.Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'220.-\\\",\\n \\\"interpretation\\\": \\\"3220\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl. 400.- techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Techn.Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'490.-\\\",\\n \\\"interpretation\\\": \\\"3490\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1944\\\",\\n \\\"interpretation\\\": \\\"1944-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl. 400.-techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Techn. Leiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4'090.-\\\",\\n \\\"interpretation\\\": \\\"4090\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Aug. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-08-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl. 400.-techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"20. Okt. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-10-20\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1/2 Haushaltungszul.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 6,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Techn. Leiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.500.-\\\",\\n \\\"interpretation\\\": \\\"5500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1945\\\",\\n \\\"interpretation\\\": \\\"1945-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 7,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5'720.-\\\",\\n \\\"interpretation\\\": \\\"5720\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"?\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 8,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1/10 47\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Fr. 160.- pro Monat\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"type\":\"output_text\",\"logprobs\":[]}],\"role\":\"assistant\",\"status\":\"completed\",\"type\":\"message\",\"phase\":\"final_answer\"}],\"parallel_tool_calls\":true,\"temperature\":0.0,\"tool_choice\":\"auto\",\"tools\":[],\"top_p\":0.98,\"background\":false,\"completed_at\":1773784093.0,\"conversation\":null,\"max_output_tokens\":null,\"max_tool_calls\":null,\"previous_response_id\":null,\"prompt\":null,\"prompt_cache_key\":null,\"prompt_cache_retention\":null,\"reasoning\":{\"effort\":\"none\",\"generate_summary\":null,\"summary\":null},\"safety_identifier\":null,\"service_tier\":\"default\",\"status\":\"completed\",\"text\":{\"format\":{\"type\":\"text\"},\"verbosity\":\"medium\"},\"top_logprobs\":0,\"truncation\":\"disabled\",\"usage\":{\"input_tokens\":3512,\"input_tokens_details\":{\"cached_tokens\":1536},\"output_tokens\":2031,\"output_tokens_details\":{\"reasoning_tokens\":0},\"total_tokens\":5543},\"user\":null,\"billing\":{\"payer\":\"developer\"},\"frequency_penalty\":0.0,\"presence_penalty\":0.0,\"store\":true}"}, "scoring": {"f1_micro": 0.958556414832441, "f1_macro": 0.9118032786885245, "micro_precision": 0.9572277227722772, "micro_recall": 0.9598888006354249, "total_instances": 61, "total_tp": 2417, "total_fp": 108, "total_fn": 101, "cost_summary": {"total_input_tokens": 215826, "total_output_tokens": 50403, "total_tokens": 266229, "input_cost_usd": 0.3776955000000002, "output_cost_usd": 0.7056420000000001, "total_cost_usd": 1.0833375}}, "normalized_score": 95.8556414832441}, {"_id": {"$oid": "69d4eb12b877594bc5718c90"}, "test_id": "T0692", "benchmark": "personnel_cards", "date": "2026-03-16", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "genai", "model": "gemini-3.1-pro-preview", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\u2013\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'140.\u2013\",\"interpretation\":\"3140\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Dez. 1943\",\"interpretation\":\"1943-12-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.Fr.200.\u2013techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'155.\u2013\",\"interpretation\":\"3155\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl Fr.200.\u2013 techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.525.\u2013\",\"interpretation\":\"4525\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.200.\u2013\",\"interpretation\":\"5200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1945\",\"interpretation\":\"1945-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5420.\u2013\",\"interpretation\":\"5420\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Betr. Techn.\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4700.\u2013\",\"interpretation\":\"4700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Nov. 1946\",\"interpretation\":\"1946-11-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gemini-3.1-pro-preview", "provider": "genai", "finish_reason": "STOP", "usage": {"input_tokens": 2347, "output_tokens": 1758, "total_tokens": 4105, "input_cost_usd": 0.004694, "output_cost_usd": 0.021096, "estimated_cost_usd": 0.02579}, "duration": 16.242645263671875, "timestamp": "2026-03-16T20:10:44.675871", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\u2013", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'140.\u2013", "interpretation": "3140", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Dez. 1943", "interpretation": "1943-12-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl.Fr.200.\u2013techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'155.\u2013", "interpretation": "3155", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl Fr.200.\u2013 techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.525.\u2013", "interpretation": "4525", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Lagerleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.200.\u2013", "interpretation": "5200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1945", "interpretation": "1945-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5420.\u2013", "interpretation": "5420", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "Betr. Techn.", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4700.\u2013", "interpretation": "4700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Nov. 1946", "interpretation": "1946-11-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "7a6ce9a3-a406-4294-b25c-ebfafa4efa0a", "score": {"f1_score": 0.86, "precision": 0.8648648648648649, "recall": 0.8533333333333334, "true_positives": 64, "false_positives": 10, "false_negatives": 11, "field_scores": {"rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.525.\u2013", "ground_truth": "4.525.--", "score": 0.8}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "\u2013", "ground_truth": "-", "score": 0.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1946", "ground_truth": "1.Januar 1946", "score": 0.962962962962963}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-12-01", "ground_truth": "1943-12-01", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4525", "ground_truth": "4525", "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5420", "ground_truth": "5420", "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "inkl Fr.200.\u2013 techn.Z.", "ground_truth": "inkl.Fr.200.- techn.Z.", "score": 0.9090909090909091}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1945", "ground_truth": "1.Juli 1945", "score": 0.9565217391304348}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1.Januar 1945", "score": 0.962962962962963}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'140.\u2013", "ground_truth": "3'140.-", "score": 0.8571428571428572}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Dez. 1943", "ground_truth": "1.Dez. 1943", "score": 0.9565217391304348}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-11-01", "ground_truth": "1946-11-01", "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'155.\u2013", "ground_truth": "3'155.-", "score": 0.8571428571428572}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4700.\u2013", "ground_truth": "4700.-", "score": 0.8333333333333335}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1946-01-01", "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1.Jan.1944", "score": 0.9090909090909091}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Betriebs-Techniker", "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-07-01", "ground_truth": "1945-07-01", "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "Betr. Techn.", "ground_truth": "Betr. Techn.", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.200.\u2013", "ground_truth": "5.200.-", "score": 0.8571428571428572}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3140", "ground_truth": "3140", "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4700", "ground_truth": "4700", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5200", "ground_truth": "5200", "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5420.\u2013", "ground_truth": "5420.-", "score": 0.8333333333333335}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Nov. 1946", "ground_truth": "1.Nov.1946", "score": 0.9090909090909091}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3155", "ground_truth": "3155", "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "inkl.Fr.200.\u2013techn.Z.", "ground_truth": "inkl.Fr.200.-techn.Z.", "score": 0.9523809523809522}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Lagerleiter", "ground_truth": "Lagerleiter", "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}}, "total_fields": 114}, "raw_response": "{\"sdk_http_response\":{\"headers\":{\"content-type\":\"application/json; charset=UTF-8\",\"vary\":\"Origin, X-Origin, Referer\",\"content-encoding\":\"gzip\",\"date\":\"Mon, 16 Mar 2026 19:10:51 GMT\",\"server\":\"scaffolding on HTTPServer2\",\"x-xss-protection\":\"0\",\"x-frame-options\":\"SAMEORIGIN\",\"x-content-type-options\":\"nosniff\",\"server-timing\":\"gfet4t7; dur=15619\",\"alt-svc\":\"h3=\\\":443\\\"; ma=2592000,h3-29=\\\":443\\\"; ma=2592000\",\"transfer-encoding\":\"chunked\"},\"body\":null},\"candidates\":[{\"content\":{\"parts\":[{\"media_resolution\":null,\"code_execution_result\":null,\"executable_code\":null,\"file_data\":null,\"function_call\":null,\"function_response\":null,\"inline_data\":null,\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\u2013\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'140.\u2013\\\",\\n \\\"interpretation\\\": \\\"3140\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Dez. 1943\\\",\\n \\\"interpretation\\\": \\\"1943-12-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl.Fr.200.\u2013techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'155.\u2013\\\",\\n \\\"interpretation\\\": \\\"3155\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl Fr.200.\u2013 techn.Z.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.525.\u2013\\\",\\n \\\"interpretation\\\": \\\"4525\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1945\\\",\\n \\\"interpretation\\\": \\\"1945-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Lagerleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.200.\u2013\\\",\\n \\\"interpretation\\\": \\\"5200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1945\\\",\\n \\\"interpretation\\\": \\\"1945-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5420.\u2013\\\",\\n \\\"interpretation\\\": \\\"5420\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 6,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Betr. Techn.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4700.\u2013\\\",\\n \\\"interpretation\\\": \\\"4700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Nov. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-11-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"thought\":null,\"thought_signature\":\"EjQKMgG-Pvb7ixD1bL4JFdIzFWGo1rKHqjXDH6erXBbGNMmZ05SpEpZALys88-oc1xV0G2fv\",\"video_metadata\":null}],\"role\":\"model\"},\"citation_metadata\":null,\"finish_message\":null,\"token_count\":null,\"finish_reason\":\"STOP\",\"avg_logprobs\":null,\"grounding_metadata\":null,\"index\":0,\"logprobs_result\":null,\"safety_ratings\":null,\"url_context_metadata\":null}],\"create_time\":null,\"model_version\":\"gemini-3.1-pro-preview\",\"prompt_feedback\":null,\"response_id\":\"u1W4aYysIN7v7M8Pj6-d6AU\",\"usage_metadata\":{\"cache_tokens_details\":null,\"cached_content_token_count\":null,\"candidates_token_count\":1758,\"candidates_tokens_details\":null,\"prompt_token_count\":2347,\"prompt_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":1267},{\"modality\":\"IMAGE\",\"token_count\":1080}],\"thoughts_token_count\":null,\"tool_use_prompt_token_count\":null,\"tool_use_prompt_tokens_details\":null,\"total_token_count\":4105,\"traffic_type\":null},\"automatic_function_calling_history\":[],\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\u2013\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'140.\u2013\",\"interpretation\":\"3140\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Dez. 1943\",\"interpretation\":\"1943-12-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.Fr.200.\u2013techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'155.\u2013\",\"interpretation\":\"3155\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl Fr.200.\u2013 techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.525.\u2013\",\"interpretation\":\"4525\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.200.\u2013\",\"interpretation\":\"5200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1945\",\"interpretation\":\"1945-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5420.\u2013\",\"interpretation\":\"5420\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Betr. Techn.\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4700.\u2013\",\"interpretation\":\"4700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Nov. 1946\",\"interpretation\":\"1946-11-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}"}, "scoring": {"f1_micro": 0.9703718433088089, "f1_macro": 0.909016393442623, "micro_precision": 0.9717244125846276, "micro_recall": 0.9690230341540905, "total_instances": 61, "total_tp": 2440, "total_fp": 71, "total_fn": 78, "cost_summary": {"total_input_tokens": 143605, "total_output_tokens": 61209, "total_tokens": 204814, "input_cost_usd": 0.28720999999999997, "output_cost_usd": 0.7345079999999997, "total_cost_usd": 1.0217180000000001}}, "normalized_score": 97.03718433088089}, {"_id": {"$oid": "69d4eb12b877594bc5718c93"}, "test_id": "T0639", "benchmark": "personnel_cards", "date": "2026-03-16", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "anthropic", "model": "claude-opus-4-6", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[]}", "model": "claude-opus-4-6", "provider": "anthropic", "finish_reason": "tool_use", "usage": {"input_tokens": 4072, "output_tokens": 630, "total_tokens": 4702, "input_cost_usd": 0.02036, "output_cost_usd": 0.01575, "estimated_cost_usd": 0.03611}, "duration": 9.042253732681274, "timestamp": "2026-03-16T15:56:23.198873", "parsed": {"parameter": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Rechnungsf\u00fchrer", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "-", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'320.-", "interpretation": "3320", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Aug. 1943", "interpretation": "1943-08-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. Fr.200.- Techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Rechnungsf\u00fchrer", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'395.-", "interpretation": "3395", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl.Fr.200.- techn.Z.", "interpretation": null, "is_crossed_out": false}}]}}, "conversation_id": "fb5bcd92-fe1a-42a5-a187-33eeddbd6812", "score": {"f1_score": 0.0, "precision": 0.0, "recall": 0.0, "true_positives": 0, "false_positives": 26, "false_negatives": 26, "field_scores": {"parameter.rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "parameter.rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Aug. 1943", "ground_truth": null, "score": 0.0}, "parameter.rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "parameter.rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": null, "ground_truth": "1. Jan. 1944", "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "parameter.rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "parameter.rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "inkl. Fr. 200.- techn. Z.", "score": 0.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "parameter.rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "parameter.rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "parameter.rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "parameter.rows[1].bemerkungen.diplomatic_transcript": {"response": "inkl.Fr.200.- techn.Z.", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": "\"", "score": 0.0}, "parameter.rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "parameter.rows[1].dienstliche_stellung.interpretation": {"response": "Rechnungsf\u00fchrer", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1944-01-01", "score": 0.0}, "parameter.rows[0].dienstort.diplomatic_transcript": {"response": "-", "ground_truth": null, "score": 0.0}, "parameter.rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[1].bemerkungen.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "parameter.rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "parameter.rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "parameter.rows[0].bemerkungen.diplomatic_transcript": {"response": "inkl. Fr.200.- Techn.Z.", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1943-08-01", "score": 0.0}, "parameter.rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "parameter.rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": "3320", "score": 0.0}, "parameter.rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Rechnungsf\u00fchrer", "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": "3'320.-", "score": 0.0}, "parameter.rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'395.-", "ground_truth": null, "score": 0.0}, "parameter.rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": "3395", "score": 0.0}, "rows[0].bemerkungen.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "inkl. Fr. 200.- Techn. Z.", "score": 0.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": "-", "score": 0.0}, "parameter.rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Rechnungsf\u00fchrer", "score": 0.0}, "parameter.rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "parameter.rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "parameter.rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": null, "ground_truth": "1. Aug. 1943", "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": "Rechnungsf\u00fchrer", "score": 0.0}, "rows[1].dienstort.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "parameter.rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "parameter.rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "parameter.rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'320.-", "ground_truth": null, "score": 0.0}, "parameter.rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3320", "ground_truth": null, "score": 0.0}, "parameter.rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-08-01", "ground_truth": null, "score": 0.0}, "parameter.rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "parameter.rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3395", "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": "3'395.-", "score": 0.0}, "parameter.rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "parameter.rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "parameter.rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}}, "total_fields": 76}, "raw_response": "{\"id\":\"msg_01EQGRvDLbbjtpiRi2eLSvEK\",\"content\":[{\"id\":\"toolu_01XR9VdqcjWvdEQFQ71JPuSk\",\"input\":{\"parameter\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Rechnungsf\u00fchrer\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"-\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'320.-\",\"interpretation\":\"3320\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Aug. 1943\",\"interpretation\":\"1943-08-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. Fr.200.- Techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Rechnungsf\u00fchrer\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'395.-\",\"interpretation\":\"3395\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.Fr.200.- techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}}]}},\"name\":\"extract_structured_data\",\"type\":\"tool_use\",\"caller\":{\"type\":\"direct\"}}],\"model\":\"claude-opus-4-6\",\"role\":\"assistant\",\"stop_reason\":\"tool_use\",\"stop_sequence\":null,\"type\":\"message\",\"usage\":{\"cache_creation\":{\"ephemeral_1h_input_tokens\":0,\"ephemeral_5m_input_tokens\":0},\"cache_creation_input_tokens\":0,\"cache_read_input_tokens\":0,\"inference_geo\":\"global\",\"input_tokens\":4072,\"output_tokens\":630,\"server_tool_use\":null,\"service_tier\":\"standard\"}}"}, "scoring": {"f1_micro": 0.16178929765886285, "f1_macro": 0.15655737704918035, "micro_precision": 0.1707855251544572, "micro_recall": 0.15369340746624305, "total_instances": 61, "total_tp": 387, "total_fp": 1879, "total_fn": 2131, "cost_summary": {"total_input_tokens": 248371, "total_output_tokens": 59759, "total_tokens": 308130, "input_cost_usd": 1.2418550000000002, "output_cost_usd": 1.4939749999999996, "total_cost_usd": 2.735829999999999}}, "normalized_score": 16.178929765886284}, {"_id": {"$oid": "69d4eb12b877594bc5718c99"}, "test_id": "T0651", "benchmark": "personnel_cards", "date": "2026-03-16", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "anthropic", "model": "claude-sonnet-4-6", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[]}", "model": "claude-sonnet-4-6", "provider": "anthropic", "finish_reason": "tool_use", "usage": {"input_tokens": 4062, "output_tokens": 33, "total_tokens": 4095, "input_cost_usd": 0.012185999999999999, "output_cost_usd": 0.000495, "estimated_cost_usd": 0.012681}, "duration": 1.83892822265625, "timestamp": "2026-03-16T15:55:24.256915", "parsed": {"rows": []}, "conversation_id": "b92ec6c5-4ccc-4110-a2bf-c8d838294abd", "score": {"f1_score": 0.0, "precision": 0.0, "recall": 0.0, "true_positives": 0, "false_positives": 0, "false_negatives": 0, "field_scores": {}, "total_fields": 0}, "raw_response": "{\"id\":\"msg_01VKsh3V2FmoqPBG1uPonzf5\",\"content\":[{\"id\":\"toolu_01Tvs2aSVqybmodThcg5ZE3u\",\"input\":{\"rows\":[]},\"name\":\"extract_structured_data\",\"type\":\"tool_use\",\"caller\":{\"type\":\"direct\"}}],\"model\":\"claude-sonnet-4-6\",\"role\":\"assistant\",\"stop_reason\":\"tool_use\",\"stop_sequence\":null,\"type\":\"message\",\"usage\":{\"cache_creation\":{\"ephemeral_1h_input_tokens\":0,\"ephemeral_5m_input_tokens\":0},\"cache_creation_input_tokens\":0,\"cache_read_input_tokens\":0,\"inference_geo\":\"global\",\"input_tokens\":4062,\"output_tokens\":33,\"server_tool_use\":null,\"service_tier\":\"standard\"}}"}, "scoring": {"f1_micro": 0.9700930877401466, "f1_macro": 0.9118032786885245, "micro_precision": 0.967601738443303, "micro_recall": 0.9725972994440032, "total_instances": 61, "total_tp": 2449, "total_fp": 82, "total_fn": 69, "cost_summary": {"total_input_tokens": 247761, "total_output_tokens": 61316, "total_tokens": 309077, "input_cost_usd": 0.7432829999999999, "output_cost_usd": 0.91974, "total_cost_usd": 1.663023}}, "normalized_score": 97.00930877401466}, {"_id": {"$oid": "69d4eb12b877594bc5718cab"}, "test_id": "T0663", "benchmark": "personnel_cards", "date": "2026-03-16", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5.4-2026-03-05", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2200.-\",\"interpretation\":\"2200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"27. Nov. 44.\",\"interpretation\":\"1944-11-27\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"plus Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3.403.-\",\"interpretation\":\"3403\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.090.-\",\"interpretation\":\"4090\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.September 1945\",\"interpretation\":\"1945-09-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4310.-\",\"interpretation\":\"4310\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.Januar 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4610.-\",\"interpretation\":\"4610\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. April 1946\",\"interpretation\":\"1946-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4910.-\",\"interpretation\":\"4910\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1946\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5130.-\",\"interpretation\":\"5130\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gpt-5.4-2026-03-05", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 4937, "output_tokens": 1206, "total_tokens": 6143, "cached_tokens": 2048, "input_cost_usd": 0.012342500000000001, "output_cost_usd": 0.018090000000000002, "estimated_cost_usd": 0.0304325}, "duration": 13.022216320037842, "timestamp": "2026-03-16T17:19:56.503590", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2200.-", "interpretation": "2200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "27. Nov. 44.", "interpretation": "1944-11-27", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "plus Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3.403.-", "interpretation": "3403", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "Lagerleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.090.-", "interpretation": "4090", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1.September 1945", "interpretation": "1945-09-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4310.-", "interpretation": "4310", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1.Januar 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4610.-", "interpretation": "4610", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. April 1946", "interpretation": "1946-04-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4910.-", "interpretation": "4910", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1946", "interpretation": "1946-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5130.-", "interpretation": "5130", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "df6baa20-93fd-4044-8d74-daca42324f28", "score": {"f1_score": 1.0, "precision": 1.0, "recall": 1.0, "true_positives": 81, "false_positives": 0, "false_negatives": 0, "field_scores": {"rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3403", "ground_truth": "3403", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1946-01-01", "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1.September 1945", "ground_truth": "1. September 1945", "score": 0.9696969696969697}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4310.-", "ground_truth": "4310.-", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "27. Nov. 44.", "ground_truth": "27. Nov. 44.", "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5130.-", "ground_truth": "5130.-", "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1946", "ground_truth": "1. Juli 1946", "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "plus Zulagen", "ground_truth": "plus Zulagen", "score": 1.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-04-01", "ground_truth": "1946-04-01", "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3.403.-", "ground_truth": "3.403.-", "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-09-01", "ground_truth": "1945-09-01", "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": "1. Jan. 1947", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4610.-", "ground_truth": "4610.-", "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[6].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-11-27", "ground_truth": "1944-11-27", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2200.-", "ground_truth": "2200.-", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4310", "ground_truth": "4310", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "Lagerleiterin", "ground_truth": "Lagerleiterin", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4910", "ground_truth": "4910", "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1.Januar 1946", "ground_truth": "1. Januar 1946", "score": 0.962962962962963}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5130", "ground_truth": "5130", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-07-01", "ground_truth": "1946-07-01", "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2200", "ground_truth": "2200", "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. April 1946", "ground_truth": "1. April 1946", "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4910.-", "ground_truth": "4910.-", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4090", "ground_truth": "4090", "score": 1.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4610", "ground_truth": "4610", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.090.-", "ground_truth": "4.090.--", "score": 0.9333333333333332}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}}, "total_fields": 133}, "raw_response": "{\"id\":\"chatcmpl-DK4xTBMJqhtHbS2488uJbGSs6eoYy\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2200.-\\\",\\\"interpretation\\\":\\\"2200\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"27. Nov. 44.\\\",\\\"interpretation\\\":\\\"1944-11-27\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"plus Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiterin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3.403.-\\\",\\\"interpretation\\\":\\\"3403\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Januar 1945\\\",\\\"interpretation\\\":\\\"1945-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":3,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Lagerleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4.090.-\\\",\\\"interpretation\\\":\\\"4090\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1.September 1945\\\",\\\"interpretation\\\":\\\"1945-09-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":4,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4310.-\\\",\\\"interpretation\\\":\\\"4310\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1.Januar 1946\\\",\\\"interpretation\\\":\\\"1946-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":5,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4610.-\\\",\\\"interpretation\\\":\\\"4610\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. April 1946\\\",\\\"interpretation\\\":\\\"1946-04-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":6,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4910.-\\\",\\\"interpretation\\\":\\\"4910\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Juli 1946\\\",\\\"interpretation\\\":\\\"1946-07-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":7,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"5130.-\\\",\\\"interpretation\\\":\\\"5130\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 1947\\\",\\\"interpretation\\\":\\\"1947-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2200.-\",\"interpretation\":\"2200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"27. Nov. 44.\",\"interpretation\":\"1944-11-27\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"plus Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3.403.-\",\"interpretation\":\"3403\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.090.-\",\"interpretation\":\"4090\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.September 1945\",\"interpretation\":\"1945-09-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4310.-\",\"interpretation\":\"4310\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.Januar 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4610.-\",\"interpretation\":\"4610\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. April 1946\",\"interpretation\":\"1946-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4910.-\",\"interpretation\":\"4910\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1946\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5130.-\",\"interpretation\":\"5130\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1773677991,\"model\":\"gpt-5.4-2026-03-05\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":1206,\"prompt_tokens\":4937,\"total_tokens\":6143,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":2048}}}"}, "scoring": {"f1_micro": 0.9677419354838711, "f1_macro": 0.909016393442623, "micro_precision": 0.9644970414201184, "micro_recall": 0.9710087370929309, "total_instances": 61, "total_tp": 2445, "total_fp": 90, "total_fn": 73, "cost_summary": {"total_input_tokens": 300707, "total_output_tokens": 36749, "total_tokens": 337456, "input_cost_usd": 0.7517675000000005, "output_cost_usd": 0.5512349999999999, "total_cost_usd": 1.3030025}}, "normalized_score": 96.77419354838712}, {"_id": {"$oid": "69d4eb12b877594bc5718cb9"}, "test_id": "T0680", "benchmark": "personnel_cards", "date": "2026-03-16", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "genai", "model": "gemini-3.1-flash-lite-preview", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3.000.-\",\"interpretation\":\"3000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"4. Juni 1945\",\"interpretation\":\"1945-06-04\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gemini-3.1-flash-lite-preview", "provider": "genai", "finish_reason": "STOP", "usage": {"input_tokens": 2359, "output_tokens": 301, "total_tokens": 2660, "input_cost_usd": 0.00058975, "output_cost_usd": 0.00045149999999999997, "estimated_cost_usd": 0.00104125}, "duration": 2.672137975692749, "timestamp": "2026-03-16T19:10:27.178743", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3.000.-", "interpretation": "3000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "4. Juni 1945", "interpretation": "1945-06-04", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "4d996470-faf1-4b95-86d4-bf6679bc78c6", "score": {"f1_score": 1.0, "precision": 1.0, "recall": 1.0, "true_positives": 12, "false_positives": 0, "false_negatives": 0, "field_scores": {"rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3.000.-", "ground_truth": "3.000.-", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "4. Juni 1945", "ground_truth": "4. Juni 1945", "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-06-04", "ground_truth": "1945-06-04", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3000", "ground_truth": "3000", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 19}, "raw_response": "{\"sdk_http_response\":{\"headers\":{\"content-type\":\"application/json; charset=UTF-8\",\"vary\":\"Origin, X-Origin, Referer\",\"content-encoding\":\"gzip\",\"date\":\"Mon, 16 Mar 2026 18:10:34 GMT\",\"server\":\"scaffolding on HTTPServer2\",\"x-xss-protection\":\"0\",\"x-frame-options\":\"SAMEORIGIN\",\"x-content-type-options\":\"nosniff\",\"server-timing\":\"gfet4t7; dur=2525\",\"alt-svc\":\"h3=\\\":443\\\"; ma=2592000,h3-29=\\\":443\\\"; ma=2592000\",\"transfer-encoding\":\"chunked\"},\"body\":null},\"candidates\":[{\"content\":{\"parts\":[{\"media_resolution\":null,\"code_execution_result\":null,\"executable_code\":null,\"file_data\":null,\"function_call\":null,\"function_response\":null,\"inline_data\":null,\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3.000.-\\\",\\n \\\"interpretation\\\": \\\"3000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4. Juni 1945\\\",\\n \\\"interpretation\\\": \\\"1945-06-04\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"thought\":null,\"thought_signature\":\"EjQKMgG-Pvb7O6SKgrnFg6t0YTQztnWYeUIhq1RuYP6Ur-FncqrC_EJ8l25RE6ARSs3oTYaj\",\"video_metadata\":null}],\"role\":\"model\"},\"citation_metadata\":null,\"finish_message\":null,\"token_count\":null,\"finish_reason\":\"STOP\",\"avg_logprobs\":null,\"grounding_metadata\":null,\"index\":0,\"logprobs_result\":null,\"safety_ratings\":null,\"url_context_metadata\":null}],\"create_time\":null,\"model_version\":\"gemini-3.1-flash-lite-preview\",\"prompt_feedback\":null,\"response_id\":\"mUe4aea0O8T1xs0PsOingA0\",\"usage_metadata\":{\"cache_tokens_details\":null,\"cached_content_token_count\":null,\"candidates_token_count\":301,\"candidates_tokens_details\":null,\"prompt_token_count\":2359,\"prompt_tokens_details\":[{\"modality\":\"IMAGE\",\"token_count\":1092},{\"modality\":\"TEXT\",\"token_count\":1267}],\"thoughts_token_count\":null,\"tool_use_prompt_token_count\":null,\"tool_use_prompt_tokens_details\":null,\"total_token_count\":2660,\"traffic_type\":null},\"automatic_function_calling_history\":[],\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3.000.-\",\"interpretation\":\"3000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"4. Juni 1945\",\"interpretation\":\"1945-06-04\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}"}, "scoring": {"f1_micro": 0.967384858667721, "f1_macro": 0.9080327868852459, "micro_precision": 0.9630066902794175, "micro_recall": 0.971803018268467, "total_instances": 61, "total_tp": 2447, "total_fp": 94, "total_fn": 71, "cost_summary": {"total_input_tokens": 143605, "total_output_tokens": 60244, "total_tokens": 203849, "input_cost_usd": 0.035901249999999996, "output_cost_usd": 0.09036599999999997, "total_cost_usd": 0.12626725}}, "normalized_score": 96.7384858667721}, {"_id": {"$oid": "69d4eb12b877594bc5718c51"}, "test_id": "T0604", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "mistral", "model": "pixtral-large-2411", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Assistent\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Assistent\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Basel\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'900.-\",\"interpretation\":\"3900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. April 1947\",\"interpretation\":\"1947-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Sekret\u00e4r\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 4'200.-\",\"interpretation\":\"4200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1950\",\"interpretation\":\"1950-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Bef\u00f6rderung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Professor\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Genf\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"II\",\"interpretation\":\"2\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 6'300.-\",\"interpretation\":\"6300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Okt. 1955\",\"interpretation\":\"1955-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Ernennung\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "pixtral-large-2411", "provider": "mistral", "finish_reason": "stop", "usage": {"input_tokens": 2000, "output_tokens": 1339, "total_tokens": 3339, "input_cost_usd": 0.004, "output_cost_usd": 0.008034, "estimated_cost_usd": 0.012034}, "duration": 19.74574112892151, "timestamp": "2026-02-10T09:56:59.873361", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Assistent", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Assistent", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Basel", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'900.-", "interpretation": "3900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. April 1947", "interpretation": "1947-04-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "Sekret\u00e4r", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 4'200.-", "interpretation": "4200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1950", "interpretation": "1950-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Bef\u00f6rderung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Professor", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Genf", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "II", "interpretation": "2", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 6'300.-", "interpretation": "6300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Okt. 1955", "interpretation": "1955-10-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Ernennung", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "c1d3b092-bda1-4e4e-8740-559d7dc49fba", "score": {"f1_score": 0.45, "precision": 0.4, "recall": 0.5217391304347826, "true_positives": 24, "false_positives": 36, "false_negatives": 22, "field_scores": {"rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Assistent", "ground_truth": "Hilfsleiterin,", "score": 0.43478260869565216}, "rows[1].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 6'300.-", "ground_truth": "3238.-", "score": 0.3529411764705882}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "Bef\u00f6rderung", "ground_truth": "+ Zulagen", "score": 0.19999999999999996}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6300", "ground_truth": "3238", "score": 0.25}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1950", "ground_truth": "1. Jan. 47", "score": 0.7272727272727273}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "II", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3900", "ground_truth": "2850", "score": 0.25}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'900.-", "ground_truth": "2850.-", "score": 0.3529411764705882}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Assistent", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1945-12-17", "score": 0.7}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4200", "ground_truth": "3100", "score": 0.5}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "Ernennung", "ground_truth": "+ Zulagen", "score": 0.2222222222222222}, "rows[2].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": "17. Dez. 45", "score": 0.5217391304347826}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-04-01", "ground_truth": "1946-07-01", "score": 0.8}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": "2700", "score": 0.75}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1950-01-01", "ground_truth": "1947-01-01", "score": 0.8}, "rows[2].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 4'200.-", "ground_truth": "3100.-", "score": 0.4705882352941176}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Okt. 1955", "ground_truth": "1. Jan. 48", "score": 0.4545454545454546}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Professor", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "Sekret\u00e4r", "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'700.-", "ground_truth": "2700.-", "score": 0.5882352941176471}, "rows[3].gehaltsklasse.interpretation": {"response": "2", "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Hilfsleiterin", "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1955-10-01", "ground_truth": "1948-01-01", "score": 0.7}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. April 1947", "ground_truth": "1. Juli 46", "score": 0.5217391304347826}, "rows[1].dienstort.interpretation": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.diplomatic_transcript": {"response": "Genf", "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 76}, "raw_response": "{\"id\":\"008ef6f3764d4a68907d25de7111c8d0\",\"object\":\"chat.completion\",\"model\":\"pixtral-large-2411\",\"usage\":{\"prompt_tokens\":2000,\"completion_tokens\":1339,\"total_tokens\":3339,\"num_cached_tokens\":1984},\"created\":1770713800,\"choices\":[{\"index\":0,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Assistent\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Assistent\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Basel\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'900.-\\\",\\n \\\"interpretation\\\": \\\"3900\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. April 1947\\\",\\n \\\"interpretation\\\": \\\"1947-04-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Sekret\u00e4r\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 4'200.-\\\",\\n \\\"interpretation\\\": \\\"4200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1950\\\",\\n \\\"interpretation\\\": \\\"1950-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bef\u00f6rderung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Professor\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Genf\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"II\\\",\\n \\\"interpretation\\\": \\\"2\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 6'300.-\\\",\\n \\\"interpretation\\\": \\\"6300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Okt. 1955\\\",\\n \\\"interpretation\\\": \\\"1955-10-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Ernennung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"tool_calls\":null,\"prefix\":false,\"role\":\"assistant\"},\"finish_reason\":\"stop\"}]}"}, "scoring": {"f1_micro": 0.22749554367201424, "f1_macro": 0.2695081967213115, "micro_precision": 0.1580984825023227, "micro_recall": 0.4054805401111994, "total_instances": 61, "total_tp": 1021, "total_fp": 5437, "total_fn": 1497, "cost_summary": {"total_input_tokens": 122000, "total_output_tokens": 144302, "total_tokens": 266302, "input_cost_usd": 0.2440000000000002, "output_cost_usd": 0.8658119999999999, "total_cost_usd": 1.109812}}, "normalized_score": 22.749554367201423}, {"_id": {"$oid": "69d4eb12b877594bc5718c57"}, "test_id": "T0611", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5-mini", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\u2713\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4200.-\",\"interpretation\":\"4200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"3. April 1946\",\"interpretation\":\"1946-04-03\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4300.-\",\"interpretation\":\"4300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gpt-5-mini-2025-08-07", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 4018, "output_tokens": 1703, "total_tokens": 5721, "cached_tokens": 1664, "input_cost_usd": 0.0010045, "output_cost_usd": 0.003406, "estimated_cost_usd": 0.0044105}, "duration": 25.476990938186646, "timestamp": "2026-02-10T00:44:05.924996", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\u2713", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4200.-", "interpretation": "4200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "3. April 1946", "interpretation": "1946-04-03", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4300.-", "interpretation": "4300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "732bba7a-f645-41ff-ba3b-46dfe01abf7a", "score": {"f1_score": 0.94, "precision": 0.9583333333333334, "recall": 0.92, "true_positives": 23, "false_positives": 1, "false_negatives": 2, "field_scores": {"rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4300", "ground_truth": "4300", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "3. April 1946", "ground_truth": "3. April 1946", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-04-03", "ground_truth": "1946-04-03", "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": "1. Jan. 1947", "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4200", "ground_truth": "4200", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4300.-", "ground_truth": "4300.--", "score": 0.923076923076923}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "\u2713", "ground_truth": "V", "score": 0.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": "5", "score": 0.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4200.-", "ground_truth": "4200.--", "score": 0.923076923076923}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}}, "total_fields": 38}, "raw_response": "{\"id\":\"chatcmpl-D7VCo86twSANE9EPy6UClcqTL3UjC\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiter\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\u2713\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4200.-\\\",\\\"interpretation\\\":\\\"4200\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"3. April 1946\\\",\\\"interpretation\\\":\\\"1946-04-03\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4300.-\\\",\\\"interpretation\\\":\\\"4300\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 1947\\\",\\\"interpretation\\\":\\\"1947-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\u2713\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4200.-\",\"interpretation\":\"4200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"3. April 1946\",\"interpretation\":\"1946-04-03\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4300.-\",\"interpretation\":\"4300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1770680622,\"model\":\"gpt-5-mini-2025-08-07\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":1703,\"prompt_tokens\":4018,\"total_tokens\":5721,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":1344,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1664}}}"}, "scoring": {"f1_micro": 0.9255008753160863, "f1_macro": 0.8727868852459016, "micro_precision": 0.9300234558248631, "micro_recall": 0.9210220673635308, "total_instances": 61, "total_tp": 2379, "total_fp": 179, "total_fn": 204, "cost_summary": {"total_input_tokens": 243335, "total_output_tokens": 166399, "total_tokens": 409734, "input_cost_usd": 0.060833749999999964, "output_cost_usd": 0.33279799999999987, "total_cost_usd": 0.3936317499999999}}, "normalized_score": 92.55008753160863}, {"_id": {"$oid": "69d4eb12b877594bc5718c5a"}, "test_id": "T0603", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "mistral", "model": "mistral-small-2506", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Assistent\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3.700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.April 1945\",\"interpretation\":\"1945-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Provisorisch\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.094.-\",\"interpretation\":\"5094\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1946\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Definitiv\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Leiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"VI\",\"interpretation\":\"6\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"6.30.-\",\"interpretation\":\"6.3\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Erh\u00f6ht\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "mistral-small-2506", "provider": "mistral", "finish_reason": "stop", "usage": {"input_tokens": 1810, "output_tokens": 1130, "total_tokens": 2940, "input_cost_usd": 0.000181, "output_cost_usd": 0.00033899999999999995, "estimated_cost_usd": 0.00052}, "duration": 9.83842420578003, "timestamp": "2026-02-10T09:25:05.073622", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Assistent", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'400.-", "interpretation": "2400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3.700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1.April 1945", "interpretation": "1945-04-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Provisorisch", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": "5", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.094.-", "interpretation": "5094", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1946", "interpretation": "1946-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Definitiv", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Leiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "VI", "interpretation": "6", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "6.30.-", "interpretation": "6.3", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Erh\u00f6ht", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "7aea5ddd-29cd-4ecb-a836-e63e8cce963a", "score": {"f1_score": 0.38, "precision": 0.3, "recall": 0.5294117647058824, "true_positives": 18, "false_positives": 42, "false_negatives": 16, "field_scores": {"rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.094.-", "ground_truth": "4945.-", "score": 0.6153846153846154}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1946", "ground_truth": "1. Januar 1947", "score": 0.6923076923076923}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6.3", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5094", "ground_truth": "4945", "score": 0.5}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1.April 1945", "ground_truth": "1. Januar 1946", "score": 0.5384615384615384}, "rows[1].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'400.-", "ground_truth": "4600.-", "score": 0.5882352941176471}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[2].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1945-12-01", "score": 0.8}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "VI", "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "Definitiv", "ground_truth": "+ Zulagen", "score": 0.2222222222222222}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3.700.-", "ground_truth": "4765.-", "score": 0.4615384615384615}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-04-01", "ground_truth": "1946-01-01", "score": 0.8}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": "1. Dez. 45", "score": 0.5454545454545454}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "Provisorisch", "ground_truth": "+ Zulagen", "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": "4765", "score": 0.25}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Assistent", "ground_truth": "Hilfsleiter", "score": 0.4}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Leiter", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].gehaltsklasse.interpretation": {"response": "6", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.interpretation": {"response": "5", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-07-01", "ground_truth": "1947-01-01", "score": 0.8}, "rows[0].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "6.30.-", "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "Erh\u00f6ht", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2400", "ground_truth": "4600", "score": 0.75}}, "total_fields": 76}, "raw_response": "{\"id\":\"b27e5fdc24f54fc4886b37100986e01d\",\"object\":\"chat.completion\",\"model\":\"mistral-small-2506\",\"usage\":{\"prompt_tokens\":1810,\"completion_tokens\":1130,\"total_tokens\":2940,\"num_cached_tokens\":0},\"created\":1770711895,\"choices\":[{\"index\":0,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Assistent\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'400.-\\\",\\n \\\"interpretation\\\": \\\"2400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3.700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1.April 1945\\\",\\n \\\"interpretation\\\": \\\"1945-04-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Provisorisch\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": \\\"5\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.094.-\\\",\\n \\\"interpretation\\\": \\\"5094\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1946\\\",\\n \\\"interpretation\\\": \\\"1946-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Definitiv\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Leiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"VI\\\",\\n \\\"interpretation\\\": \\\"6\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"6.30.-\\\",\\n \\\"interpretation\\\": \\\"6.3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1947\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Erh\u00f6ht\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"tool_calls\":null,\"prefix\":false,\"role\":\"assistant\"},\"finish_reason\":\"stop\"}]}"}, "scoring": {"f1_micro": 0.23295322317896205, "f1_macro": 0.2834426229508197, "micro_precision": 0.16474654377880185, "micro_recall": 0.39753772835583795, "total_instances": 61, "total_tp": 1001, "total_fp": 5075, "total_fn": 1517, "cost_summary": {"total_input_tokens": 110410, "total_output_tokens": 115108, "total_tokens": 225518, "input_cost_usd": 0.011041000000000006, "output_cost_usd": 0.034532400000000005, "total_cost_usd": 0.04557339999999999}}, "normalized_score": 23.295322317896204}, {"_id": {"$oid": "69d4eb12b877594bc5718c5b"}, "test_id": "T0609", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-4o-mini", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4800.-\",\"interpretation\":\"4800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"17. Dez. 45\",\"interpretation\":\"1945-12-17\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ Zulagen\",\"is_crossed_out\":false}}]}", "model": "gpt-4o-mini-2024-07-18", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 39031, "output_tokens": 269, "total_tokens": 39300, "cached_tokens": 1920, "input_cost_usd": 0.00585465, "output_cost_usd": 0.0001614, "estimated_cost_usd": 0.00601605}, "duration": 7.6698384284973145, "timestamp": "2026-02-10T00:17:11.732146", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": "5", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4800.-", "interpretation": "4800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "17. Dez. 45", "interpretation": "1945-12-17", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": "+ Zulagen", "is_crossed_out": false}}]}, "conversation_id": "98b3b7d8-0942-456e-b968-abe93ecba31a", "score": {"f1_score": 0.93, "precision": 0.875, "recall": 1.0, "true_positives": 14, "false_positives": 2, "false_negatives": 0, "field_scores": {"rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4800", "ground_truth": "4800", "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": "5", "ground_truth": "5", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": "V", "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": "+ Zulagen", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-12-17", "ground_truth": "1945-12-17", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "17. Dez. 45", "ground_truth": "17. Dez. 45", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4800.-", "ground_truth": "4800.-", "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}}, "total_fields": 19}, "raw_response": "{\"id\":\"chatcmpl-D7Un323MHOGn4wJVLndUk9bbfuDyN\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": \\\"5\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4800.-\\\",\\n \\\"interpretation\\\": \\\"4800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"17. Dez. 45\\\",\\n \\\"interpretation\\\": \\\"1945-12-17\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": \\\"+ Zulagen\\\",\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4800.-\",\"interpretation\":\"4800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"17. Dez. 45\",\"interpretation\":\"1945-12-17\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ Zulagen\",\"is_crossed_out\":false}}]}}}],\"created\":1770679025,\"model\":\"gpt-4o-mini-2024-07-18\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":\"fp_f4ae844694\",\"usage\":{\"completion_tokens\":269,\"prompt_tokens\":39031,\"total_tokens\":39300,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1920}}}"}, "scoring": {"f1_micro": 0.746145167356149, "f1_macro": 0.748688524590164, "micro_precision": 0.7254113345521024, "micro_recall": 0.7680991095625243, "total_instances": 61, "total_tp": 1984, "total_fp": 751, "total_fn": 599, "cost_summary": {"total_input_tokens": 2380891, "total_output_tokens": 51524, "total_tokens": 2432415, "input_cost_usd": 0.35713365000000014, "output_cost_usd": 0.030914399999999988, "total_cost_usd": 0.3880480500000001}}, "normalized_score": 74.6145167356149}, {"_id": {"$oid": "69d4eb12b877594bc5718c5c"}, "test_id": "T0615", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "o3", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'800.-\",\"interpretation\":\"2800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Nov. 1944\",\"interpretation\":\"1944-11-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ Zulagen\",\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.015.-\",\"interpretation\":\"4015\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ Zulagen\",\"is_crossed_out\":false}}]}", "model": "o3-2025-04-16", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 3170, "output_tokens": 1272, "total_tokens": 4442, "cached_tokens": 1664, "input_cost_usd": 0.00634, "output_cost_usd": 0.010176, "estimated_cost_usd": 0.016516}, "duration": 24.0093252658844, "timestamp": "2026-02-10T00:25:43.233033", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'800.-", "interpretation": "2800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Nov. 1944", "interpretation": "1944-11-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": "+ Zulagen", "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.015.-", "interpretation": "4015", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": "+ Zulagen", "is_crossed_out": false}}]}, "conversation_id": "91db60e1-0d38-4d72-ab3f-a40ffdb73d04", "score": {"f1_score": 0.96, "precision": 0.9259259259259259, "recall": 1.0, "true_positives": 25, "false_positives": 2, "false_negatives": 0, "field_scores": {"rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.015.-", "ground_truth": "4.015.-", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Nov. 1944", "ground_truth": "1. Nov. 1944", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-11-01", "ground_truth": "1944-11-01", "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": "+ Zulagen", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4015", "ground_truth": "4015", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2800", "ground_truth": "2800", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": "+ Zulagen", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'800.-", "ground_truth": "2'800.-", "score": 1.0}}, "total_fields": 38}, "raw_response": "{\"id\":\"chatcmpl-D7Uv3bfxZhbe0WcKUozvL2s0iHEAT\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'800.-\\\",\\\"interpretation\\\":\\\"2800\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Nov. 1944\\\",\\\"interpretation\\\":\\\"1944-11-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":\\\"+ Zulagen\\\",\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiterin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4.015.-\\\",\\\"interpretation\\\":\\\"4015\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Januar 1945\\\",\\\"interpretation\\\":\\\"1945-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":\\\"+ Zulagen\\\",\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'800.-\",\"interpretation\":\"2800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Nov. 1944\",\"interpretation\":\"1944-11-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ Zulagen\",\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.015.-\",\"interpretation\":\"4015\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ Zulagen\",\"is_crossed_out\":false}}]}}}],\"created\":1770679521,\"model\":\"o3-2025-04-16\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":1272,\"prompt_tokens\":3170,\"total_tokens\":4442,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":896,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1664}}}"}, "scoring": {"f1_micro": 0.9079073329504117, "f1_macro": 0.8559016393442623, "micro_precision": 0.8981060606060606, "micro_recall": 0.9179248935346497, "total_instances": 61, "total_tp": 2371, "total_fp": 269, "total_fn": 212, "cost_summary": {"total_input_tokens": 193370, "total_output_tokens": 145111, "total_tokens": 338481, "input_cost_usd": 0.3867400000000005, "output_cost_usd": 1.160888, "total_cost_usd": 1.547628}}, "normalized_score": 90.79073329504116}, {"_id": {"$oid": "69d4eb12b877594bc5718c5d"}, "test_id": "T0613", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5.1-2025-11-13", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"G\u00e4rtnerin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"190.-\",\"interpretation\":\"190\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"15. Okt. 1942\",\"interpretation\":\"1942-10-15\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Teuerungszulage\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'120.-\",\"interpretation\":\"2120\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1943\",\"interpretation\":\"1943-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'280.-\",\"interpretation\":\"2280\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'200.-\",\"interpretation\":\"2200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. M\u00e4rz 1944\",\"interpretation\":\"1944-03-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'800.-\",\"interpretation\":\"2800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. August 1944\",\"interpretation\":\"1944-08-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'140.-\",\"interpretation\":\"4140\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juni 1945\",\"interpretation\":\"1945-06-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+. Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gpt-5.1-2025-11-13", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 3105, "output_tokens": 1234, "total_tokens": 4339, "cached_tokens": 2176, "input_cost_usd": 0.00388125, "output_cost_usd": 0.01234, "estimated_cost_usd": 0.01622125}, "duration": 11.930987119674683, "timestamp": "2026-02-10T01:59:27.546825", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "G\u00e4rtnerin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "190.-", "interpretation": "190", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "15. Okt. 1942", "interpretation": "1942-10-15", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Teuerungszulage", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "G\u00e4rtnerin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'120.-", "interpretation": "2120", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1943", "interpretation": "1943-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": ".", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "G\u00e4rtnerin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'280.-", "interpretation": "2280", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": ".", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "G\u00e4rtnerin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'200.-", "interpretation": "2200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. M\u00e4rz 1944", "interpretation": "1944-03-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": ".", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'800.-", "interpretation": "2800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. August 1944", "interpretation": "1944-08-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": ".", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'140.-", "interpretation": "4140", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "Lagerleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juni 1945", "interpretation": "1945-06-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+. Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "1b1fbd55-3ebe-4bc7-8217-62773146bb14", "score": {"f1_score": 0.9, "precision": 0.875, "recall": 0.9166666666666666, "true_positives": 77, "false_positives": 11, "false_negatives": 7, "field_scores": {"rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2200", "ground_truth": "200", "score": 0.8571428571428572}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "15. Okt. 1942", "ground_truth": "15. Okt. 1942", "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-06-01", "ground_truth": "1945-06-01", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'280.-", "ground_truth": "2'280.-", "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. M\u00e4rz 1944", "ground_truth": "1. M\u00e4rz 1944", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "190", "ground_truth": "190", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'120.-", "ground_truth": "2'280.--", "score": 0.8}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": ".", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": ".", "ground_truth": null, "score": 0.0}, "rows[5].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'140.-", "ground_truth": "4.140.--", "score": 0.8}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2120", "ground_truth": "2280", "score": 0.75}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-03-01", "ground_truth": "1944-03-01", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'200.-", "ground_truth": "200.-", "score": 0.8333333333333335}, "rows[6].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": ".", "ground_truth": null, "score": 0.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'600.-", "ground_truth": "4.600.--", "score": 0.8}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4600", "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. August 1944", "ground_truth": "1. August 1944", "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "190.-", "ground_truth": "190.--", "score": 0.9090909090909091}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-01-01", "ground_truth": "1943-01-01", "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Teuerungszulage", "ground_truth": "+ Teuerungszulage", "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2800", "ground_truth": "2800", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1942-10-15", "ground_truth": "1942-10-15", "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juni 1945", "ground_truth": "1. Juni 1945", "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2280", "ground_truth": "2280", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1943", "ground_truth": "1. Jan. 1943", "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'800.-", "ground_truth": "2'800.--", "score": 0.9333333333333332}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4140", "ground_truth": "4140", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-08-01", "ground_truth": "1944-08-01", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[6].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": "Lagerleiterin", "ground_truth": "Lagerleiterin", "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": "+. Zulagen", "ground_truth": "+ Zulagen", "score": 0.9473684210526316}, "rows[3].bemerkungen.diplomatic_transcript": {"response": ".", "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}}, "total_fields": 133}, "raw_response": "{\"id\":\"chatcmpl-D7WNxLASx5MvsBG1Wh7H2sCdXt67l\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"G\u00e4rtnerin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"190.-\\\",\\\"interpretation\\\":\\\"190\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"15. Okt. 1942\\\",\\\"interpretation\\\":\\\"1942-10-15\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Teuerungszulage\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"G\u00e4rtnerin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'120.-\\\",\\\"interpretation\\\":\\\"2120\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 1943\\\",\\\"interpretation\\\":\\\"1943-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\".\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":3,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"G\u00e4rtnerin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'280.-\\\",\\\"interpretation\\\":\\\"2280\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 1944\\\",\\\"interpretation\\\":\\\"1944-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\".\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":4,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"G\u00e4rtnerin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'200.-\\\",\\\"interpretation\\\":\\\"2200\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. M\u00e4rz 1944\\\",\\\"interpretation\\\":\\\"1944-03-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\".\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":5,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'800.-\\\",\\\"interpretation\\\":\\\"2800\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. August 1944\\\",\\\"interpretation\\\":\\\"1944-08-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\".\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":6,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiterin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4'140.-\\\",\\\"interpretation\\\":\\\"4140\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Januar 1945\\\",\\\"interpretation\\\":\\\"1945-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":7,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Lagerleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4'600.-\\\",\\\"interpretation\\\":\\\"4600\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Juni 1945\\\",\\\"interpretation\\\":\\\"1945-06-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+. Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"G\u00e4rtnerin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"190.-\",\"interpretation\":\"190\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"15. Okt. 1942\",\"interpretation\":\"1942-10-15\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Teuerungszulage\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'120.-\",\"interpretation\":\"2120\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1943\",\"interpretation\":\"1943-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'280.-\",\"interpretation\":\"2280\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'200.-\",\"interpretation\":\"2200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. M\u00e4rz 1944\",\"interpretation\":\"1944-03-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'800.-\",\"interpretation\":\"2800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. August 1944\",\"interpretation\":\"1944-08-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'140.-\",\"interpretation\":\"4140\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juni 1945\",\"interpretation\":\"1945-06-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+. Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1770685157,\"model\":\"gpt-5.1-2025-11-13\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":1234,\"prompt_tokens\":3105,\"total_tokens\":4339,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":2176}}}"}, "scoring": {"f1_micro": 0.8902369668246446, "f1_macro": 0.8567213114754098, "micro_precision": 0.8722139673105498, "micro_recall": 0.9090205187766164, "total_instances": 61, "total_tp": 2348, "total_fp": 344, "total_fn": 235, "cost_summary": {"total_input_tokens": 189405, "total_output_tokens": 37300, "total_tokens": 226705, "input_cost_usd": 0.23675625000000014, "output_cost_usd": 0.37299999999999994, "total_cost_usd": 0.60975625}}, "normalized_score": 89.02369668246446}, {"_id": {"$oid": "69d4eb12b877594bc5718c5f"}, "test_id": "T0612", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5-nano", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfslagerleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Geisshof\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"270.-\",\"interpretation\":\"270\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"13. Jan. 1941\",\"interpretation\":\"1941-01-13\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gpt-5-nano-2025-08-07", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 4424, "output_tokens": 2881, "total_tokens": 7305, "input_cost_usd": 0.0002212, "output_cost_usd": 0.0011524, "estimated_cost_usd": 0.0013736}, "duration": 29.93955683708191, "timestamp": "2026-02-10T01:03:49.629088", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfslagerleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Geisshof", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "270.-", "interpretation": "270", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "13. Jan. 1941", "interpretation": "1941-01-13", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "44ed6c5b-5d0a-4f8b-bd6a-14236ecd71ca", "score": {"f1_score": 1.0, "precision": 1.0, "recall": 1.0, "true_positives": 12, "false_positives": 0, "false_negatives": 0, "field_scores": {"rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfslagerleiter", "ground_truth": "Hilfslagerleiter", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "13. Jan. 1941", "ground_truth": "13. Jan. 1941", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1941-01-13", "ground_truth": "1941-01-13", "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "270", "ground_truth": "270", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "270.-", "ground_truth": "270.-", "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Geisshof", "ground_truth": "Geisshof", "score": 1.0}}, "total_fields": 19}, "raw_response": "{\"id\":\"chatcmpl-D7VVpCyeoJDJLbzDGfqIn7Nxl3tbl\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfslagerleiter\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"Geisshof\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"270.-\\\",\\\"interpretation\\\":\\\"270\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"13. Jan. 1941\\\",\\\"interpretation\\\":\\\"1941-01-13\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfslagerleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Geisshof\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"270.-\",\"interpretation\":\"270\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"13. Jan. 1941\",\"interpretation\":\"1941-01-13\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1770681801,\"model\":\"gpt-5-nano-2025-08-07\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":2881,\"prompt_tokens\":4424,\"total_tokens\":7305,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":2688,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":0}}}"}, "scoring": {"f1_micro": 0.8063936063936064, "f1_macro": 0.7778688524590165, "micro_precision": 0.833195706028076, "micro_recall": 0.781262098335269, "total_instances": 61, "total_tp": 2018, "total_fp": 404, "total_fn": 565, "cost_summary": {"total_input_tokens": 270649, "total_output_tokens": 389681, "total_tokens": 660330, "input_cost_usd": 0.013532450000000007, "output_cost_usd": 0.15587239999999997, "total_cost_usd": 0.16940485000000002}}, "normalized_score": 80.63936063936063}, {"_id": {"$oid": "69d4eb12b877594bc5718c60"}, "test_id": "T0614", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5.2-2025-12-11", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"-\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'200.-\",\"interpretation\":\"2200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"31. Okt. 1943\",\"interpretation\":\"1943-10-31\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'225.-\",\"interpretation\":\"2225\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'565.--\",\"interpretation\":\"3565\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"20. M\u00e4rz 1945\",\"interpretation\":\"1945-03-20\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen (Wiedereintri.tt).\",\"interpretation\":\"+ Zulagen (Wiedereintritt).\",\"is_crossed_out\":false}}]}", "model": "gpt-5.2-2025-12-11", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 4001, "output_tokens": 544, "total_tokens": 4545, "cached_tokens": 1536, "input_cost_usd": 0.00700175, "output_cost_usd": 0.0076159999999999995, "estimated_cost_usd": 0.014617749999999999}, "duration": 8.325046300888062, "timestamp": "2026-02-10T02:03:32.976707", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "-", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'200.-", "interpretation": "2200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "31. Okt. 1943", "interpretation": "1943-10-31", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'225.-", "interpretation": "2225", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'565.--", "interpretation": "3565", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "20. M\u00e4rz 1945", "interpretation": "1945-03-20", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen (Wiedereintri.tt).", "interpretation": "+ Zulagen (Wiedereintritt).", "is_crossed_out": false}}]}, "conversation_id": "f44e452b-dfc9-465e-961d-963cdcd7403f", "score": {"f1_score": 0.91, "precision": 0.8947368421052632, "recall": 0.918918918918919, "true_positives": 34, "false_positives": 4, "false_negatives": 3, "field_scores": {"rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "20. M\u00e4rz 1945", "ground_truth": "20. M\u00e4rz 1945", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2225", "ground_truth": "2225", "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "31. Okt. 1943", "ground_truth": "31. Okt. 1943", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-10-31", "ground_truth": "1943-10-31", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'565.--", "ground_truth": "3.565.--", "score": 0.875}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3565", "ground_truth": "3565", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": "+ Zulagen (Wiedereintritt).", "ground_truth": null, "score": 0.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen (Wiedereintri.tt).", "ground_truth": "+ Zulagen (Wiedereintritt)", "score": 0.962962962962963}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2200", "ground_truth": "2200", "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'225.-", "ground_truth": "2.225.-", "score": 0.8571428571428572}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'200.-", "ground_truth": "2.200.-", "score": 0.8571428571428572}, "rows[0].dienstort.diplomatic_transcript": {"response": "-", "ground_truth": "-", "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-03-20", "ground_truth": "1945-03-20", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}}, "total_fields": 57}, "raw_response": "{\"id\":\"chatcmpl-D7WRyaWsi38CiLq07Efhn20MUFYwJ\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"-\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'200.-\\\",\\\"interpretation\\\":\\\"2200\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"31. Okt. 1943\\\",\\\"interpretation\\\":\\\"1943-10-31\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiterin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'225.-\\\",\\\"interpretation\\\":\\\"2225\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 1944\\\",\\\"interpretation\\\":\\\"1944-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":3,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiterin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3'565.--\\\",\\\"interpretation\\\":\\\"3565\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"20. M\u00e4rz 1945\\\",\\\"interpretation\\\":\\\"1945-03-20\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen (Wiedereintri.tt).\\\",\\\"interpretation\\\":\\\"+ Zulagen (Wiedereintritt).\\\",\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"-\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'200.-\",\"interpretation\":\"2200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"31. Okt. 1943\",\"interpretation\":\"1943-10-31\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'225.-\",\"interpretation\":\"2225\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'565.--\",\"interpretation\":\"3565\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"20. M\u00e4rz 1945\",\"interpretation\":\"1945-03-20\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen (Wiedereintri.tt).\",\"interpretation\":\"+ Zulagen (Wiedereintritt).\",\"is_crossed_out\":false}}]}}}],\"created\":1770685406,\"model\":\"gpt-5.2-2025-12-11\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":544,\"prompt_tokens\":4001,\"total_tokens\":4545,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1536}}}"}, "scoring": {"f1_micro": 0.9632210607820364, "f1_macro": 0.9099999999999999, "micro_precision": 0.9632210607820364, "micro_recall": 0.9632210607820364, "total_instances": 61, "total_tp": 2488, "total_fp": 95, "total_fn": 95, "cost_summary": {"total_input_tokens": 243335, "total_output_tokens": 39571, "total_tokens": 282906, "input_cost_usd": 0.4258362500000001, "output_cost_usd": 0.553994, "total_cost_usd": 0.97983025}}, "normalized_score": 96.32210607820365}, {"_id": {"$oid": "69d4eb12b877594bc5718c62"}, "test_id": "T0582", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "cohere", "model": "command-a-vision-07-2025", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Assistent\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Professor\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. April 1945\",\"interpretation\":\"1945-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "command-a-vision-07-2025", "provider": "cohere", "finish_reason": "complete", "usage": {"input_tokens": 2319.0, "output_tokens": 553.0, "total_tokens": 2872.0, "input_cost_usd": 0.0057975, "output_cost_usd": 0.00553, "estimated_cost_usd": 0.0113275}, "duration": 13.531197786331177, "timestamp": "2026-02-10T09:43:06.252860", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Assistent", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'400.-", "interpretation": "2400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "Professor", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. April 1945", "interpretation": "1945-04-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "642b2ee9-38fc-4e77-804a-71c33c0b7276", "score": {"f1_score": 0.0, "precision": 0.0, "recall": 0.0, "true_positives": 0, "false_positives": 28, "false_negatives": 0, "field_scores": {"rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": null, "score": 0.0}, "rows[1].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "Professor", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Assistent", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-04-01", "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2400", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'700.-", "ground_truth": null, "score": 0.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'400.-", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. April 1945", "ground_truth": null, "score": 0.0}}, "total_fields": 38}, "raw_response": "{\"id\":\"05281d07-77e4-46f7-b83e-b45afba56ae8\",\"finish_reason\":\"COMPLETE\",\"message\":{\"role\":\"assistant\",\"content\":[{\"type\":\"text\",\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Assistent\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'400.-\\\",\\n \\\"interpretation\\\": \\\"2400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Professor\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. April 1945\\\",\\n \\\"interpretation\\\": \\\"1945-04-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\"}]},\"usage\":{\"billed_units\":{\"input_tokens\":5101.0,\"output_tokens\":553.0},\"tokens\":{\"input_tokens\":2319.0,\"output_tokens\":553.0,\"image_tokens\":3343},\"cached_tokens\":2304.0}}"}, "scoring": {"f1_micro": 0.784255946116607, "f1_macro": 0.8044262295081968, "micro_precision": 0.8343036274070756, "micro_recall": 0.7398729150119142, "total_instances": 61, "total_tp": 1863, "total_fp": 370, "total_fn": 655, "cost_summary": {"total_input_tokens": 141459.0, "total_output_tokens": 55307.0, "total_tokens": 196766.0, "input_cost_usd": 0.3536475000000004, "output_cost_usd": 0.55307, "total_cost_usd": 0.9067175000000001}}, "normalized_score": 78.4255946116607}, {"_id": {"$oid": "69d4eb12b877594bc5718c63"}, "test_id": "T0608", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-4o", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2900.-\",\"interpretation\":\"2900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"7. Jan. 46\",\"interpretation\":\"1946-01-07\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3050.-\",\"interpretation\":\"3050\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 46\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3150.-\",\"interpretation\":\"3150\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 47\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3300.-\",\"interpretation\":\"3300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 48\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gpt-4o-2024-08-06", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 3301, "output_tokens": 682, "total_tokens": 3983, "cached_tokens": 1792, "input_cost_usd": 0.0082525, "output_cost_usd": 0.00682, "estimated_cost_usd": 0.015072499999999999}, "duration": 25.16994309425354, "timestamp": "2026-02-10T00:16:50.332350", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": "5", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2900.-", "interpretation": "2900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "7. Jan. 46", "interpretation": "1946-01-07", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3050.-", "interpretation": "3050", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 46", "interpretation": "1946-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3150.-", "interpretation": "3150", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 47", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3300.-", "interpretation": "3300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 48", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "84372ba5-c1b3-453d-ac92-6ea2e46d56b7", "score": {"f1_score": 0.96, "precision": 0.9574468085106383, "recall": 0.9574468085106383, "true_positives": 45, "false_positives": 2, "false_negatives": 2, "field_scores": {"rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 48", "ground_truth": "1. Jan. 48", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-07", "ground_truth": "1945-01-07", "score": 0.9}, "rows[0].gehaltsklasse.interpretation": {"response": "5", "ground_truth": "5", "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "7. Jan. 46", "ground_truth": "7. Jan. 45", "score": 0.9}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2900", "ground_truth": "2900", "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": "V", "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3050.-", "ground_truth": "3050.-", "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3150.-", "ground_truth": "3150.-", "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 46", "ground_truth": "1. Juli 46", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3050", "ground_truth": "3050", "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3300.-", "ground_truth": "3300.-", "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3300", "ground_truth": "3300", "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": "1948-01-01", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 47", "ground_truth": "1. Jan. 47", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-07-01", "ground_truth": "1946-07-01", "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3150", "ground_truth": "3150", "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2900.-", "ground_truth": "2900.-", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}}, "total_fields": 76}, "raw_response": "{\"id\":\"chatcmpl-D7UmQFOHZ3E12m8K07XANDVgxPBMD\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"V\\\",\\\"interpretation\\\":\\\"5\\\",\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2900.-\\\",\\\"interpretation\\\":\\\"2900\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"7. Jan. 46\\\",\\\"interpretation\\\":\\\"1946-01-07\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3050.-\\\",\\\"interpretation\\\":\\\"3050\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Juli 46\\\",\\\"interpretation\\\":\\\"1946-07-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":3,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3150.-\\\",\\\"interpretation\\\":\\\"3150\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 47\\\",\\\"interpretation\\\":\\\"1947-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":4,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3300.-\\\",\\\"interpretation\\\":\\\"3300\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 48\\\",\\\"interpretation\\\":\\\"1948-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2900.-\",\"interpretation\":\"2900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"7. Jan. 46\",\"interpretation\":\"1946-01-07\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3050.-\",\"interpretation\":\"3050\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 46\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3150.-\",\"interpretation\":\"3150\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 47\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3300.-\",\"interpretation\":\"3300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 48\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1770678986,\"model\":\"gpt-4o-2024-08-06\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":\"fp_ad98c18a04\",\"usage\":{\"completion_tokens\":682,\"prompt_tokens\":3301,\"total_tokens\":3983,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1792}}}"}, "scoring": {"f1_micro": 0.9055312678198061, "f1_macro": 0.8749180327868852, "micro_precision": 0.8894697535474234, "micro_recall": 0.9221835075493612, "total_instances": 61, "total_tp": 2382, "total_fp": 296, "total_fn": 201, "cost_summary": {"total_input_tokens": 201361, "total_output_tokens": 36632, "total_tokens": 237993, "input_cost_usd": 0.5034024999999999, "output_cost_usd": 0.36632, "total_cost_usd": 0.8697225000000001}}, "normalized_score": 90.55312678198061}, {"_id": {"$oid": "69d4eb12b877594bc5718c97"}, "test_id": "T0601", "benchmark": "personnel_cards", "date": "2026-02-10", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "mistral", "model": "mistral-medium-2505", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsassistentin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsassistentin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'700.-\",\"interpretation\":\"2700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Okt. 1946\",\"interpretation\":\"1946-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'000.-\",\"interpretation\":\"3000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'300.-\",\"interpretation\":\"3300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'600.-\",\"interpretation\":\"3600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1949\",\"interpretation\":\"1949-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'900.-\",\"interpretation\":\"3900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1950\",\"interpretation\":\"1950-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":8,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 4'200.-\",\"interpretation\":\"4200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1951\",\"interpretation\":\"1951-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":9,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 4'500.-\",\"interpretation\":\"4500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1952\",\"interpretation\":\"1952-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":10,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 4'800.-\",\"interpretation\":\"4800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1953\",\"interpretation\":\"1953-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":11,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5'100.-\",\"interpretation\":\"5100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1954\",\"interpretation\":\"1954-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":12,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5'400.-\",\"interpretation\":\"5400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1955\",\"interpretation\":\"1955-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":13,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5'700.-\",\"interpretation\":\"5700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1956\",\"interpretation\":\"1956-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":14,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 6'000.-\",\"interpretation\":\"6000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1957\",\"interpretation\":\"1957-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":15,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 6'300.-\",\"interpretation\":\"6300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1958\",\"interpretation\":\"1958-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":16,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 6'600.-\",\"interpretation\":\"6600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1959\",\"interpretation\":\"1959-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":17,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 6'900.-\",\"interpretation\":\"6900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1960\",\"interpretation\":\"1960-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":18,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 7'200.-\",\"interpretation\":\"7200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1961\",\"interpretation\":\"1961-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":19,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 7'500.-\",\"interpretation\":\"7500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1962\",\"interpretation\":\"1962-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":20,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 7'800.-\",\"interpretation\":\"7800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1963\",\"interpretation\":\"1963-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":21,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 8'100.-\",\"interpretation\":\"8100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1964\",\"interpretation\":\"1964-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":22,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 8'400.-\",\"interpretation\":\"8400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1965\",\"interpretation\":\"1965-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":23,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 8'700.-\",\"interpretation\":\"8700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1966\",\"interpretation\":\"1966-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":24,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 9'000.-\",\"interpretation\":\"9000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1967\",\"interpretation\":\"1967-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":25,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 9'300.-\",\"interpretation\":\"9300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1968\",\"interpretation\":\"1968-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":26,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 9'600.-\",\"interpretation\":\"9600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1969\",\"interpretation\":\"1969-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":27,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 9'900.-\",\"interpretation\":\"9900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1970\",\"interpretation\":\"1970-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":28,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 10'200.-\",\"interpretation\":\"10200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1971\",\"interpretation\":\"1971-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":29,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 10'500.-\",\"interpretation\":\"10500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1972\",\"interpretation\":\"1972-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":30,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 10'800.-\",\"interpretation\":\"10800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1973\",\"interpretation\":\"1973-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":31,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 11'100.-\",\"interpretation\":\"11100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1974\",\"interpretation\":\"1974-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":32,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 11'400.-\",\"interpretation\":\"11400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1975\",\"interpretation\":\"1975-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":33,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 11'700.-\",\"interpretation\":\"11700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1976\",\"interpretation\":\"1976-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":34,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 12'000.-\",\"interpretation\":\"12000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1977\",\"interpretation\":\"1977-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":35,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 12'300.-\",\"interpretation\":\"12300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1978\",\"interpretation\":\"1978-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":36,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 12'600.-\",\"interpretation\":\"12600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1979\",\"interpretation\":\"1979-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":37,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 12'900.-\",\"interpretation\":\"12900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1980\",\"interpretation\":\"1980-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":38,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 13'200.-\",\"interpretation\":\"13200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1981\",\"interpretation\":\"1981-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":39,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 13'500.-\",\"interpretation\":\"13500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1982\",\"interpretation\":\"1982-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":40,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 13'800.-\",\"interpretation\":\"13800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1983\",\"interpretation\":\"1983-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":41,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 14'100.-\",\"interpretation\":\"14100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1984\",\"interpretation\":\"1984-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":42,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 14'400.-\",\"interpretation\":\"14400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1985\",\"interpretation\":\"1985-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":43,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 14'700.-\",\"interpretation\":\"14700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1986\",\"interpretation\":\"1986-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":44,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 15'000.-\",\"interpretation\":\"15000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1987\",\"interpretation\":\"1987-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":45,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 15'300.-\",\"interpretation\":\"15300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1988\",\"interpretation\":\"1988-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":46,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 15'600.-\",\"interpretation\":\"15600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1989\",\"interpretation\":\"1989-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":47,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 15'900.-\",\"interpretation\":\"15900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1990\",\"interpretation\":\"1990-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":48,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 16'200.-\",\"interpretation\":\"16200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1991\",\"interpretation\":\"1991-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":49,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 16'500.-\",\"interpretation\":\"16500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1992\",\"interpretation\":\"1992-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":50,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 16'800.-\",\"interpretation\":\"16800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1993\",\"interpretation\":\"1993-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":51,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 17'100.-\",\"interpretation\":\"17100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1994\",\"interpretation\":\"1994-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":52,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 17'400.-\",\"interpretation\":\"17400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1995\",\"interpretation\":\"1995-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":53,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 17'700.-\",\"interpretation\":\"17700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1996\",\"interpretation\":\"1996-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":54,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 18'000.-\",\"interpretation\":\"18000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1997\",\"interpretation\":\"1997-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":55,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 18'300.-\",\"interpretation\":\"18300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1998\",\"interpretation\":\"1998-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":56,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 18'600.-\",\"interpretation\":\"18600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1999\",\"interpretation\":\"1999-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":57,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 18'900.-\",\"interpretation\":\"18900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2000\",\"interpretation\":\"2000-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":58,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 19'200.-\",\"interpretation\":\"19200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2001\",\"interpretation\":\"2001-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":59,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 19'500.-\",\"interpretation\":\"19500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2002\",\"interpretation\":\"2002-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":60,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 19'800.-\",\"interpretation\":\"19800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2003\",\"interpretation\":\"2003-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":61,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 20'100.-\",\"interpretation\":\"20100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2004\",\"interpretation\":\"2004-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":62,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 20'400.-\",\"interpretation\":\"20400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2005\",\"interpretation\":\"2005-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":63,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 20'700.-\",\"interpretation\":\"20700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2006\",\"interpretation\":\"2006-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":64,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 21'000.-\",\"interpretation\":\"21000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2007\",\"interpretation\":\"2007-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":65,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 21'300.-\",\"interpretation\":\"21300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2008\",\"interpretation\":\"2008-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":66,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 21'600.-\",\"interpretation\":\"21600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2009\",\"interpretation\":\"2009-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":67,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 21'900.-\",\"interpretation\":\"21900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2010\",\"interpretation\":\"2010-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":68,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 22'200.-\",\"interpretation\":\"22200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2011\",\"interpretation\":\"2011-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":69,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 22'500.-\",\"interpretation\":\"22500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2012\",\"interpretation\":\"2012-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":70,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 22'800.-\",\"interpretation\":\"22800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2013\",\"interpretation\":\"2013-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":71,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 23'100.-\",\"interpretation\":\"23100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2014\",\"interpretation\":\"2014-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":72,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 23'400.-\",\"interpretation\":\"23400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2015\",\"interpretation\":\"2015-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":73,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 23'700.-\",\"interpretation\":\"23700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2016\",\"interpretation\":\"2016-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":74,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 24'000.-\",\"interpretation\":\"24000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2017\",\"interpretation\":\"2017-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":75,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 24'300.-\",\"interpretation\":\"24300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2018\",\"interpretation\":\"2018-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":76,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 24'600.-\",\"interpretation\":\"24600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2019\",\"interpretation\":\"2019-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":77,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 24'900.-\",\"interpretation\":\"24900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 2020\",\"interpretation\":\"2020-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "mistral-medium-2505", "provider": "mistral", "finish_reason": "stop", "usage": {"input_tokens": 1877, "output_tokens": 21857, "total_tokens": 23734, "input_cost_usd": 0.0007508, "output_cost_usd": 0.043714, "estimated_cost_usd": 0.044464800000000006}, "duration": 433.3277282714844, "timestamp": "2026-02-10T05:55:05.084432", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsassistentin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsassistentin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'400.-", "interpretation": "2400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'700.-", "interpretation": "2700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Okt. 1946", "interpretation": "1946-10-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'000.-", "interpretation": "3000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'300.-", "interpretation": "3300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1948", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'600.-", "interpretation": "3600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1949", "interpretation": "1949-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'900.-", "interpretation": "3900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1950", "interpretation": "1950-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 8, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 4'200.-", "interpretation": "4200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1951", "interpretation": "1951-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 9, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 4'500.-", "interpretation": "4500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1952", "interpretation": "1952-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 10, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 4'800.-", "interpretation": "4800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1953", "interpretation": "1953-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 11, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5'100.-", "interpretation": "5100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1954", "interpretation": "1954-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 12, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5'400.-", "interpretation": "5400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1955", "interpretation": "1955-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 13, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5'700.-", "interpretation": "5700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1956", "interpretation": "1956-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 14, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 6'000.-", "interpretation": "6000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1957", "interpretation": "1957-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 15, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 6'300.-", "interpretation": "6300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1958", "interpretation": "1958-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 16, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 6'600.-", "interpretation": "6600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1959", "interpretation": "1959-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 17, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 6'900.-", "interpretation": "6900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1960", "interpretation": "1960-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 18, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 7'200.-", "interpretation": "7200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1961", "interpretation": "1961-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 19, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 7'500.-", "interpretation": "7500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1962", "interpretation": "1962-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 20, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 7'800.-", "interpretation": "7800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1963", "interpretation": "1963-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 21, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 8'100.-", "interpretation": "8100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1964", "interpretation": "1964-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 22, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 8'400.-", "interpretation": "8400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1965", "interpretation": "1965-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 23, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 8'700.-", "interpretation": "8700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1966", "interpretation": "1966-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 24, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 9'000.-", "interpretation": "9000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1967", "interpretation": "1967-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 25, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 9'300.-", "interpretation": "9300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1968", "interpretation": "1968-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 26, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 9'600.-", "interpretation": "9600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1969", "interpretation": "1969-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 27, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 9'900.-", "interpretation": "9900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1970", "interpretation": "1970-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 28, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 10'200.-", "interpretation": "10200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1971", "interpretation": "1971-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 29, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 10'500.-", "interpretation": "10500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1972", "interpretation": "1972-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 30, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 10'800.-", "interpretation": "10800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1973", "interpretation": "1973-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 31, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 11'100.-", "interpretation": "11100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1974", "interpretation": "1974-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 32, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 11'400.-", "interpretation": "11400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1975", "interpretation": "1975-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 33, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 11'700.-", "interpretation": "11700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1976", "interpretation": "1976-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 34, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 12'000.-", "interpretation": "12000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1977", "interpretation": "1977-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 35, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 12'300.-", "interpretation": "12300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1978", "interpretation": "1978-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 36, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 12'600.-", "interpretation": "12600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1979", "interpretation": "1979-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 37, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 12'900.-", "interpretation": "12900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1980", "interpretation": "1980-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 38, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 13'200.-", "interpretation": "13200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1981", "interpretation": "1981-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 39, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 13'500.-", "interpretation": "13500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1982", "interpretation": "1982-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 40, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 13'800.-", "interpretation": "13800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1983", "interpretation": "1983-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 41, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 14'100.-", "interpretation": "14100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1984", "interpretation": "1984-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 42, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 14'400.-", "interpretation": "14400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1985", "interpretation": "1985-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 43, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 14'700.-", "interpretation": "14700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1986", "interpretation": "1986-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 44, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 15'000.-", "interpretation": "15000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1987", "interpretation": "1987-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 45, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 15'300.-", "interpretation": "15300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1988", "interpretation": "1988-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 46, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 15'600.-", "interpretation": "15600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1989", "interpretation": "1989-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 47, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 15'900.-", "interpretation": "15900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1990", "interpretation": "1990-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 48, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 16'200.-", "interpretation": "16200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1991", "interpretation": "1991-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 49, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 16'500.-", "interpretation": "16500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1992", "interpretation": "1992-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 50, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 16'800.-", "interpretation": "16800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1993", "interpretation": "1993-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 51, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 17'100.-", "interpretation": "17100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1994", "interpretation": "1994-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 52, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 17'400.-", "interpretation": "17400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1995", "interpretation": "1995-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 53, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 17'700.-", "interpretation": "17700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1996", "interpretation": "1996-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 54, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 18'000.-", "interpretation": "18000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1997", "interpretation": "1997-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 55, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 18'300.-", "interpretation": "18300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1998", "interpretation": "1998-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 56, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 18'600.-", "interpretation": "18600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1999", "interpretation": "1999-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 57, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 18'900.-", "interpretation": "18900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2000", "interpretation": "2000-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 58, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 19'200.-", "interpretation": "19200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2001", "interpretation": "2001-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 59, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 19'500.-", "interpretation": "19500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2002", "interpretation": "2002-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 60, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 19'800.-", "interpretation": "19800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2003", "interpretation": "2003-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 61, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 20'100.-", "interpretation": "20100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2004", "interpretation": "2004-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 62, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 20'400.-", "interpretation": "20400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2005", "interpretation": "2005-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 63, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 20'700.-", "interpretation": "20700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2006", "interpretation": "2006-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 64, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 21'000.-", "interpretation": "21000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2007", "interpretation": "2007-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 65, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 21'300.-", "interpretation": "21300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2008", "interpretation": "2008-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 66, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 21'600.-", "interpretation": "21600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2009", "interpretation": "2009-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 67, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 21'900.-", "interpretation": "21900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2010", "interpretation": "2010-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 68, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 22'200.-", "interpretation": "22200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2011", "interpretation": "2011-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 69, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 22'500.-", "interpretation": "22500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2012", "interpretation": "2012-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 70, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 22'800.-", "interpretation": "22800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2013", "interpretation": "2013-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 71, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 23'100.-", "interpretation": "23100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2014", "interpretation": "2014-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 72, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 23'400.-", "interpretation": "23400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2015", "interpretation": "2015-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 73, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 23'700.-", "interpretation": "23700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2016", "interpretation": "2016-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 74, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 24'000.-", "interpretation": "24000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2017", "interpretation": "2017-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 75, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 24'300.-", "interpretation": "24300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2018", "interpretation": "2018-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 76, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 24'600.-", "interpretation": "24600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2019", "interpretation": "2019-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 77, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 24'900.-", "interpretation": "24900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 2020", "interpretation": "2020-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "08f9cbf7-4d28-46b9-90cf-436e09b2e3a4", "score": {"f1_score": 0.01, "precision": 0.005597014925373134, "recall": 0.5, "true_positives": 6, "false_positives": 1066, "false_negatives": 6, "field_scores": {"rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'700.-", "ground_truth": null, "score": 0.0}, "rows[30].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[59].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[68].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[34].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "12300", "ground_truth": null, "score": 0.0}, "rows[12].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[27].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[58].datum_gehalts\u00e4nderung.interpretation": {"response": "2002-01-01", "ground_truth": null, "score": 0.0}, "rows[16].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1960", "ground_truth": null, "score": 0.0}, "rows[39].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[31].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[28].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[63].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[21].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[19].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[33].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[67].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "22200", "ground_truth": null, "score": 0.0}, "rows[8].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[35].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 12'600.-", "ground_truth": null, "score": 0.0}, "rows[62].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "20700", "ground_truth": null, "score": 0.0}, "rows[8].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[25].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 9'600.-", "ground_truth": null, "score": 0.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[63].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[55].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[23].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[9].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[64].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[65].datum_gehalts\u00e4nderung.interpretation": {"response": "2009-01-01", "ground_truth": null, "score": 0.0}, "rows[59].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[75].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[28].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[56].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[44].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[21].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[60].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[57].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[70].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[28].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[76].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "24900", "ground_truth": null, "score": 0.0}, "rows[58].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[71].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[45].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 15'600.-", "ground_truth": null, "score": 0.0}, "rows[26].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[70].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[64].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[62].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[73].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[28].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[41].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[17].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "7200", "ground_truth": null, "score": 0.0}, "rows[62].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[70].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[33].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[15].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[45].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[54].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "18300", "ground_truth": null, "score": 0.0}, "rows[21].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 8'400.-", "ground_truth": null, "score": 0.0}, "rows[40].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": null, "score": 0.0}, "rows[11].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[36].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[30].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[45].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[75].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[28].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[72].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[56].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[66].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2010", "ground_truth": null, "score": 0.0}, "rows[9].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[38].datum_gehalts\u00e4nderung.interpretation": {"response": "1982-01-01", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[64].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[23].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1967", "ground_truth": null, "score": 0.0}, "rows[44].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[39].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[15].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[15].datum_gehalts\u00e4nderung.interpretation": {"response": "1959-01-01", "ground_truth": null, "score": 0.0}, "rows[12].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[66].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[56].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 18'900.-", "ground_truth": null, "score": 0.0}, "rows[54].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[43].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1945-12-03", "score": 0.0}, "rows[66].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[29].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[10].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[49].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[40].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[57].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "19200", "ground_truth": null, "score": 0.0}, "rows[71].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1949", "ground_truth": null, "score": 0.0}, "rows[45].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1989", "ground_truth": null, "score": 0.0}, "rows[34].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[42].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[22].datum_gehalts\u00e4nderung.interpretation": {"response": "1966-01-01", "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[18].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[37].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[68].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[71].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 23'400.-", "ground_truth": null, "score": 0.0}, "rows[69].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[57].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[24].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[46].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[36].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[12].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1956", "ground_truth": null, "score": 0.0}, "rows[30].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1974", "ground_truth": null, "score": 0.0}, "rows[47].datum_gehalts\u00e4nderung.interpretation": {"response": "1991-01-01", "ground_truth": null, "score": 0.0}, "rows[69].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[69].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[31].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[15].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3900", "ground_truth": null, "score": 0.0}, "rows[10].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[63].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[38].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1982", "ground_truth": null, "score": 0.0}, "rows[53].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5'100.-", "ground_truth": null, "score": 0.0}, "rows[32].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[50].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "17100", "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.interpretation": {"response": "1951-01-01", "ground_truth": null, "score": 0.0}, "rows[40].datum_gehalts\u00e4nderung.interpretation": {"response": "1984-01-01", "ground_truth": null, "score": 0.0}, "rows[10].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[18].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1962", "ground_truth": null, "score": 0.0}, "rows[29].datum_gehalts\u00e4nderung.interpretation": {"response": "1973-01-01", "ground_truth": null, "score": 0.0}, "rows[36].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[48].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 16'500.-", "ground_truth": null, "score": 0.0}, "rows[41].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "14400", "ground_truth": null, "score": 0.0}, "rows[11].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5400", "ground_truth": null, "score": 0.0}, "rows[11].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[48].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "16500", "ground_truth": null, "score": 0.0}, "rows[54].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[44].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[15].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[69].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2013", "ground_truth": null, "score": 0.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[17].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[67].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[47].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 16'200.-", "ground_truth": null, "score": 0.0}, "rows[9].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[41].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[50].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[33].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[30].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[54].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[48].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[66].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[53].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[49].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[73].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[18].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[66].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[29].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[38].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[65].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[64].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[54].datum_gehalts\u00e4nderung.interpretation": {"response": "1998-01-01", "ground_truth": null, "score": 0.0}, "rows[56].datum_gehalts\u00e4nderung.interpretation": {"response": "2000-01-01", "ground_truth": null, "score": 0.0}, "rows[54].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[24].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[48].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[56].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[55].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "18600", "ground_truth": null, "score": 0.0}, "rows[56].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[65].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[59].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[25].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[57].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3000", "ground_truth": null, "score": 0.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3600", "ground_truth": null, "score": 0.0}, "rows[47].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[10].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[50].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[59].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[74].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[21].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[42].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[10].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[42].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[67].datum_gehalts\u00e4nderung.interpretation": {"response": "2011-01-01", "ground_truth": null, "score": 0.0}, "rows[52].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[47].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1991", "ground_truth": null, "score": 0.0}, "rows[48].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[44].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[26].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 9'900.-", "ground_truth": null, "score": 0.0}, "rows[62].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[18].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[44].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 15'300.-", "ground_truth": null, "score": 0.0}, "rows[59].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[42].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[17].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[76].datum_gehalts\u00e4nderung.interpretation": {"response": "2020-01-01", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[74].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 24'300.-", "ground_truth": null, "score": 0.0}, "rows[61].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[41].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 14'400.-", "ground_truth": null, "score": 0.0}, "rows[58].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[13].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 6'000.-", "ground_truth": null, "score": 0.0}, "rows[65].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[59].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[58].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[60].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[53].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[56].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[74].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2018", "ground_truth": null, "score": 0.0}, "rows[30].datum_gehalts\u00e4nderung.interpretation": {"response": "1974-01-01", "ground_truth": null, "score": 0.0}, "rows[35].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "12600", "ground_truth": null, "score": 0.0}, "rows[74].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[69].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[44].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[62].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[52].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[23].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[25].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[52].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[42].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[57].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[70].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[38].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[19].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[22].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[47].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[50].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[60].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 20'100.-", "ground_truth": null, "score": 0.0}, "rows[10].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1954", "ground_truth": null, "score": 0.0}, "rows[19].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[75].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[29].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[60].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "20100", "ground_truth": null, "score": 0.0}, "rows[19].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 7'800.-", "ground_truth": null, "score": 0.0}, "rows[75].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 24'600.-", "ground_truth": null, "score": 0.0}, "rows[62].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[70].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[9].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[26].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[76].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[22].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[69].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[34].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[23].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[57].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[73].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 24'000.-", "ground_truth": null, "score": 0.0}, "rows[61].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[51].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[26].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[16].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[46].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[65].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[35].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[46].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[28].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[28].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1972", "ground_truth": null, "score": 0.0}, "rows[43].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[48].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[16].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[18].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[68].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[27].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[34].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 12'300.-", "ground_truth": null, "score": 0.0}, "rows[74].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[48].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[20].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[40].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[46].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[42].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[60].datum_gehalts\u00e4nderung.interpretation": {"response": "2004-01-01", "ground_truth": null, "score": 0.0}, "rows[13].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1957", "ground_truth": null, "score": 0.0}, "rows[17].datum_gehalts\u00e4nderung.interpretation": {"response": "1961-01-01", "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[60].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[54].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[50].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1994", "ground_truth": null, "score": 0.0}, "rows[16].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[44].datum_gehalts\u00e4nderung.interpretation": {"response": "1988-01-01", "ground_truth": null, "score": 0.0}, "rows[70].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[70].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[55].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[62].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[20].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[60].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[28].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[32].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[43].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[35].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[66].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "21900", "ground_truth": null, "score": 0.0}, "rows[67].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[36].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[43].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1987", "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[22].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 8'700.-", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[31].datum_gehalts\u00e4nderung.interpretation": {"response": "1975-01-01", "ground_truth": null, "score": 0.0}, "rows[27].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[20].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[45].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[58].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[73].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[42].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 14'700.-", "ground_truth": null, "score": 0.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4500", "ground_truth": null, "score": 0.0}, "rows[63].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[50].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 17'100.-", "ground_truth": null, "score": 0.0}, "rows[31].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[15].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[44].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "15300", "ground_truth": null, "score": 0.0}, "rows[6].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[18].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 7'500.-", "ground_truth": null, "score": 0.0}, "rows[53].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1997", "ground_truth": null, "score": 0.0}, "rows[69].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[30].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[72].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[31].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[45].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[66].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[26].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[36].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[19].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[32].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[57].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[30].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[35].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[73].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2017", "ground_truth": null, "score": 0.0}, "rows[42].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[60].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[72].datum_gehalts\u00e4nderung.interpretation": {"response": "2016-01-01", "ground_truth": null, "score": 0.0}, "rows[12].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[62].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[8].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[68].datum_gehalts\u00e4nderung.interpretation": {"response": "2012-01-01", "ground_truth": null, "score": 0.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[71].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[75].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[13].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[68].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 22'500.-", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[19].datum_gehalts\u00e4nderung.interpretation": {"response": "1963-01-01", "ground_truth": null, "score": 0.0}, "rows[64].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[43].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[50].datum_gehalts\u00e4nderung.interpretation": {"response": "1994-01-01", "ground_truth": null, "score": 0.0}, "rows[75].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[32].datum_gehalts\u00e4nderung.interpretation": {"response": "1976-01-01", "ground_truth": null, "score": 0.0}, "rows[22].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[56].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[76].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[56].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[45].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[73].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[52].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[68].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[64].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2008", "ground_truth": null, "score": 0.0}, "rows[50].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[57].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 19'200.-", "ground_truth": null, "score": 0.0}, "rows[40].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[17].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[16].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[43].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[38].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[13].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[40].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[33].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[63].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[24].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[60].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[44].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[13].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6000", "ground_truth": null, "score": 0.0}, "rows[56].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[57].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[35].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[64].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[22].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[72].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[47].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[68].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[24].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 9'300.-", "ground_truth": null, "score": 0.0}, "rows[50].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[17].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[63].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[14].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[25].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[42].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1986", "ground_truth": null, "score": 0.0}, "rows[69].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 22'800.-", "ground_truth": null, "score": 0.0}, "rows[74].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[53].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[47].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[53].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "18000", "ground_truth": null, "score": 0.0}, "rows[43].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[72].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[49].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[32].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[50].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[45].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[34].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[58].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[73].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[65].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[24].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[62].datum_gehalts\u00e4nderung.interpretation": {"response": "2006-01-01", "ground_truth": null, "score": 0.0}, "rows[49].datum_gehalts\u00e4nderung.interpretation": {"response": "1993-01-01", "ground_truth": null, "score": 0.0}, "rows[20].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[25].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[52].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1996", "ground_truth": null, "score": 0.0}, "rows[48].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[41].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1985", "ground_truth": null, "score": 0.0}, "rows[31].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[29].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[14].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[64].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[40].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[70].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[31].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[20].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[17].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[53].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[64].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[32].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 11'700.-", "ground_truth": null, "score": 0.0}, "rows[10].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[63].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2007", "ground_truth": null, "score": 0.0}, "rows[22].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1958", "ground_truth": null, "score": 0.0}, "rows[40].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[68].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[27].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1971", "ground_truth": null, "score": 0.0}, "rows[63].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[32].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[62].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2006", "ground_truth": null, "score": 0.0}, "rows[44].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[34].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[48].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[30].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[42].datum_gehalts\u00e4nderung.interpretation": {"response": "1986-01-01", "ground_truth": null, "score": 0.0}, "rows[73].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[57].datum_gehalts\u00e4nderung.interpretation": {"response": "2001-01-01", "ground_truth": null, "score": 0.0}, "rows[32].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[74].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[59].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[34].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[55].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[68].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[38].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[20].datum_gehalts\u00e4nderung.interpretation": {"response": "1964-01-01", "ground_truth": null, "score": 0.0}, "rows[31].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[18].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[67].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[29].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[13].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[27].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[72].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "23700", "ground_truth": null, "score": 0.0}, "rows[61].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 20'400.-", "ground_truth": null, "score": 0.0}, "rows[57].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[57].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[13].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[21].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[29].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 10'800.-", "ground_truth": null, "score": 0.0}, "rows[38].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[61].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[14].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[72].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[70].datum_gehalts\u00e4nderung.interpretation": {"response": "2014-01-01", "ground_truth": null, "score": 0.0}, "rows[32].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[32].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[60].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[51].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[63].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[60].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[45].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[29].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1973", "ground_truth": null, "score": 0.0}, "rows[65].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[49].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[60].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[66].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[20].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[73].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[40].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[63].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[59].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "19800", "ground_truth": null, "score": 0.0}, "rows[72].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[14].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[52].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 17'700.-", "ground_truth": null, "score": 0.0}, "rows[21].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[20].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 8'100.-", "ground_truth": null, "score": 0.0}, "rows[19].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[45].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[23].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[48].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[44].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[61].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[55].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 18'600.-", "ground_truth": null, "score": 0.0}, "rows[64].datum_gehalts\u00e4nderung.interpretation": {"response": "2008-01-01", "ground_truth": null, "score": 0.0}, "rows[12].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": "4600", "score": 0.0}, "rows[76].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[57].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[42].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[23].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[47].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[38].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[9].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4800", "ground_truth": null, "score": 0.0}, "rows[59].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[69].datum_gehalts\u00e4nderung.interpretation": {"response": "2013-01-01", "ground_truth": null, "score": 0.0}, "rows[10].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[61].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[43].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[61].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'400.-", "ground_truth": null, "score": 0.0}, "rows[74].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[35].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[67].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[19].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[44].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[35].datum_gehalts\u00e4nderung.interpretation": {"response": "1979-01-01", "ground_truth": null, "score": 0.0}, "rows[12].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[55].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[67].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[55].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[31].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[15].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[36].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[46].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[15].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[55].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1999", "ground_truth": null, "score": 0.0}, "rows[40].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "14100", "ground_truth": null, "score": 0.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[13].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[50].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[74].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[34].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[41].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[27].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[65].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[54].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 18'300.-", "ground_truth": null, "score": 0.0}, "rows[58].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[19].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[71].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[25].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "9600", "ground_truth": null, "score": 0.0}, "rows[10].datum_gehalts\u00e4nderung.interpretation": {"response": "1954-01-01", "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1951", "ground_truth": null, "score": 0.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[40].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[55].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[17].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5'700.-", "ground_truth": null, "score": 0.0}, "rows[56].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2000", "ground_truth": null, "score": 0.0}, "rows[47].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[66].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[44].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[45].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[15].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[25].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[69].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "22800", "ground_truth": null, "score": 0.0}, "rows[71].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[33].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[71].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "23400", "ground_truth": null, "score": 0.0}, "rows[48].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[24].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[51].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[76].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[51].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[56].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[35].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[63].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[66].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[53].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[41].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[51].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[39].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[72].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[36].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4200", "ground_truth": null, "score": 0.0}, "rows[15].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1959", "ground_truth": null, "score": 0.0}, "rows[52].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[27].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[34].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[33].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1977", "ground_truth": null, "score": 0.0}, "rows[21].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[31].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[29].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[15].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[52].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[26].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[20].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[9].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1953", "ground_truth": null, "score": 0.0}, "rows[41].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[76].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[58].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[63].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[9].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[71].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[19].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[63].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[25].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[41].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[26].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[30].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "11100", "ground_truth": null, "score": 0.0}, "rows[23].datum_gehalts\u00e4nderung.interpretation": {"response": "1967-01-01", "ground_truth": null, "score": 0.0}, "rows[53].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[23].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[18].datum_gehalts\u00e4nderung.interpretation": {"response": "1962-01-01", "ground_truth": null, "score": 0.0}, "rows[8].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[58].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[49].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[55].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[43].datum_gehalts\u00e4nderung.interpretation": {"response": "1987-01-01", "ground_truth": null, "score": 0.0}, "rows[72].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[75].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[37].datum_gehalts\u00e4nderung.interpretation": {"response": "1981-01-01", "ground_truth": null, "score": 0.0}, "rows[56].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[44].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[11].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[13].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[11].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[58].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[36].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[37].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[37].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[43].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "15000", "ground_truth": null, "score": 0.0}, "rows[65].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "21600", "ground_truth": null, "score": 0.0}, "rows[18].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[68].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[48].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[25].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[28].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[30].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[18].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "7500", "ground_truth": null, "score": 0.0}, "rows[24].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[70].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[64].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[26].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[58].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 19'500.-", "ground_truth": null, "score": 0.0}, "rows[59].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[42].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[60].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[39].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[39].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[61].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2005", "ground_truth": null, "score": 0.0}, "rows[67].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 22'200.-", "ground_truth": null, "score": 0.0}, "rows[34].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1978", "ground_truth": null, "score": 0.0}, "rows[9].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[12].datum_gehalts\u00e4nderung.interpretation": {"response": "1956-01-01", "ground_truth": null, "score": 0.0}, "rows[46].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[66].datum_gehalts\u00e4nderung.interpretation": {"response": "2010-01-01", "ground_truth": null, "score": 0.0}, "rows[74].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[45].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[25].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[39].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "13800", "ground_truth": null, "score": 0.0}, "rows[6].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[24].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[71].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[11].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[44].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[33].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[46].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[23].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[17].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 7'200.-", "ground_truth": null, "score": 0.0}, "rows[22].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[33].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[31].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[68].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "22500", "ground_truth": null, "score": 0.0}, "rows[11].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'000.-", "ground_truth": null, "score": 0.0}, "rows[41].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[43].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[67].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[69].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[70].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[76].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[9].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[68].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[19].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[37].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[68].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[44].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1988", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[8].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[76].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[18].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[55].datum_gehalts\u00e4nderung.interpretation": {"response": "1999-01-01", "ground_truth": null, "score": 0.0}, "rows[72].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[49].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[9].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[29].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[42].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[67].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[75].datum_gehalts\u00e4nderung.interpretation": {"response": "2019-01-01", "ground_truth": null, "score": 0.0}, "rows[41].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[69].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[65].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[47].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[45].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[44].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[35].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[34].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[31].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[55].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[15].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[51].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[72].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[54].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2400", "ground_truth": null, "score": 0.0}, "rows[61].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[63].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[26].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1950", "ground_truth": null, "score": 0.0}, "rows[30].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[10].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[46].datum_gehalts\u00e4nderung.interpretation": {"response": "1990-01-01", "ground_truth": null, "score": 0.0}, "rows[64].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[35].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 6'300.-", "ground_truth": null, "score": 0.0}, "rows[43].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 15'000.-", "ground_truth": null, "score": 0.0}, "rows[49].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[41].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[17].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[26].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "9900", "ground_truth": null, "score": 0.0}, "rows[73].datum_gehalts\u00e4nderung.interpretation": {"response": "2017-01-01", "ground_truth": null, "score": 0.0}, "rows[70].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[25].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[28].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "10500", "ground_truth": null, "score": 0.0}, "rows[76].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[74].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "24300", "ground_truth": null, "score": 0.0}, "rows[29].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[75].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[23].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[46].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[57].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[58].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[35].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[39].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[62].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[47].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[38].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "13500", "ground_truth": null, "score": 0.0}, "rows[33].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[60].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[25].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[73].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[36].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[37].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[37].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[23].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": null, "ground_truth": "3. Dez. 45", "score": 0.0}, "rows[67].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": null, "score": 0.0}, "rows[62].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[8].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[62].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[58].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "19500", "ground_truth": null, "score": 0.0}, "rows[65].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[43].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[50].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[13].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[51].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[53].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[72].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2016", "ground_truth": null, "score": 0.0}, "rows[55].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[27].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 10'200.-", "ground_truth": null, "score": 0.0}, "rows[51].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[72].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[70].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "23100", "ground_truth": null, "score": 0.0}, "rows[29].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[12].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[36].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[15].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 6'600.-", "ground_truth": null, "score": 0.0}, "rows[22].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[25].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1969", "ground_truth": null, "score": 0.0}, "rows[58].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[65].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[29].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[56].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[26].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[18].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[44].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[11].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].datum_gehalts\u00e4nderung.interpretation": {"response": "1958-01-01", "ground_truth": null, "score": 0.0}, "rows[59].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2003", "ground_truth": null, "score": 0.0}, "rows[14].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6300", "ground_truth": null, "score": 0.0}, "rows[33].datum_gehalts\u00e4nderung.interpretation": {"response": "1977-01-01", "ground_truth": null, "score": 0.0}, "rows[38].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[43].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[52].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[51].datum_gehalts\u00e4nderung.interpretation": {"response": "1995-01-01", "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[42].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[73].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[23].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[36].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[41].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[49].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1993", "ground_truth": null, "score": 0.0}, "rows[46].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[66].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[21].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[17].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[27].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[54].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[38].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[13].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[38].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[41].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[52].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[17].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[56].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[65].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[13].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[26].datum_gehalts\u00e4nderung.interpretation": {"response": "1970-01-01", "ground_truth": null, "score": 0.0}, "rows[30].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[19].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[49].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "16800", "ground_truth": null, "score": 0.0}, "rows[12].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[26].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1970", "ground_truth": null, "score": 0.0}, "rows[7].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[38].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[58].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[71].datum_gehalts\u00e4nderung.interpretation": {"response": "2015-01-01", "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'300.-", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[45].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "15600", "ground_truth": null, "score": 0.0}, "rows[24].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[20].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[46].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 15'900.-", "ground_truth": null, "score": 0.0}, "rows[37].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1981", "ground_truth": null, "score": 0.0}, "rows[19].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1963", "ground_truth": null, "score": 0.0}, "rows[45].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[33].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[16].datum_gehalts\u00e4nderung.interpretation": {"response": "1960-01-01", "ground_truth": null, "score": 0.0}, "rows[73].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[47].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[69].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[33].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[22].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[20].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[25].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[46].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[70].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[22].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[10].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[31].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[19].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[61].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[21].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[36].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1980", "ground_truth": null, "score": 0.0}, "rows[47].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[66].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[47].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[65].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[51].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[52].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[59].datum_gehalts\u00e4nderung.interpretation": {"response": "2003-01-01", "ground_truth": null, "score": 0.0}, "rows[39].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[42].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "14700", "ground_truth": null, "score": 0.0}, "rows[29].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[71].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[54].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[59].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[22].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[40].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[69].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[34].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[74].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[18].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[33].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[68].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2700", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": null, "score": 0.0}, "rows[63].datum_gehalts\u00e4nderung.interpretation": {"response": "2007-01-01", "ground_truth": null, "score": 0.0}, "rows[46].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1990", "ground_truth": null, "score": 0.0}, "rows[53].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[75].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "24600", "ground_truth": null, "score": 0.0}, "rows[55].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[37].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[52].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[26].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[61].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[49].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[72].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[39].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[39].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "rows[51].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1995", "ground_truth": null, "score": 0.0}, "rows[11].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[30].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[37].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": "1950-01-01", "ground_truth": null, "score": 0.0}, "rows[40].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[64].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 21'300.-", "ground_truth": null, "score": 0.0}, "rows[68].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[35].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[65].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[23].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[20].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[74].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": null, "score": 0.0}, "rows[59].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[55].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[13].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[54].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[53].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 18'000.-", "ground_truth": null, "score": 0.0}, "rows[10].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[75].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[42].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[27].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[61].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[71].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[73].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[24].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "9300", "ground_truth": null, "score": 0.0}, "rows[70].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[57].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[43].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[24].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[34].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[59].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[36].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[70].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2014", "ground_truth": null, "score": 0.0}, "rows[58].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[65].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 21'600.-", "ground_truth": null, "score": 0.0}, "rows[38].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[50].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[46].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "15900", "ground_truth": null, "score": 0.0}, "rows[46].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[28].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[29].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[39].datum_gehalts\u00e4nderung.interpretation": {"response": "1983-01-01", "ground_truth": null, "score": 0.0}, "rows[16].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[26].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[55].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[35].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[31].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1975", "ground_truth": null, "score": 0.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3300", "ground_truth": null, "score": 0.0}, "rows[11].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[75].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[25].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[49].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[57].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2001", "ground_truth": null, "score": 0.0}, "rows[27].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[60].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2004", "ground_truth": null, "score": 0.0}, "rows[21].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[20].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[34].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[59].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[9].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[68].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2012", "ground_truth": null, "score": 0.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[15].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6600", "ground_truth": null, "score": 0.0}, "rows[13].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[63].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 21'000.-", "ground_truth": null, "score": 0.0}, "rows[33].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[53].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[16].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6900", "ground_truth": null, "score": 0.0}, "rows[17].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1961", "ground_truth": null, "score": 0.0}, "rows[51].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[49].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[56].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "18900", "ground_truth": null, "score": 0.0}, "rows[76].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2020", "ground_truth": null, "score": 0.0}, "rows[58].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[22].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[39].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[32].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[39].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[47].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[52].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[32].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[22].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[63].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "21000", "ground_truth": null, "score": 0.0}, "rows[28].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[35].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[15].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[15].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[32].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1976", "ground_truth": null, "score": 0.0}, "rows[38].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[18].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[39].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[17].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[52].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "17700", "ground_truth": null, "score": 0.0}, "rows[54].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[62].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[64].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "21300", "ground_truth": null, "score": 0.0}, "rows[41].datum_gehalts\u00e4nderung.interpretation": {"response": "1985-01-01", "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-10-01", "ground_truth": null, "score": 0.0}, "rows[71].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[61].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[23].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[35].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[9].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[69].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[65].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2009", "ground_truth": null, "score": 0.0}, "rows[28].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[37].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[30].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[40].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 14'100.-", "ground_truth": null, "score": 0.0}, "rows[12].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[57].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[30].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[74].datum_gehalts\u00e4nderung.interpretation": {"response": "2018-01-01", "ground_truth": null, "score": 0.0}, "rows[45].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[37].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 13'200.-", "ground_truth": null, "score": 0.0}, "rows[17].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[73].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[41].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": null, "score": 0.0}, "rows[14].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[17].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[36].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[62].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[30].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[76].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[21].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1965", "ground_truth": null, "score": 0.0}, "rows[9].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[42].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[51].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[72].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[43].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].datum_gehalts\u00e4nderung.interpretation": {"response": "1953-01-01", "ground_truth": null, "score": 0.0}, "rows[16].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[48].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[43].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[21].datum_gehalts\u00e4nderung.interpretation": {"response": "1965-01-01", "ground_truth": null, "score": 0.0}, "rows[14].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[46].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[76].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[54].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1998", "ground_truth": null, "score": 0.0}, "rows[60].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[27].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[40].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1984", "ground_truth": null, "score": 0.0}, "rows[40].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": "4600.-", "score": 0.0}, "rows[19].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "7800", "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Okt. 1946", "ground_truth": null, "score": 0.0}, "rows[55].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[16].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[50].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[73].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[29].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[52].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[75].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[43].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1952", "ground_truth": null, "score": 0.0}, "rows[33].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[41].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[14].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[16].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[70].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 23'100.-", "ground_truth": null, "score": 0.0}, "rows[7].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[26].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[74].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[20].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[51].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "17400", "ground_truth": null, "score": 0.0}, "rows[65].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[31].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[67].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2011", "ground_truth": null, "score": 0.0}, "rows[66].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[19].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[49].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[62].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[71].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[21].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[16].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[52].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[37].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[52].datum_gehalts\u00e4nderung.interpretation": {"response": "1996-01-01", "ground_truth": null, "score": 0.0}, "rows[18].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[18].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[32].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[61].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "20400", "ground_truth": null, "score": 0.0}, "rows[70].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[33].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[75].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[24].datum_gehalts\u00e4nderung.interpretation": {"response": "1968-01-01", "ground_truth": null, "score": 0.0}, "rows[28].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[75].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[38].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 13'500.-", "ground_truth": null, "score": 0.0}, "rows[63].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[48].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[37].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[23].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 9'000.-", "ground_truth": null, "score": 0.0}, "rows[31].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "11400", "ground_truth": null, "score": 0.0}, "rows[22].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1966", "ground_truth": null, "score": 0.0}, "rows[28].datum_gehalts\u00e4nderung.interpretation": {"response": "1972-01-01", "ground_truth": null, "score": 0.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[26].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[34].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[34].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[54].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[15].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[48].datum_gehalts\u00e4nderung.interpretation": {"response": "1992-01-01", "ground_truth": null, "score": 0.0}, "rows[76].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[32].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].datum_gehalts\u00e4nderung.interpretation": {"response": "1952-01-01", "ground_truth": null, "score": 0.0}, "rows[38].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[50].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[48].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[14].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[36].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[71].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[11].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1955", "ground_truth": null, "score": 0.0}, "rows[74].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[22].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "8700", "ground_truth": null, "score": 0.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[67].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[74].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[24].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[29].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[35].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[16].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[58].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2002", "ground_truth": null, "score": 0.0}, "rows[49].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[14].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[39].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[54].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[39].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1983", "ground_truth": null, "score": 0.0}, "rows[64].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[60].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[34].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[67].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[72].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 23'700.-", "ground_truth": null, "score": 0.0}, "rows[9].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 4'800.-", "ground_truth": null, "score": 0.0}, "rows[22].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[16].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[21].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[33].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 12'000.-", "ground_truth": null, "score": 0.0}, "rows[11].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5'400.-", "ground_truth": null, "score": 0.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[67].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[51].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[53].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[53].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[54].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[37].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[75].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[16].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'900.-", "ground_truth": null, "score": 0.0}, "rows[71].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[64].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[73].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "24000", "ground_truth": null, "score": 0.0}, "rows[59].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[20].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[53].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[74].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[29].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "10800", "ground_truth": null, "score": 0.0}, "rows[66].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[51].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[49].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[32].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[16].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[55].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[61].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[24].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[23].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[66].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[31].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 11'400.-", "ground_truth": null, "score": 0.0}, "rows[67].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[48].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[21].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[76].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[76].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[50].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[60].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[61].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[47].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsassistentin", "ground_truth": "Koch", "score": 0.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 4'200.-", "ground_truth": null, "score": 0.0}, "rows[53].datum_gehalts\u00e4nderung.interpretation": {"response": "1997-01-01", "ground_truth": null, "score": 0.0}, "rows[71].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2015", "ground_truth": null, "score": 0.0}, "rows[62].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[34].datum_gehalts\u00e4nderung.interpretation": {"response": "1978-01-01", "ground_truth": null, "score": 0.0}, "rows[21].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "8400", "ground_truth": null, "score": 0.0}, "rows[46].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[67].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[49].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 16'800.-", "ground_truth": null, "score": 0.0}, "rows[28].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 10'500.-", "ground_truth": null, "score": 0.0}, "rows[32].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "11700", "ground_truth": null, "score": 0.0}, "rows[53].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[11].datum_gehalts\u00e4nderung.interpretation": {"response": "1955-01-01", "ground_truth": null, "score": 0.0}, "rows[66].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[76].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[17].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[51].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[28].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[24].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[18].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[12].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5700", "ground_truth": null, "score": 0.0}, "rows[36].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 12'900.-", "ground_truth": null, "score": 0.0}, "rows[68].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[69].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[56].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[11].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[26].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[47].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[12].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[42].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[75].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 2019", "ground_truth": null, "score": 0.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[23].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[51].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 17'400.-", "ground_truth": null, "score": 0.0}, "rows[57].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[69].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[24].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[64].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[20].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "8100", "ground_truth": null, "score": 0.0}, "rows[71].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[22].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[27].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[13].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[39].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[61].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[27].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[36].datum_gehalts\u00e4nderung.interpretation": {"response": "1980-01-01", "ground_truth": null, "score": 0.0}, "rows[64].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[36].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "12900", "ground_truth": null, "score": 0.0}, "rows[24].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1968", "ground_truth": null, "score": 0.0}, "rows[13].datum_gehalts\u00e4nderung.interpretation": {"response": "1957-01-01", "ground_truth": null, "score": 0.0}, "rows[10].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[49].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[21].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'600.-", "ground_truth": null, "score": 0.0}, "rows[30].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 11'100.-", "ground_truth": null, "score": 0.0}, "rows[23].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "9000", "ground_truth": null, "score": 0.0}, "rows[41].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[40].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1949-01-01", "ground_truth": null, "score": 0.0}, "rows[47].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "16200", "ground_truth": null, "score": 0.0}, "rows[27].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "10200", "ground_truth": null, "score": 0.0}, "rows[46].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[20].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[25].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[30].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsassistentin", "ground_truth": null, "score": 0.0}, "rows[66].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 21'900.-", "ground_truth": null, "score": 0.0}, "rows[56].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[67].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[37].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1948", "ground_truth": null, "score": 0.0}, "rows[39].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 13'800.-", "ground_truth": null, "score": 0.0}, "rows[13].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[19].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[31].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[14].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[15].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[48].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1992", "ground_truth": null, "score": 0.0}, "rows[54].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[45].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[68].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[72].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[4].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[21].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[33].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "12000", "ground_truth": null, "score": 0.0}, "rows[20].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1964", "ground_truth": null, "score": 0.0}, "rows[25].datum_gehalts\u00e4nderung.interpretation": {"response": "1969-01-01", "ground_truth": null, "score": 0.0}, "rows[32].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[35].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1979", "ground_truth": null, "score": 0.0}, "rows[50].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[27].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[50].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[38].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[62].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 20'700.-", "ground_truth": null, "score": 0.0}, "rows[45].datum_gehalts\u00e4nderung.interpretation": {"response": "1989-01-01", "ground_truth": null, "score": 0.0}, "rows[27].datum_gehalts\u00e4nderung.interpretation": {"response": "1971-01-01", "ground_truth": null, "score": 0.0}, "rows[13].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[19].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[17].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[16].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 6'900.-", "ground_truth": null, "score": 0.0}, "rows[37].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "13200", "ground_truth": null, "score": 0.0}, "rows[27].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[28].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[75].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[24].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[59].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 19'800.-", "ground_truth": null, "score": 0.0}, "rows[16].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[52].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[61].datum_gehalts\u00e4nderung.interpretation": {"response": "2005-01-01", "ground_truth": null, "score": 0.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 4'500.-", "ground_truth": null, "score": 0.0}, "rows[37].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[76].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 24'900.-", "ground_truth": null, "score": 0.0}, "rows[10].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5100", "ground_truth": null, "score": 0.0}, "rows[18].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[40].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[69].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[73].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[25].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}}, "total_fields": 1463}, "raw_response": "{\"id\":\"97c4df884f954428a9d7402f396d7a7e\",\"object\":\"chat.completion\",\"model\":\"mistral-medium-2505\",\"usage\":{\"prompt_tokens\":1877,\"completion_tokens\":21857,\"total_tokens\":23734,\"num_cached_tokens\":0},\"created\":1770699097,\"choices\":[{\"index\":0,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsassistentin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsassistentin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'400.-\\\",\\n \\\"interpretation\\\": \\\"2400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'700.-\\\",\\n \\\"interpretation\\\": \\\"2700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Okt. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-10-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'000.-\\\",\\n \\\"interpretation\\\": \\\"3000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1947\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'300.-\\\",\\n \\\"interpretation\\\": \\\"3300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1948\\\",\\n \\\"interpretation\\\": \\\"1948-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 6,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'600.-\\\",\\n \\\"interpretation\\\": \\\"3600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1949\\\",\\n \\\"interpretation\\\": \\\"1949-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 7,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'900.-\\\",\\n \\\"interpretation\\\": \\\"3900\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1950\\\",\\n \\\"interpretation\\\": \\\"1950-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 8,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 4'200.-\\\",\\n \\\"interpretation\\\": \\\"4200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1951\\\",\\n \\\"interpretation\\\": \\\"1951-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 9,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 4'500.-\\\",\\n \\\"interpretation\\\": \\\"4500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1952\\\",\\n \\\"interpretation\\\": \\\"1952-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 10,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 4'800.-\\\",\\n \\\"interpretation\\\": \\\"4800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1953\\\",\\n \\\"interpretation\\\": \\\"1953-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 11,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5'100.-\\\",\\n \\\"interpretation\\\": \\\"5100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1954\\\",\\n \\\"interpretation\\\": \\\"1954-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 12,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5'400.-\\\",\\n \\\"interpretation\\\": \\\"5400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1955\\\",\\n \\\"interpretation\\\": \\\"1955-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 13,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5'700.-\\\",\\n \\\"interpretation\\\": \\\"5700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1956\\\",\\n \\\"interpretation\\\": \\\"1956-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 14,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 6'000.-\\\",\\n \\\"interpretation\\\": \\\"6000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1957\\\",\\n \\\"interpretation\\\": \\\"1957-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 15,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 6'300.-\\\",\\n \\\"interpretation\\\": \\\"6300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1958\\\",\\n \\\"interpretation\\\": \\\"1958-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 16,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 6'600.-\\\",\\n \\\"interpretation\\\": \\\"6600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1959\\\",\\n \\\"interpretation\\\": \\\"1959-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 17,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 6'900.-\\\",\\n \\\"interpretation\\\": \\\"6900\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1960\\\",\\n \\\"interpretation\\\": \\\"1960-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 18,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 7'200.-\\\",\\n \\\"interpretation\\\": \\\"7200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1961\\\",\\n \\\"interpretation\\\": \\\"1961-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 19,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 7'500.-\\\",\\n \\\"interpretation\\\": \\\"7500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1962\\\",\\n \\\"interpretation\\\": \\\"1962-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 20,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 7'800.-\\\",\\n \\\"interpretation\\\": \\\"7800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1963\\\",\\n \\\"interpretation\\\": \\\"1963-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 21,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 8'100.-\\\",\\n \\\"interpretation\\\": \\\"8100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1964\\\",\\n \\\"interpretation\\\": \\\"1964-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 22,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 8'400.-\\\",\\n \\\"interpretation\\\": \\\"8400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1965\\\",\\n \\\"interpretation\\\": \\\"1965-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 23,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 8'700.-\\\",\\n \\\"interpretation\\\": \\\"8700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1966\\\",\\n \\\"interpretation\\\": \\\"1966-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 24,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 9'000.-\\\",\\n \\\"interpretation\\\": \\\"9000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1967\\\",\\n \\\"interpretation\\\": \\\"1967-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 25,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 9'300.-\\\",\\n \\\"interpretation\\\": \\\"9300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1968\\\",\\n \\\"interpretation\\\": \\\"1968-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 26,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 9'600.-\\\",\\n \\\"interpretation\\\": \\\"9600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1969\\\",\\n \\\"interpretation\\\": \\\"1969-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 27,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 9'900.-\\\",\\n \\\"interpretation\\\": \\\"9900\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1970\\\",\\n \\\"interpretation\\\": \\\"1970-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 28,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 10'200.-\\\",\\n \\\"interpretation\\\": \\\"10200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1971\\\",\\n \\\"interpretation\\\": \\\"1971-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 29,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 10'500.-\\\",\\n \\\"interpretation\\\": \\\"10500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1972\\\",\\n \\\"interpretation\\\": \\\"1972-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 30,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 10'800.-\\\",\\n \\\"interpretation\\\": \\\"10800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1973\\\",\\n \\\"interpretation\\\": \\\"1973-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 31,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 11'100.-\\\",\\n \\\"interpretation\\\": \\\"11100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1974\\\",\\n \\\"interpretation\\\": \\\"1974-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 32,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 11'400.-\\\",\\n \\\"interpretation\\\": \\\"11400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1975\\\",\\n \\\"interpretation\\\": \\\"1975-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 33,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 11'700.-\\\",\\n \\\"interpretation\\\": \\\"11700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1976\\\",\\n \\\"interpretation\\\": \\\"1976-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 34,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 12'000.-\\\",\\n \\\"interpretation\\\": \\\"12000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1977\\\",\\n \\\"interpretation\\\": \\\"1977-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 35,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 12'300.-\\\",\\n \\\"interpretation\\\": \\\"12300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1978\\\",\\n \\\"interpretation\\\": \\\"1978-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 36,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 12'600.-\\\",\\n \\\"interpretation\\\": \\\"12600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1979\\\",\\n \\\"interpretation\\\": \\\"1979-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 37,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 12'900.-\\\",\\n \\\"interpretation\\\": \\\"12900\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1980\\\",\\n \\\"interpretation\\\": \\\"1980-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 38,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 13'200.-\\\",\\n \\\"interpretation\\\": \\\"13200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1981\\\",\\n \\\"interpretation\\\": \\\"1981-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 39,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 13'500.-\\\",\\n \\\"interpretation\\\": \\\"13500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1982\\\",\\n \\\"interpretation\\\": \\\"1982-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 40,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 13'800.-\\\",\\n \\\"interpretation\\\": \\\"13800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1983\\\",\\n \\\"interpretation\\\": \\\"1983-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 41,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 14'100.-\\\",\\n \\\"interpretation\\\": \\\"14100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1984\\\",\\n \\\"interpretation\\\": \\\"1984-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 42,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 14'400.-\\\",\\n \\\"interpretation\\\": \\\"14400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1985\\\",\\n \\\"interpretation\\\": \\\"1985-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 43,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 14'700.-\\\",\\n \\\"interpretation\\\": \\\"14700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1986\\\",\\n \\\"interpretation\\\": \\\"1986-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 44,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 15'000.-\\\",\\n \\\"interpretation\\\": \\\"15000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1987\\\",\\n \\\"interpretation\\\": \\\"1987-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 45,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 15'300.-\\\",\\n \\\"interpretation\\\": \\\"15300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1988\\\",\\n \\\"interpretation\\\": \\\"1988-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 46,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 15'600.-\\\",\\n \\\"interpretation\\\": \\\"15600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1989\\\",\\n \\\"interpretation\\\": \\\"1989-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 47,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 15'900.-\\\",\\n \\\"interpretation\\\": \\\"15900\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1990\\\",\\n \\\"interpretation\\\": \\\"1990-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 48,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 16'200.-\\\",\\n \\\"interpretation\\\": \\\"16200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1991\\\",\\n \\\"interpretation\\\": \\\"1991-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 49,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 16'500.-\\\",\\n \\\"interpretation\\\": \\\"16500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1992\\\",\\n \\\"interpretation\\\": \\\"1992-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 50,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 16'800.-\\\",\\n \\\"interpretation\\\": \\\"16800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1993\\\",\\n \\\"interpretation\\\": \\\"1993-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 51,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 17'100.-\\\",\\n \\\"interpretation\\\": \\\"17100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1994\\\",\\n \\\"interpretation\\\": \\\"1994-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 52,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 17'400.-\\\",\\n \\\"interpretation\\\": \\\"17400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1995\\\",\\n \\\"interpretation\\\": \\\"1995-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 53,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 17'700.-\\\",\\n \\\"interpretation\\\": \\\"17700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1996\\\",\\n \\\"interpretation\\\": \\\"1996-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 54,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 18'000.-\\\",\\n \\\"interpretation\\\": \\\"18000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1997\\\",\\n \\\"interpretation\\\": \\\"1997-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 55,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 18'300.-\\\",\\n \\\"interpretation\\\": \\\"18300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1998\\\",\\n \\\"interpretation\\\": \\\"1998-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 56,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 18'600.-\\\",\\n \\\"interpretation\\\": \\\"18600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1999\\\",\\n \\\"interpretation\\\": \\\"1999-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 57,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 18'900.-\\\",\\n \\\"interpretation\\\": \\\"18900\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2000\\\",\\n \\\"interpretation\\\": \\\"2000-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 58,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 19'200.-\\\",\\n \\\"interpretation\\\": \\\"19200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2001\\\",\\n \\\"interpretation\\\": \\\"2001-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 59,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 19'500.-\\\",\\n \\\"interpretation\\\": \\\"19500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2002\\\",\\n \\\"interpretation\\\": \\\"2002-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 60,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 19'800.-\\\",\\n \\\"interpretation\\\": \\\"19800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2003\\\",\\n \\\"interpretation\\\": \\\"2003-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 61,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 20'100.-\\\",\\n \\\"interpretation\\\": \\\"20100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2004\\\",\\n \\\"interpretation\\\": \\\"2004-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 62,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 20'400.-\\\",\\n \\\"interpretation\\\": \\\"20400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2005\\\",\\n \\\"interpretation\\\": \\\"2005-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 63,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 20'700.-\\\",\\n \\\"interpretation\\\": \\\"20700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2006\\\",\\n \\\"interpretation\\\": \\\"2006-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 64,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 21'000.-\\\",\\n \\\"interpretation\\\": \\\"21000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2007\\\",\\n \\\"interpretation\\\": \\\"2007-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 65,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 21'300.-\\\",\\n \\\"interpretation\\\": \\\"21300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2008\\\",\\n \\\"interpretation\\\": \\\"2008-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 66,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 21'600.-\\\",\\n \\\"interpretation\\\": \\\"21600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2009\\\",\\n \\\"interpretation\\\": \\\"2009-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 67,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 21'900.-\\\",\\n \\\"interpretation\\\": \\\"21900\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2010\\\",\\n \\\"interpretation\\\": \\\"2010-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 68,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 22'200.-\\\",\\n \\\"interpretation\\\": \\\"22200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2011\\\",\\n \\\"interpretation\\\": \\\"2011-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 69,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 22'500.-\\\",\\n \\\"interpretation\\\": \\\"22500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2012\\\",\\n \\\"interpretation\\\": \\\"2012-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 70,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 22'800.-\\\",\\n \\\"interpretation\\\": \\\"22800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2013\\\",\\n \\\"interpretation\\\": \\\"2013-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 71,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 23'100.-\\\",\\n \\\"interpretation\\\": \\\"23100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2014\\\",\\n \\\"interpretation\\\": \\\"2014-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 72,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 23'400.-\\\",\\n \\\"interpretation\\\": \\\"23400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2015\\\",\\n \\\"interpretation\\\": \\\"2015-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 73,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 23'700.-\\\",\\n \\\"interpretation\\\": \\\"23700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2016\\\",\\n \\\"interpretation\\\": \\\"2016-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 74,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 24'000.-\\\",\\n \\\"interpretation\\\": \\\"24000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2017\\\",\\n \\\"interpretation\\\": \\\"2017-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 75,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 24'300.-\\\",\\n \\\"interpretation\\\": \\\"24300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2018\\\",\\n \\\"interpretation\\\": \\\"2018-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 76,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 24'600.-\\\",\\n \\\"interpretation\\\": \\\"24600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2019\\\",\\n \\\"interpretation\\\": \\\"2019-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 77,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 24'900.-\\\",\\n \\\"interpretation\\\": \\\"24900\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 2020\\\",\\n \\\"interpretation\\\": \\\"2020-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"tool_calls\":null,\"prefix\":false,\"role\":\"assistant\"},\"finish_reason\":\"stop\"}]}"}, "scoring": {"f1_micro": 0.042212654436540625, "f1_macro": 0.023934426229508195, "micro_precision": 0.023926998779776117, "micro_recall": 0.17903930131004367, "total_instances": 61, "total_tp": 451, "total_fp": 18398, "total_fn": 2068, "cost_summary": {"total_input_tokens": 39082, "total_output_tokens": 347892, "total_tokens": 386974, "input_cost_usd": 0.015632800000000002, "output_cost_usd": 0.695784, "total_cost_usd": 0.7114168000000002}}, "normalized_score": 4.221265443654063}, {"_id": {"$oid": "69d4eb12b877594bc5718c33"}, "test_id": "T0577", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "anthropic", "model": "claude-opus-4-1-20250805", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfslagerleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Geisshof\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"270.-\",\"interpretation\":\"270\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"13. Jan. 1941\",\"interpretation\":\"1941-01-13\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "claude-opus-4-1-20250805", "provider": "anthropic", "finish_reason": "tool_use", "usage": {"input_tokens": 3767, "output_tokens": 319, "total_tokens": 4086, "input_cost_usd": 0.056505, "output_cost_usd": 0.023925000000000002, "estimated_cost_usd": 0.08043}, "duration": 9.19486117362976, "timestamp": "2026-02-09T16:30:19.526767", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfslagerleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Geisshof", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "270.-", "interpretation": "270", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "13. Jan. 1941", "interpretation": "1941-01-13", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "10d4ce48-804c-46fa-8d31-e4abf7e478e6", "score": {"f1_score": 1.0, "precision": 1.0, "recall": 1.0, "true_positives": 12, "false_positives": 0, "false_negatives": 0, "field_scores": {"rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfslagerleiter", "ground_truth": "Hilfslagerleiter", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1941-01-13", "ground_truth": "1941-01-13", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "270", "ground_truth": "270", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "13. Jan. 1941", "ground_truth": "13. Jan. 1941", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "270.-", "ground_truth": "270.-", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Geisshof", "ground_truth": "Geisshof", "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 19}, "raw_response": "{\"id\":\"msg_011GdVhUdXkoD9GxGgGEuTS8\",\"content\":[{\"id\":\"toolu_01CRLi1Fm8HKS4pFchcVyXYe\",\"input\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfslagerleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Geisshof\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"270.-\",\"interpretation\":\"270\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"13. Jan. 1941\",\"interpretation\":\"1941-01-13\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}}]},\"name\":\"extract_structured_data\",\"type\":\"tool_use\"}],\"model\":\"claude-opus-4-1-20250805\",\"role\":\"assistant\",\"stop_reason\":\"tool_use\",\"stop_sequence\":null,\"type\":\"message\",\"usage\":{\"cache_creation\":{\"ephemeral_1h_input_tokens\":0,\"ephemeral_5m_input_tokens\":0},\"cache_creation_input_tokens\":0,\"cache_read_input_tokens\":0,\"input_tokens\":3767,\"output_tokens\":319,\"server_tool_use\":null,\"service_tier\":\"standard\",\"inference_geo\":\"not_available\"}}"}, "scoring": {"f1_micro": 0.8765072765072766, "f1_macro": 0.8662295081967214, "micro_precision": 0.9197207678883071, "micro_recall": 0.8371723590150913, "total_instances": 61, "total_tp": 2108, "total_fp": 184, "total_fn": 410, "cost_summary": {"total_input_tokens": 228973, "total_output_tokens": 60065, "total_tokens": 289038, "input_cost_usd": 3.434594999999998, "output_cost_usd": 4.504874999999999, "total_cost_usd": 7.939470000000001}}, "normalized_score": 87.65072765072766}, {"_id": {"$oid": "69d4eb12b877594bc5718c34"}, "test_id": "T0618", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openrouter", "model": "qwen/qwen3-vl-8b-instruct", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin,\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2700.-\",\"interpretation\":\"2700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"17. Dez. 45\",\"interpretation\":\"1945-12-17\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2850.-\",\"interpretation\":\"2850\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 46\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3100.-\",\"interpretation\":\"3100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 47\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3238.-\",\"interpretation\":\"3238\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 48\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "qwen/qwen3-vl-8b-instruct", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 5202, "output_tokens": 1082, "total_tokens": 6284}, "duration": 9.566864013671875, "timestamp": "2026-02-09T17:14:29.808198", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin,", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2700.-", "interpretation": "2700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "17. Dez. 45", "interpretation": "1945-12-17", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2850.-", "interpretation": "2850", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 46", "interpretation": "1946-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3100.-", "interpretation": "3100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 47", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3238.-", "interpretation": "3238", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 48", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "8316e177-4cd7-420c-82c9-262a40128710", "score": {"f1_score": 0.99, "precision": 1.0, "recall": 0.9782608695652174, "true_positives": 45, "false_positives": 0, "false_negatives": 1, "field_scores": {"rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-07-01", "ground_truth": "1946-07-01", "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2700.-", "ground_truth": "2700.-", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin,", "ground_truth": "Hilfsleiterin,", "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2700", "ground_truth": "2700", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Hilfsleiterin", "score": 0.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 47", "ground_truth": "1. Jan. 47", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3238.-", "ground_truth": "3238.-", "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3238", "ground_truth": "3238", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2850", "ground_truth": "2850", "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3100.-", "ground_truth": "3100.-", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2850.-", "ground_truth": "2850.-", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 46", "ground_truth": "1. Juli 46", "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 48", "ground_truth": "1. Jan. 48", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "17. Dez. 45", "ground_truth": "17. Dez. 45", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3100", "ground_truth": "3100", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-12-17", "ground_truth": "1945-12-17", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": "1948-01-01", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 76}, "raw_response": "{\"id\":\"gen-1770653654-7scvTi3QgnmNaFjmDjzX\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"17. Dez. 45\\\",\\n \\\"interpretation\\\": \\\"1945-12-17\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin,\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"2700.-\\\",\\n \\\"interpretation\\\": \\\"2700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"row_number\\\": 1\\n },\\n {\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 46\\\",\\n \\\"interpretation\\\": \\\"1946-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"2850.-\\\",\\n \\\"interpretation\\\": \\\"2850\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"row_number\\\": 2\\n },\\n {\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 47\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3100.-\\\",\\n \\\"interpretation\\\": \\\"3100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"row_number\\\": 3\\n },\\n {\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 48\\\",\\n \\\"interpretation\\\": \\\"1948-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3238.-\\\",\\n \\\"interpretation\\\": \\\"3238\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"row_number\\\": 4\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin,\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2700.-\",\"interpretation\":\"2700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"17. Dez. 45\",\"interpretation\":\"1945-12-17\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2850.-\",\"interpretation\":\"2850\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 46\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3100.-\",\"interpretation\":\"3100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 47\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3238.-\",\"interpretation\":\"3238\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 48\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]},\"reasoning\":null},\"native_finish_reason\":\"stop\"}],\"created\":1770653654,\"model\":\"qwen/qwen3-vl-8b-instruct\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":1082,\"prompt_tokens\":5202,\"total_tokens\":6284,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":null,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":null,\"image_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":0,\"video_tokens\":0},\"cost\":0.00169376,\"is_byok\":false,\"cost_details\":{\"upstream_inference_cost\":null,\"upstream_inference_prompt_cost\":0.00093636,\"upstream_inference_completions_cost\":0.0007574}},\"provider\":\"Alibaba\"}"}, "scoring": {"f1_micro": 0.8710952945828391, "f1_macro": 0.8342622950819673, "micro_precision": 0.8673228346456693, "micro_recall": 0.874900714853058, "total_instances": 61, "total_tp": 2203, "total_fp": 337, "total_fn": 315, "cost_summary": {"total_input_tokens": 299311, "total_output_tokens": 56165, "total_tokens": 355476, "input_cost_usd": 0.0, "output_cost_usd": 0.0, "total_cost_usd": 0.0}}, "normalized_score": 87.1095294582839}, {"_id": {"$oid": "69d4eb12b877594bc5718c35"}, "test_id": "T0581", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "anthropic", "model": "claude-sonnet-4-5-20250929", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter-Rechnungsf\u00fchrer\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3500.-\",\"interpretation\":\"3500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"15. Sept. 1943\",\"interpretation\":\"1943-09-15\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. 200 Techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter-Rechnungsf\u00fchrer\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3545.-\",\"interpretation\":\"3545\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.200.-techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3925.-\",\"interpretation\":\"3925\",\"is_crossed_out\":true},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 45\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":true},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter-Rechnungsf\u00fchrer\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.115.-\",\"interpretation\":\"5115\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5295.-\",\"interpretation\":\"5295\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5475.-\",\"interpretation\":\"5475\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "claude-sonnet-4-5-20250929", "provider": "anthropic", "finish_reason": "tool_use", "usage": {"input_tokens": 4027, "output_tokens": 1739, "total_tokens": 5766, "input_cost_usd": 0.012081000000000001, "output_cost_usd": 0.026085, "estimated_cost_usd": 0.038166000000000005}, "duration": 17.808212995529175, "timestamp": "2026-02-09T17:27:13.604199", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter-Rechnungsf\u00fchrer", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3500.-", "interpretation": "3500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "15. Sept. 1943", "interpretation": "1943-09-15", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 200 Techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiter-Rechnungsf\u00fchrer", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3545.-", "interpretation": "3545", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl.200.-techn.Z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3925.-", "interpretation": "3925", "is_crossed_out": true}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 45", "interpretation": "1945-01-01", "is_crossed_out": true}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiter-Rechnungsf\u00fchrer", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.115.-", "interpretation": "5115", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5295.-", "interpretation": "5295", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5475.-", "interpretation": "5475", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "84313fa4-0ad6-4e66-b43d-88d7a30caf3d", "score": {"f1_score": 1.0, "precision": 1.0, "recall": 1.0, "true_positives": 70, "false_positives": 0, "false_negatives": 0, "field_scores": {"rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": true, "ground_truth": true, "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "inkl.200.-techn.Z.", "ground_truth": "inkl.200.-techn.Z.", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": "Hilfsleiter-Rechnungsf\u00fchrer", "ground_truth": "Hilfsleiter-\nRechnungsf\u00fchrer", "score": 0.9818181818181819}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5475.-", "ground_truth": "5475.-", "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5295.-", "ground_truth": "5295.-", "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter-Rechnungsf\u00fchrer", "ground_truth": "Hilfsleiter-\nRechnungsf\u00fchrer", "score": 0.9818181818181819}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3545", "ground_truth": "3545", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5295", "ground_truth": "5295", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiter-Rechnungsf\u00fchrer", "ground_truth": "Hilfsleiter-\nRechnungsf\u00fchrer", "score": 0.9818181818181819}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1947", "ground_truth": "1. Januar 1947", "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 45", "ground_truth": "1. Jan. 45", "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "inkl. 200 Techn.Z.", "ground_truth": "inkl. 200 Techn.Z.", "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3925.-", "ground_truth": "3925.-", "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1946-01-01", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5115", "ground_truth": "5115", "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3925", "ground_truth": "3925", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3500", "ground_truth": "3500", "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3500.-", "ground_truth": "3500.-", "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5475", "ground_truth": "5475", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-09-15", "ground_truth": "1943-09-15", "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1946", "ground_truth": "1. Januar 1946", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3545.-", "ground_truth": "3545.-", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": true, "ground_truth": true, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "15. Sept. 1943", "ground_truth": "15. Sept. 1943", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.115.-", "ground_truth": "5.115.-", "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 114}, "raw_response": "{\"id\":\"msg_01HstpgpxrESrYuSNHsrk7qb\",\"content\":[{\"id\":\"toolu_0122TVP6feZ32Cwwcdx13Z9k\",\"input\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter-Rechnungsf\u00fchrer\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3500.-\",\"interpretation\":\"3500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"15. Sept. 1943\",\"interpretation\":\"1943-09-15\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. 200 Techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter-Rechnungsf\u00fchrer\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3545.-\",\"interpretation\":\"3545\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.200.-techn.Z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3925.-\",\"interpretation\":\"3925\",\"is_crossed_out\":true},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 45\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":true},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter-Rechnungsf\u00fchrer\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.115.-\",\"interpretation\":\"5115\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5295.-\",\"interpretation\":\"5295\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5475.-\",\"interpretation\":\"5475\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]},\"name\":\"extract_structured_data\",\"type\":\"tool_use\"}],\"model\":\"claude-sonnet-4-5-20250929\",\"role\":\"assistant\",\"stop_reason\":\"tool_use\",\"stop_sequence\":null,\"type\":\"message\",\"usage\":{\"cache_creation\":{\"ephemeral_1h_input_tokens\":0,\"ephemeral_5m_input_tokens\":0},\"cache_creation_input_tokens\":0,\"cache_read_input_tokens\":0,\"input_tokens\":4027,\"output_tokens\":1739,\"server_tool_use\":null,\"service_tier\":\"standard\",\"inference_geo\":\"not_available\"}}"}, "scoring": {"f1_micro": 0.8045292014302741, "f1_macro": 0.8318032786885247, "micro_precision": 0.8048489666136724, "micro_recall": 0.8042096902303415, "total_instances": 61, "total_tp": 2025, "total_fp": 491, "total_fn": 493, "cost_summary": {"total_input_tokens": 245626, "total_output_tokens": 60595, "total_tokens": 306221, "input_cost_usd": 0.7368780000000006, "output_cost_usd": 0.908925, "total_cost_usd": 1.6458030000000001}}, "normalized_score": 80.45292014302741}, {"_id": {"$oid": "69d4eb12b877594bc5718c36"}, "test_id": "T0620", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openrouter", "model": "x-ai/grok-4", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4200.-\",\"interpretation\":\"4200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Okt. 45\",\"interpretation\":\"1945-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "x-ai/grok-4", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 3213, "output_tokens": 916, "total_tokens": 4129, "cached_tokens": 679}, "duration": 19.61096453666687, "timestamp": "2026-02-09T19:10:34.431915", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4200.-", "interpretation": "4200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Okt. 45", "interpretation": "1945-10-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "990e17e9-f4a9-433d-9954-6189cb12f39b", "score": {"f1_score": 0.83, "precision": 0.8333333333333334, "recall": 0.8333333333333334, "true_positives": 10, "false_positives": 2, "false_negatives": 2, "field_scores": {"rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4200.-", "ground_truth": "4200.-", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4200", "ground_truth": "4200", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Okt. 45", "ground_truth": "9. Okt. 45", "score": 0.9}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-10-01", "ground_truth": "1945-10-09", "score": 0.9}}, "total_fields": 19}, "raw_response": "{\"id\":\"gen-1770660609-QrUHgALAruryZcmvZ1hv\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\" {\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4200.-\\\",\\\"interpretation\\\":\\\"4200\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Okt. 45\\\",\\\"interpretation\\\":\\\"1945-10-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4200.-\",\"interpretation\":\"4200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Okt. 45\",\"interpretation\":\"1945-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]},\"reasoning\":null,\"reasoning_details\":[{\"id\":\"rs_d5c439b0-dcd5-e8d3-57b7-1b71c9539316\",\"format\":\"xai-responses-v1\",\"index\":0,\"type\":\"reasoning.encrypted\",\"data\":\"16lg9Ee9jBv2w+PMXn3MXdFMsHoy5gY7x4ylYtW/eomcpCT3zhba+6yey3qqSw1fNWLPPlFeF2DjS24B1Qf4NAj1iFSo2dQIJTw3lFsUgNYKLQjk2+g5ZIom6tTjQ1XoGnH1pHYlNQkUpI/XPnvU7c+idGb5Sxvl+me+5PkU3gGT6ZhElJCFycoWRFFYGpXdCc3XufhzJXSgC+Hemn9alz0yARM3f4TMWQR72G0bATQLKXo+WEqZYwb1eT9miwhH5XZBHfjVO5kbpYFQRtgmmBHscCgjPJ4DPD7cgrFG/GzctDg93Fw62UNiOYylQUHGlxRej4bH1IsSLBrfrG5kDvcp92xa8+Hv6CGMUI3o1QjvFHI4ldyYp8i3Kw1s6cALyItrdwfH5/0WMmCg0K3Tdmuh3tLDBF2VvmwWkXNG7CIR92nVkrp7Ur7lpCrpopQKX1Vtq/TkATs0YZDPXX5w/FxlW9pbxp3kXZybiBDhVS4ARvRlHAOFN5TSJR40liJyxLRl8RDQvr/1FEQ14VyvXOgnEtP7Q8bpbphG8VjgHG2f4O3+m6XdvYfK5onacSAXArP2xqaejbqHh3UrSIt49Y9hTOK8odcZqXRShDX4QBX4h3LztalEz9Ql+pUpvujuS8tikAjEKIBY+OyaUhIVccLoVuZ8KxsG+uyWaElMtsBppAwmUvrxC4ndUYwHY6RkUjiKTIijXODf6wmyJLKOaG0P+ryQBu+VWa3HlsZb5RCdMn8RzMPTkspjK3j3nTaUmPkQTh3aBgF98YeYf/qcZXZKxRl59/66OD3WHSvoD+shwqSGRLGQAeFhXJRgiLZHd5CxrcEK+epTEN5kupM6bpP2v9c+Qkexd7t0Lp9bNdaTUtAsVxe7QWz8vPaJoCo3GJ0n2dfWchTsuMZj9S7wKYGXPMxnNHcdZstMq6llbOAhxcw2+L4SxhhcwFUVgnR2HGZHkri0rgQt0K6aXsGAOCcmOgSDOMOOjuQzAMgaYHaHAg1WzHVN3PlWm4Kc0TrpyM4FdJg1h8NpEsSH5jAy0b1ADOfG0Le7GTkMGaljj0n8cR5j4bI3ve9wG6YJt3B5LMRlPMJlUDn1X5tHlQhu3BTbs3WV7LUlSSNwu0sKjVwYdckUZPE1UlYgQA+zlwzDimOcboE0S4pFjXNruDoaXdPBVB6ECvzMyG8RBvJrrLRcAKccKhHP/XFfiIsSpq2mo8vE+ho1MFhDS6nWW9zqRXj3EruI7y0FKXksfT3f/NSyBwIKgcSrX1B0OhgH1QiSQ6RSFwgxlJxr38b9ruh7hY/uGLSbKSk0Hj2nXbbr8val2qzPiQzYsSPH2+NSsXob0orK1R61N/H5HFU+hpkrRZRiikh19KcESdf05SbFrQf1wYnEdBCe6r2rMJExRXyyNg1z2ipXTot2Pj2gGCFdd4wrCSygTi6C5jPnQOfQ/vFhI2XILwmTAnMt8AHIyOQEB/OTrrFCeRcvXonjFQO2WFRakA2stBEHyEDSDeVfa6lfR542Wu1lcskcoab3OazZerJQa/P5ON6lcHnFO0rDitEzYtKvTmZQAUL4a12db9g/7PYxuTUMwxf+tiJ628X8a+w3X2FoGhg3w0YOposACWVoPm6DlrJsvgu3fgTtaW1caKrIShS0k2MCoOSAKQ5XLWmxeb8k1bOpqiI11uftSmCajmIP4X6D0K75/ta28LQ4aC4XXoW61qOWjf2xxKSpHetO+w0Q1oUh6d83HvK9Sfdff3VCk8MhL2j9o/KVce5XuyoO7qFfdE++a45G0X65LhgcZlHa63cjpPosj/S5KzqeEiYw2tjf+X6cVYZ7Z1Hax97hfji2Y4lzkmfDC0bzsMvjSV6xUxuSvDwZLELXyxMObILacDdB5Bnf1mKV6gOHkaup0pNjXsTFcfXvEX4tr6u4o3aKGx9VgD5pOnnF9pGt2t4d8ZjR37QLOXp+nVlQB6NoZ4DeM+hGp0xpxooRxvadC4LZSriEYWoz2oRR61hbKxddkLx6DYpXEfKLTPw0rf3S8DXJF1jsxOJF3e0uMlLt1y9yBwBbjpWhLZIdnpKFiBzZYKwDXdXgxUhDvk3CT+UaFMNvfJzqZ85BzH4AMFp1bhexJMCnR1jufZn1pyi+l0vcHGEUun/WCYYHJyoB9FlspamIPFyKPjZv05+KWPwG5BEuS7/Ajy/RUBjFsGWM88m2dLquFLLZCoGnRhexUo59Nbd2CZtldKVbH3oL92dOWk5DuwrE+jg1LjYJOmJYfHN/ld2o0+lJUAy4KH+4RXY4fIBd9KyHxutHge1cG8evP40lzHsmeiyw8QMGL885p9KLhQjPsNkC0Q4I5v+czUeD5w8/voRV/hPr/nABnOi8zkIOTRRWgWoiWMJqouagDLVNR49HZCk4DZXIdwT0XASsMp/hDnilCIXc2BXrBqdB2CN919vgg1bV7JB6sKMevDrZeEiL+ZQCOSn/6oVpjbf3SuQnQ3Krio4IMvagiVgsaiattQrHbxxjgUUF3X8m/CaQVcf5ZmxUZhLp+0DWU805zMDt8oF7Et7xFCRAXA7w1BbRARtdzIhJx9q6KlJ9GA3wtYLQ/fSL1p5udlnqe2K8UfUJFCcsOz8wfdj6mIjbrC3agwmo9j8oxcvlaMO5risRLQ2uS2g4uVtkT0LRiRZwhzrWz+sHw/v6ZobvfG+4XDUoSPTid/De4YiDhgf7FCUVbl4KpL1mdNNUauUAgJWDO1Ee5UUGHCKY7+6gdzGEr8jnhieGMNibObN4bdznpstmMbdeJjwBhuC9ADFML4IxvkZm95Y9orBJ+gt3iRcA2+x29NyOmpERzqx7IOjccQp7IOf7rdKHlQCxilE49CwUWK1dP/AWEShtJf4FAJBsn0ALqbwXKt12XQBWJyryvf/rLKn2BKYKA9MrlvdAa9+B8kQOUrI4nDr0Yl30uOfKuyXdmFfKASybqx+ZtG+sNLPX4DccoKlY7/qM/BT/DbU17n6mLpKIT965+JFcTd5Wd7f07Ods76b8I3ywUS0Ei4JmQHWoQRC5N+/KJlI0SutpXOD65Lr48VwLD/U0M1m+D+DJL3yz9lhuIt1EtPR/dA9NLAbBmcDMNgKVU81jr3pLetKHeW50eLdEevyUoKrp4cK2TxwkK1UFpzwoLO4JXq13eyI7A/r11X9zaGhseDkqkUINscGLtieNkIGYm4RPalc/oVG20dACY88HKSNDXvAUWlYeWOCiVMBYdFkskCzk2SGSgz1CIvt/7sITzS/gGzj/ApC9WxAPoD9YoqmYjmUhpibNrR6iMeyVTPpKnWzPaBALQoJJ6lFNPiX9+q1o5fX8GYRpyx3cwjN4TpkP+5/PhKmXgAgjxxjmKh6r1WzFWnEr1QbIHinyQUUh7tjzGtyy/DyXqd9BtMxKh84D5F1Yrv3yAeu1ARwI6h9mTMDhMxrs5fSWzzEMibJvqX0KNjeQYeahJOSb8/bjpWYi4IcakU33DPJX6yL6iSjn1y0p1/SGbb/3WmN0Ka64JRdf1EQhqzIli3SEr3yfLn1bQ75XWoaaFgT/l0TW6Yx9UzUvPR/0MxbXPzPIJiHHvmJub28V+emV/rnw7ycWEu2vUYAOp431TgBHLOPW8lLndmHLKJMLhe0Q\"}]},\"native_finish_reason\":\"completed\"}],\"created\":1770660609,\"model\":\"x-ai/grok-4\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":916,\"prompt_tokens\":3213,\"total_tokens\":4129,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":null,\"reasoning_tokens\":741,\"rejected_prediction_tokens\":null},\"prompt_tokens_details\":{\"audio_tokens\":null,\"cached_tokens\":679},\"cost\":0.02185125,\"is_byok\":false,\"cost_details\":{\"upstream_inference_cost\":0.02185125,\"upstream_inference_prompt_cost\":0.00811125,\"upstream_inference_completions_cost\":0.01374}},\"provider\":\"xAI\"}"}, "scoring": {"f1_micro": 0.5597110072248195, "f1_macro": 0.5718032786885247, "micro_precision": 0.6019195612431444, "micro_recall": 0.5230341540905481, "total_instances": 61, "total_tp": 1317, "total_fp": 871, "total_fn": 1201, "cost_summary": {"total_input_tokens": 195993, "total_output_tokens": 265259, "total_tokens": 461252, "input_cost_usd": 0.0, "output_cost_usd": 0.0, "total_cost_usd": 0.0}}, "normalized_score": 55.97110072248195}, {"_id": {"$oid": "69d4eb12b877594bc5718c37"}, "test_id": "T0595", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "mistral", "model": "magistral-medium-2509", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Assistent\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Professor\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3.700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.April 1945\",\"interpretation\":\"1945-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Bef\u00f6rderung\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "magistral-medium-2509", "provider": "mistral", "finish_reason": "stop", "usage": {"input_tokens": 1810, "output_tokens": 569, "total_tokens": 2379, "input_cost_usd": 0.00362, "output_cost_usd": 0.002845, "estimated_cost_usd": 0.006465}, "duration": 15.772790431976318, "timestamp": "2026-02-09T17:01:32.133804", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Assistent", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'400.-", "interpretation": "2400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "Professor", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3.700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1.April 1945", "interpretation": "1945-04-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Bef\u00f6rderung", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "5378aac6-9e08-4f33-893d-2f71afe460cd", "score": {"f1_score": 0.38, "precision": 0.41379310344827586, "recall": 0.34285714285714286, "true_positives": 12, "false_positives": 17, "false_negatives": 23, "field_scores": {"rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": "6. April 1943", "score": 0.48}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'400.-", "ground_truth": "3340.-", "score": 0.4705882352941176}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3.700.-", "ground_truth": "3460.-", "score": 0.6153846153846154}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": null, "ground_truth": "1. Januar 1945", "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1.April 1945", "ground_truth": "1. Feb. 1944", "score": 0.5}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": "4.830.--", "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Hilfsleiter", "score": 0.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1945-01-01", "score": 0.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-04-01", "ground_truth": "1944-02-01", "score": 0.8}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": "3460", "score": 0.5}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Assistent", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "Bef\u00f6rderung", "ground_truth": "(inkl.400.- tech.Zl.)", "score": 0.0625}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2400", "ground_truth": "3340", "score": 0.5}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": "4830", "score": 0.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": "\"", "score": 0.0}, "rows[2].dienstort.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": null, "ground_truth": false, "score": 0.0}, "rows[0].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1943-04-06", "score": 0.7}, "rows[1].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "Professor", "ground_truth": "Hilfsleiter", "score": 0.30000000000000004}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 57}, "raw_response": "{\"id\":\"7d48d171472540aa9916974a227d1c00\",\"object\":\"chat.completion\",\"model\":\"magistral-medium-2509\",\"usage\":{\"prompt_tokens\":1810,\"completion_tokens\":569,\"total_tokens\":2379,\"num_cached_tokens\":1920},\"created\":1770652870,\"choices\":[{\"index\":0,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Assistent\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'400.-\\\",\\n \\\"interpretation\\\": \\\"2400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Professor\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3.700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1.April 1945\\\",\\n \\\"interpretation\\\": \\\"1945-04-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bef\u00f6rderung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"tool_calls\":null,\"prefix\":false,\"role\":\"assistant\"},\"finish_reason\":\"stop\"}]}"}, "scoring": {"f1_micro": 0.1945193171608266, "f1_macro": 0.18098360655737702, "micro_precision": 0.22388831437435366, "micro_recall": 0.17196187450357425, "total_instances": 61, "total_tp": 433, "total_fp": 1501, "total_fn": 2085, "cost_summary": {"total_input_tokens": 110410, "total_output_tokens": 41850, "total_tokens": 152260, "input_cost_usd": 0.22082000000000027, "output_cost_usd": 0.20925000000000005, "total_cost_usd": 0.43006999999999973}}, "normalized_score": 19.45193171608266}, {"_id": {"$oid": "69d4eb12b877594bc5718c38"}, "test_id": "T0610", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[]}", "model": "gpt-5-2025-08-07", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 3105, "output_tokens": 337, "total_tokens": 3442, "cached_tokens": 2176, "input_cost_usd": 0.00388125, "output_cost_usd": 0.00337, "estimated_cost_usd": 0.007251250000000001}, "duration": 8.120957374572754, "timestamp": "2026-02-09T23:36:50.836031", "parsed": {"rows": []}, "conversation_id": "7a9faad1-c20f-4292-9719-e20ee77c3b0b", "score": {"f1_score": 0.0, "precision": 0.0, "recall": 0.0, "true_positives": 0, "false_positives": 0, "false_negatives": 0, "field_scores": {}, "total_fields": 0}, "raw_response": "{\"id\":\"chatcmpl-D7UA0cRrkVj68Hvvk4Kiqrq6Js360\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\": []}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[]}}}],\"created\":1770676604,\"model\":\"gpt-5-2025-08-07\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":337,\"prompt_tokens\":3105,\"total_tokens\":3442,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":320,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":2176}}}"}, "scoring": {"f1_micro": 0.9349941611521994, "f1_macro": 0.8875409836065574, "micro_precision": 0.9401174168297456, "micro_recall": 0.9299264421215641, "total_instances": 61, "total_tp": 2402, "total_fp": 153, "total_fn": 181, "cost_summary": {"total_input_tokens": 189405, "total_output_tokens": 212719, "total_tokens": 402124, "input_cost_usd": 0.23675625000000014, "output_cost_usd": 2.12719, "total_cost_usd": 2.36394625}}, "normalized_score": 93.49941611521993}, {"_id": {"$oid": "69d4eb12b877594bc5718c39"}, "test_id": "T0593", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "genai", "model": "gemini-3-flash-preview", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2 950.-\",\"interpretation\":\"2950\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"13 August 1945\",\"interpretation\":\"1945-08-13\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gemini-3-flash-preview", "provider": "genai", "finish_reason": "STOP", "usage": {"input_tokens": 2317, "output_tokens": 301, "total_tokens": 3202, "input_cost_usd": 0.0011585, "output_cost_usd": 0.0009029999999999999, "estimated_cost_usd": 0.0020615}, "duration": 5.924721717834473, "timestamp": "2026-02-09T17:56:52.557699", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2 950.-", "interpretation": "2950", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "13 August 1945", "interpretation": "1945-08-13", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "0f425576-3c40-42bb-937e-942eeeea63b9", "score": {"f1_score": 0.92, "precision": 0.9166666666666666, "recall": 0.9166666666666666, "true_positives": 11, "false_positives": 1, "false_negatives": 1, "field_scores": {"rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-08-13", "ground_truth": "1945-08-13", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2 950.-", "ground_truth": "2.950.-", "score": 0.8571428571428572}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "13 August 1945", "ground_truth": "13. August 1945", "score": 0.9655172413793103}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2950", "ground_truth": "2950", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 19}, "raw_response": "{\"sdk_http_response\":{\"headers\":{\"content-type\":\"application/json; charset=UTF-8\",\"vary\":\"Origin, X-Origin, Referer\",\"content-encoding\":\"gzip\",\"date\":\"Mon, 09 Feb 2026 16:56:46 GMT\",\"server\":\"scaffolding on HTTPServer2\",\"x-xss-protection\":\"0\",\"x-frame-options\":\"SAMEORIGIN\",\"x-content-type-options\":\"nosniff\",\"server-timing\":\"gfet4t7; dur=5774\",\"alt-svc\":\"h3=\\\":443\\\"; ma=2592000,h3-29=\\\":443\\\"; ma=2592000\",\"transfer-encoding\":\"chunked\"},\"body\":null},\"candidates\":[{\"content\":{\"parts\":[{\"video_metadata\":null,\"thought\":null,\"inline_data\":null,\"file_data\":null,\"thought_signature\":\"ErwOCrkOAb4-9vvM0XsXCr9OQZR-hFUgnyCzxbN3OXIx11UsRraKNAYHdlUXtojGVl2b-nIvW8vfFFy8WUqbmRH_VDiwGsY3fSh3uakje3J16rvYn0i0YwAqDa61tKARvvXshGrorMs5nS6GwW6Gdq0G3sR5dX4jMrM_PhnYuk4uw5LOaqm9sVtx-6BYxsJEsbaoflLm-ENjXZOkOO1oydT-6Z6NaAWHb-Ft_1a2OVjTYB4TzpxMiRuLhpsj8j04jeeoKUjnYNaGx3f_mdgzN7iLRKboCIljDv30t610dInj0jWi2_QM-PPRA0DMN5KyqFMfJ6u8XY3ge8K5Bsrp4CV-XpkuFOe32xjfoO-HXo4FCPY33QcQogyPSa0hq5d7z3UjAztc43Mcg2e-jvt1l7kM5Xd1MnUWWmKGtZYqNdQNHYOlwt8vXQu7In6N9Q0yBUzVY6pJ5mktj1jl8GjBtdedewhbCbEiZ9nCfuMDjB1XgzGoO08UxVriF8aUnQ8H0xCpQRUr0timSFF1wUcK_x-GfrGdS9Hbw5icc793GnX4jX5GjgAPw0-WIbtL1JTCK7jxeyNBSqPvu0K4lGmBPMdDLwh_7jecIxo0tgptcjGyGpCSsQFUXOVPS62wjv-pFwH1qA1dKadNtUHVrRndhxM-BTC_qGWpyNwsEj5pq79oxiIHdDebKHUnjX6QqVk2w6B4kbWVxKCiKnpi6cM1qOfer6rrHenzCuvgVTYhbMYW7VNE55uXCZl4Si9EUJXdhQXlh7gPaFgmyN3sftvaw9k3Z2aXi3l0JKDxUmxFz6NJkjc1HPlcKty48HY7YnsSNzv8ZnuLbpR9IaUmq2CS3Qb6i-tsOU2Y_ZSdtu8_gBrFJfgLgk27fnDqsgOqG9E488WQ_X0AWeouAIu9Zb9X9mZoNlaVdwzocbjx0BXk1simqCIW-JYCRolPx_3j6Zd_YfFqTHIEu58JCMGuFBy9FLm-qWYO1gpyp3ucxSURHJcDi16hAKYO5p1ChNq4htOW1MZC4bLFz9srHPPaaZXqtfeCex91A-rR11EhJaEZVv4hrFIYBe1WLiBDfV_U5WiTbZeQlqaDIxgH_ZHb8bjkb_wn9PvYwwWvvBzb59VOWsNWBqZq60oNZcMoh1dfrDQ2eBMQQ9DYnWSIvq1_WywH31pZCj9lt0J9M58bYIPjTMe05byzrNo3eTI6XYqcrJ3Oipcmm4fAqmZoSCYIcyZPYJUVZch0GvjRLwxQGUrIB9hueKAIS6L0KIQ5HG7Fl2Nb0v8oAOHyMdMgqt996cp-ZLRVbKB8rE0BDKRW_yCWKlEwEclqrks1LjM_R6KpOJMs78U9PGIDhc3lumeaKOV-EM2ZYDkYmg9-P2e5iVkwHXxEhCzrdhZB4cP94uk_UrXcTZvPD8XBN5ML3XZcAzPylyU4S4w5qclSmb_VA9ToEr_bVRSZxPp3TBiXftx9dNAFOgPyr7zoJ4Spw79XfCRrLGRIWPm4tvGG-cfKAyznQnnu3QNWhgGKjzhoh4LHtPx1Ea52BxQP6H9FsJs61s-hsuhQaxY8-xHn2tlVPmdqBoXy7nL_j8lsi3IsSvTZoq6M0Osn4u5OQC29V2FJH93saCGtFpAWe8eDqDl5ro2eFPIKR22GUClQCnjOxQFj9ruTbaqrKhYlgwsiFlCzxwr-4I-pI0-gjJCmWAHeqq0akUYWf1mphtQDQT7q0Ddf6xh6ScmViAX1nszE-9fjNFQY7OaE6fb7J8ORnsnbOsisRCSsQEDIVWoW8iURKgPdMUHBVSeznzX7WM1rwM0M-H8WTthFICwXj9M_jQCBEojyD1suyydxXo9WbKPd1nbRutWPKJ9uA0OflOHNH5dUK49vGi634JSoMh1PwJPgDbT7RYexg0Sqax8jTIyyUzG6TK29yzoGVKzaMktFKGfevLzA9L-SWS1WpmZ99IoANczDqB2J4leBZldAl6fZ9so3o1_MbwU6_UA-hE6XZuoL7pUTgSlMgqR6hS_GvFwwvGSfophd8XDFvGXMWbqNEnBuQyZLnFcH59XgTfDYGyLpMgA5PVuyPmGfQV8cr_moepisJCirkzl5oYM7oqB96amJ78KlXmmguMl9TNPj5R4zT3mhWX3PUspMKYG-nHW9QKYz5IkRk4wzi6a3gDk12D12LnIywu1a39EXL1PMPMwAFRV84Sy44V7PTO8VPv5vurOWUFWKBLAdBW1OSs6_bWFjyDvisOdZvGhBPPHktc8OyuF2jd6UbGh5cuGiHZyCq4koURF1C8fXAYc0prttin_fgBxf6nY3Nt3_MFaUB9TfzldfyNKFiYGjJ-U6EGsp1_7ozE-6olmueurTisxhclaUehlVgBWhuP1ltCTbUCYUQAdv6ZA5kk4eoCBGgvAMg27_AxFQaWqhDpt8NKkJ4bk4dsePQbeVDIozjjGyVecT3-ro-yxyhtY0l0FwFn_y30pDng==\",\"function_call\":null,\"code_execution_result\":null,\"executable_code\":null,\"function_response\":null,\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"2 950.-\\\",\\n \\\"interpretation\\\": \\\"2950\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"13 August 1945\\\",\\n \\\"interpretation\\\": \\\"1945-08-13\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\"}],\"role\":\"model\"},\"citation_metadata\":null,\"finish_message\":null,\"token_count\":null,\"finish_reason\":\"STOP\",\"url_context_metadata\":null,\"avg_logprobs\":null,\"grounding_metadata\":null,\"index\":0,\"logprobs_result\":null,\"safety_ratings\":null}],\"create_time\":null,\"model_version\":\"gemini-3-flash-preview\",\"prompt_feedback\":null,\"response_id\":\"zhGKac7nIZ-wkdUP-r6qgAM\",\"usage_metadata\":{\"cache_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":688},{\"modality\":\"IMAGE\",\"token_count\":613}],\"cached_content_token_count\":1301,\"candidates_token_count\":301,\"candidates_tokens_details\":null,\"prompt_token_count\":2317,\"prompt_tokens_details\":[{\"modality\":\"IMAGE\",\"token_count\":1092},{\"modality\":\"TEXT\",\"token_count\":1225}],\"thoughts_token_count\":584,\"tool_use_prompt_token_count\":null,\"tool_use_prompt_tokens_details\":null,\"total_token_count\":3202,\"traffic_type\":null},\"automatic_function_calling_history\":[],\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2 950.-\",\"interpretation\":\"2950\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"13 August 1945\",\"interpretation\":\"1945-08-13\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}"}, "scoring": {"f1_micro": 0.9534516765285996, "f1_macro": 0.8950819672131147, "micro_precision": 0.9471003134796239, "micro_recall": 0.9598888006354249, "total_instances": 61, "total_tp": 2417, "total_fp": 135, "total_fn": 101, "cost_summary": {"total_input_tokens": 141043, "total_output_tokens": 47847, "total_tokens": 188890, "input_cost_usd": 0.07052150000000004, "output_cost_usd": 0.143541, "total_cost_usd": 0.2140625}}, "normalized_score": 95.34516765285997}, {"_id": {"$oid": "69d4eb12b877594bc5718c3a"}, "test_id": "T0592", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "genai", "model": "gemini-2.5-pro", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"K\u00fcchenchef\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\u2713\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"18. November 46\",\"interpretation\":\"1946-11-18\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gemini-2.5-pro", "provider": "genai", "finish_reason": "STOP", "usage": {"input_tokens": 1483, "output_tokens": 871, "total_tokens": 4048, "input_cost_usd": 0.00185375, "output_cost_usd": 0.00871, "estimated_cost_usd": 0.01056375}, "duration": 20.649426460266113, "timestamp": "2026-02-09T17:13:20.766729", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "K\u00fcchenchef", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\u2713", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "18. November 46", "interpretation": "1946-11-18", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1948", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "fbbb6ac5-06d5-4a30-bedb-db92a674b426", "score": {"f1_score": 0.96, "precision": 0.9428571428571428, "recall": 0.9705882352941176, "true_positives": 33, "false_positives": 2, "false_negatives": 1, "field_scores": {"rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": "1. Jan. 1947", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4680", "score": 0.75}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-11-18", "ground_truth": "1946-11-18", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.600.-", "ground_truth": "4.600.-", "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1948", "ground_truth": "1. Jan. 1948", "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "\u2713", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "18. November 46", "ground_truth": "18. November 46", "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4600", "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4600", "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": "1948-01-01", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.600.-", "ground_truth": "4.600.-", "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "K\u00fcchenchef", "ground_truth": "K\u00fcchenchef", "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.600.-", "ground_truth": "4.600.-", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}}, "total_fields": 57}, "raw_response": "{\"sdk_http_response\":{\"headers\":{\"content-type\":\"application/json; charset=UTF-8\",\"vary\":\"Origin, X-Origin, Referer\",\"content-encoding\":\"gzip\",\"date\":\"Mon, 09 Feb 2026 16:13:14 GMT\",\"server\":\"scaffolding on HTTPServer2\",\"x-xss-protection\":\"0\",\"x-frame-options\":\"SAMEORIGIN\",\"x-content-type-options\":\"nosniff\",\"server-timing\":\"gfet4t7; dur=20503\",\"alt-svc\":\"h3=\\\":443\\\"; ma=2592000,h3-29=\\\":443\\\"; ma=2592000\",\"transfer-encoding\":\"chunked\"},\"body\":null},\"candidates\":[{\"content\":{\"parts\":[{\"video_metadata\":null,\"thought\":null,\"inline_data\":null,\"file_data\":null,\"thought_signature\":null,\"function_call\":null,\"code_execution_result\":null,\"executable_code\":null,\"function_response\":null,\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"K\u00fcchenchef\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\u2713\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.600.-\\\",\\n \\\"interpretation\\\": \\\"4600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"18. November 46\\\",\\n \\\"interpretation\\\": \\\"1946-11-18\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.600.-\\\",\\n \\\"interpretation\\\": \\\"4600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1947\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.600.-\\\",\\n \\\"interpretation\\\": \\\"4600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1948\\\",\\n \\\"interpretation\\\": \\\"1948-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\"}],\"role\":\"model\"},\"citation_metadata\":null,\"finish_message\":null,\"token_count\":null,\"finish_reason\":\"STOP\",\"url_context_metadata\":null,\"avg_logprobs\":null,\"grounding_metadata\":null,\"index\":0,\"logprobs_result\":null,\"safety_ratings\":null}],\"create_time\":null,\"model_version\":\"gemini-2.5-pro\",\"prompt_feedback\":null,\"response_id\":\"mgeKaeSbLKrinsEP_NOa8QM\",\"usage_metadata\":{\"cache_tokens_details\":null,\"cached_content_token_count\":null,\"candidates_token_count\":871,\"candidates_tokens_details\":null,\"prompt_token_count\":1483,\"prompt_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":1225},{\"modality\":\"IMAGE\",\"token_count\":258}],\"thoughts_token_count\":1694,\"tool_use_prompt_token_count\":null,\"tool_use_prompt_tokens_details\":null,\"total_token_count\":4048,\"traffic_type\":null},\"automatic_function_calling_history\":[],\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"K\u00fcchenchef\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\u2713\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"18. November 46\",\"interpretation\":\"1946-11-18\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}"}, "scoring": {"f1_micro": 0.9495947815773869, "f1_macro": 0.8988524590163934, "micro_precision": 0.9452971271153089, "micro_recall": 0.9539316918189039, "total_instances": 61, "total_tp": 2402, "total_fp": 139, "total_fn": 116, "cost_summary": {"total_input_tokens": 90463, "total_output_tokens": 56919, "total_tokens": 147382, "input_cost_usd": 0.11307875000000006, "output_cost_usd": 0.5691900000000003, "total_cost_usd": 0.6822687500000001}}, "normalized_score": 94.95947815773869}, {"_id": {"$oid": "69d4eb12b877594bc5718c3b"}, "test_id": "T0590", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "genai", "model": "gemini-2.5-flash-lite-preview-09-2025", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3100.-\",\"interpretation\":\"3100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. M\u00e4rz\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ Zulagen\",\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3225.-\",\"interpretation\":\"3225\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan.\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ Zulagen\",\"is_crossed_out\":false}}]}", "model": "gemini-2.5-flash-lite-preview-09-2025", "provider": "genai", "finish_reason": "STOP", "usage": {"input_tokens": 1483, "output_tokens": 562, "total_tokens": 2046, "input_cost_usd": 0.0001483, "output_cost_usd": 0.00022480000000000002, "estimated_cost_usd": 0.0003731}, "duration": 1.5980606079101562, "timestamp": "2026-02-09T16:52:11.888731", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3100.-", "interpretation": "3100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. M\u00e4rz", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": "+ Zulagen", "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3225.-", "interpretation": "3225", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan.", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": "+ Zulagen", "is_crossed_out": false}}]}, "conversation_id": "16e26cbd-e71e-424a-bc1d-06274d9c0f05", "score": {"f1_score": 0.79, "precision": 0.76, "recall": 0.8260869565217391, "true_positives": 19, "false_positives": 6, "false_negatives": 4, "field_scores": {"rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1946-03-01", "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3100.-", "ground_truth": "3100.-", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3225.-", "ground_truth": "3225.-", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. M\u00e4rz", "ground_truth": "1. M\u00e4rz 1946", "score": 0.736842105263158}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan.", "ground_truth": "1. Jan. 1947", "score": 0.736842105263158}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": "+ Zulagen", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": "+ Zulagen", "ground_truth": null, "score": 0.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3225", "ground_truth": "3225", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3100", "ground_truth": "3100", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1947-01-01", "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 38}, "raw_response": "{\"sdk_http_response\":{\"headers\":{\"content-type\":\"application/json; charset=UTF-8\",\"vary\":\"Origin, X-Origin, Referer\",\"content-encoding\":\"gzip\",\"date\":\"Mon, 09 Feb 2026 15:52:05 GMT\",\"server\":\"scaffolding on HTTPServer2\",\"x-xss-protection\":\"0\",\"x-frame-options\":\"SAMEORIGIN\",\"x-content-type-options\":\"nosniff\",\"server-timing\":\"gfet4t7; dur=1484\",\"alt-svc\":\"h3=\\\":443\\\"; ma=2592000,h3-29=\\\":443\\\"; ma=2592000\",\"transfer-encoding\":\"chunked\"},\"body\":null},\"candidates\":[{\"content\":{\"parts\":[{\"video_metadata\":null,\"thought\":null,\"inline_data\":null,\"file_data\":null,\"thought_signature\":null,\"function_call\":null,\"code_execution_result\":null,\"executable_code\":null,\"function_response\":null,\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3100.-\\\",\\n \\\"interpretation\\\": \\\"3100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. M\u00e4rz\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": \\\"+ Zulagen\\\",\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3225.-\\\",\\n \\\"interpretation\\\": \\\"3225\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan.\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": \\\"+ Zulagen\\\",\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\"}],\"role\":\"model\"},\"citation_metadata\":null,\"finish_message\":null,\"token_count\":null,\"finish_reason\":\"STOP\",\"url_context_metadata\":null,\"avg_logprobs\":null,\"grounding_metadata\":null,\"index\":0,\"logprobs_result\":null,\"safety_ratings\":null}],\"create_time\":null,\"model_version\":\"gemini-2.5-flash-lite-preview-09-2025\",\"prompt_feedback\":null,\"response_id\":\"pQKKad7tMJ_u7M8P5NeUIA\",\"usage_metadata\":{\"cache_tokens_details\":null,\"cached_content_token_count\":null,\"candidates_token_count\":562,\"candidates_tokens_details\":null,\"prompt_token_count\":1483,\"prompt_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":1225},{\"modality\":\"IMAGE\",\"token_count\":258}],\"thoughts_token_count\":1,\"tool_use_prompt_token_count\":null,\"tool_use_prompt_tokens_details\":null,\"total_token_count\":2046,\"traffic_type\":null},\"automatic_function_calling_history\":[],\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3100.-\",\"interpretation\":\"3100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. M\u00e4rz\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ Zulagen\",\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3225.-\",\"interpretation\":\"3225\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan.\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ Zulagen\",\"is_crossed_out\":false}}]}}"}, "scoring": {"f1_micro": 0.8736624741880984, "f1_macro": 0.8283606557377049, "micro_precision": 0.8284086863652546, "micro_recall": 0.9241461477362987, "total_instances": 61, "total_tp": 2327, "total_fp": 482, "total_fn": 191, "cost_summary": {"total_input_tokens": 90463, "total_output_tokens": 61746, "total_tokens": 152209, "input_cost_usd": 0.009046299999999997, "output_cost_usd": 0.024698399999999992, "total_cost_usd": 0.0337447}}, "normalized_score": 87.36624741880983}, {"_id": {"$oid": "69d4eb12b877594bc5718c3c"}, "test_id": "T0617", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openrouter", "model": "qwen/qwen3-vl-30b-a3b-instruct", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4400.-\",\"interpretation\":\"4400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Febr. 46\",\"interpretation\":\"1946-02-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\u2021 Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 46\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.780.-\",\"interpretation\":\"4780\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 47\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "qwen/qwen3-vl-30b-a3b-instruct", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 4082, "output_tokens": 671, "total_tokens": 4753, "cached_tokens": 1196}, "duration": 14.05350923538208, "timestamp": "2026-02-09T16:46:27.427709", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4400.-", "interpretation": "4400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Febr. 46", "interpretation": "1946-02-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "\u2021 Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 46", "interpretation": "1946-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.780.-", "interpretation": "4780", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 47", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "0091abab-864d-47d2-88c9-585657a78cc0", "score": {"f1_score": 0.97, "precision": 0.9705882352941176, "recall": 0.9705882352941176, "true_positives": 33, "false_positives": 1, "false_negatives": 1, "field_scores": {"rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-07-01", "ground_truth": "1946-07-01", "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4400.-", "ground_truth": "4400.-", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4400", "ground_truth": "4400", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 47", "ground_truth": "1. Jan. 47", "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "\u2021 Zulagen", "ground_truth": "+ Zulagen", "score": 0.8888888888888888}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4600", "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.780.-", "ground_truth": "4.780.-", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.600.-", "ground_truth": "4.600.-", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 46", "ground_truth": "1. Juli 46", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Febr. 46", "ground_truth": "1. Febr. 46", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4780", "ground_truth": "4780", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-02-01", "ground_truth": "1946-02-01", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 57}, "raw_response": "{\"id\":\"gen-1770651967-0dp2qhVvLmmG6wbqVTH2\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\": [{\\\"row_number\\\": 1, \\\"dienstliche_stellung\\\": {\\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}, \\\"dienstort\\\": {\\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}, \\\"gehaltsklasse\\\": {\\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}, \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\\"diplomatic_transcript\\\": \\\"4400.-\\\", \\\"interpretation\\\": \\\"4400\\\", \\\"is_crossed_out\\\": false}, \\\"datum_gehalts\u00e4nderung\\\": {\\\"diplomatic_transcript\\\": \\\"1. Febr. 46\\\", \\\"interpretation\\\": \\\"1946-02-01\\\", \\\"is_crossed_out\\\": false}, \\\"bemerkungen\\\": {\\\"diplomatic_transcript\\\": \\\"\u2021 Zulagen\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}}, {\\\"row_number\\\": 2, \\\"dienstliche_stellung\\\": {\\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}, \\\"dienstort\\\": {\\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}, \\\"gehaltsklasse\\\": {\\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}, \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\\"diplomatic_transcript\\\": \\\"4.600.-\\\", \\\"interpretation\\\": \\\"4600\\\", \\\"is_crossed_out\\\": false}, \\\"datum_gehalts\u00e4nderung\\\": {\\\"diplomatic_transcript\\\": \\\"1. Juli 46\\\", \\\"interpretation\\\": \\\"1946-07-01\\\", \\\"is_crossed_out\\\": false}, \\\"bemerkungen\\\": {\\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}}, {\\\"row_number\\\": 3, \\\"dienstliche_stellung\\\": {\\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}, \\\"dienstort\\\": {\\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}, \\\"gehaltsklasse\\\": {\\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}, \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\\"diplomatic_transcript\\\": \\\"4.780.-\\\", \\\"interpretation\\\": \\\"4780\\\", \\\"is_crossed_out\\\": false}, \\\"datum_gehalts\u00e4nderung\\\": {\\\"diplomatic_transcript\\\": \\\"1. Jan. 47\\\", \\\"interpretation\\\": \\\"1947-01-01\\\", \\\"is_crossed_out\\\": false}, \\\"bemerkungen\\\": {\\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4400.-\",\"interpretation\":\"4400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Febr. 46\",\"interpretation\":\"1946-02-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\u2021 Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 46\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.780.-\",\"interpretation\":\"4780\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 47\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]},\"reasoning\":null},\"native_finish_reason\":\"stop\"}],\"created\":1770651967,\"model\":\"qwen/qwen3-vl-30b-a3b-instruct\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":671,\"prompt_tokens\":4082,\"total_tokens\":4753,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":null},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1196},\"cost\":0.0009252,\"is_byok\":false,\"cost_details\":{\"upstream_inference_cost\":0.0009252,\"upstream_inference_prompt_cost\":0.0005226,\"upstream_inference_completions_cost\":0.0004026}},\"provider\":\"Fireworks\"}"}, "scoring": {"f1_micro": 0.9261374827654126, "f1_macro": 0.8949180327868852, "micro_precision": 0.9187182493161391, "micro_recall": 0.9336775218427323, "total_instances": 61, "total_tp": 2351, "total_fp": 208, "total_fn": 167, "cost_summary": {"total_input_tokens": 249546, "total_output_tokens": 47665, "total_tokens": 297211, "input_cost_usd": 0.0, "output_cost_usd": 0.0, "total_cost_usd": 0.0}}, "normalized_score": 92.61374827654126}, {"_id": {"$oid": "69d4eb12b877594bc5718c3d"}, "test_id": "T0606", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-4.1-mini", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Techn. Hilfsleiter\",\"interpretation\":\"Technischer Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'160.-\",\"interpretation\":\"3160\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.6. Aug. 1943\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. 400.- techn. z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Techn. Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":\"Techn. Hilfsleiter\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'220.-\",\"interpretation\":\"3220\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. 400.- techn. z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Techn. Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":\"Techn. Hilfsleiter\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'490.-\",\"interpretation\":\"3490\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1944\",\"interpretation\":\"1944-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. 400.- techn. z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Techn. Leiter\",\"interpretation\":\"Technischer Leiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'090.-\",\"interpretation\":\"4090\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Aug. 1944\",\"interpretation\":\"1944-08-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. 400.- techn. z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Techn. Leiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"20. Okt. 1944\",\"interpretation\":\"1944-10-20\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"1/2 Haushaltungszul.\",\"interpretation\":\"Halbe Haushaltungszulage\",\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Techn. Leiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5'500.-\",\"interpretation\":\"5500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Techn. Leiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5'720.-\",\"interpretation\":\"5720\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"?\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":8,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. 10 47\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Fr. 1.60 pro Monat\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gpt-4.1-mini-2025-04-14", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 4582, "output_tokens": 1419, "total_tokens": 6001, "cached_tokens": 1792, "input_cost_usd": 0.0018328, "output_cost_usd": 0.0022704, "estimated_cost_usd": 0.0041032}, "duration": 27.6235568523407, "timestamp": "2026-02-09T23:48:12.411256", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Techn. Hilfsleiter", "interpretation": "Technischer Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'160.-", "interpretation": "3160", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1.6. Aug. 1943", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.- techn. z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn. Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": "Techn. Hilfsleiter", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'220.-", "interpretation": "3220", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1.1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.- techn. z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn. Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": "Techn. Hilfsleiter", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'490.-", "interpretation": "3490", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1944", "interpretation": "1944-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.- techn. z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Techn. Leiter", "interpretation": "Technischer Leiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'090.-", "interpretation": "4090", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Aug. 1944", "interpretation": "1944-08-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl. 400.- techn. z.", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn. Leiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "20. Okt. 1944", "interpretation": "1944-10-20", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "1/2 Haushaltungszul.", "interpretation": "Halbe Haushaltungszulage", "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn. Leiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5'500.-", "interpretation": "5500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Techn. Leiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5'720.-", "interpretation": "5720", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "?", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 8, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. 10 47", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Fr. 1.60 pro Monat", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "63bf49fe-2856-4701-821b-30bf45df7615", "score": {"f1_score": 0.87, "precision": 0.8673469387755102, "recall": 0.8762886597938144, "true_positives": 85, "false_positives": 13, "false_negatives": 12, "field_scores": {"rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": "Technischer Hilfsleiter", "ground_truth": "Technischer Hilfsleiter", "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.- techn. z.", "ground_truth": "inkl. 400.-techn.Z .", "score": 0.926829268292683}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": "inklusive 400.- technische Zulage", "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1.6. Aug. 1943", "ground_truth": "16. Aug. 1943", "score": 0.962962962962963}, "rows[4].bemerkungen.interpretation": {"response": "Halbe Haushaltungszulage", "ground_truth": "1/2 Haushaltungszulage", "score": 0.826086956521739}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'220.-", "ground_truth": "3'220.-", "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1.1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 0.923076923076923}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'090.-", "ground_truth": "4'090.-", "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.- techn. z.", "ground_truth": "inkl. 400.-techn.Z .", "score": 0.926829268292683}, "rows[2].dienstliche_stellung.interpretation": {"response": "Techn. Hilfsleiter", "ground_truth": "Technischer Hilfsleiter", "score": 0.8292682926829268}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4090", "ground_truth": "4090", "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.- techn. z.", "ground_truth": "inkl. 400.- techn.Z.", "score": 0.926829268292683}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].bemerkungen.diplomatic_transcript": {"response": "+ Fr. 1.60 pro Monat", "ground_truth": "+ Fr. 60.- pro Monat", "score": 0.9}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3490", "ground_truth": "3490", "score": 1.0}, "rows[2].dienstort.interpretation": {"response": "Techn. Hilfsleiter", "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Techn. Hilfsleiter", "ground_truth": "Technischer Hilfsleiter", "score": 0.8292682926829268}, "rows[6].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-07-01", "ground_truth": "1944-07-01", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Aug. 1944", "ground_truth": "1. Aug. 1944", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "inkl. 400.- techn. z.", "ground_truth": "inkl. 400.- techn.Z.", "score": 0.926829268292683}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5720", "ground_truth": "5720", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3220", "ground_truth": "3220", "score": 1.0}, "rows[7].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5'720.-", "ground_truth": "5'720.-", "score": 1.0}, "rows[7].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1944", "ground_truth": "1. Juli 1944", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-10-20", "ground_truth": "1944-10-20", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": "inklusive 400.- technische Zulage", "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": "Technischer Leiter", "ground_truth": "Technischer Leiter", "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[7].bemerkungen.interpretation": {"response": null, "ground_truth": "plus 60 pro Monat", "score": 0.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": "inklusive 400.- technische Zulage", "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-08-01", "ground_truth": "1944-08-01", "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": "Techn. Hilfsleiter", "ground_truth": null, "score": 0.0}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Techn. Hilfsleiter", "ground_truth": "Techn. Hilfsleiter", "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1943-08-16", "score": 0.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstliche_stellung.interpretation": {"response": "Techn. Leiter", "ground_truth": null, "score": 0.0}, "rows[7].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5'500.-", "ground_truth": "5.500.-", "score": 0.8571428571428572}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3160", "ground_truth": "3160", "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "1/2 Haushaltungszul.", "ground_truth": "1/2 Haushaltungszul.", "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. 10 47", "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.interpretation": {"response": "Techn. Leiter", "ground_truth": null, "score": 0.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'490.-", "ground_truth": "3'490.-", "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[7].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5500", "ground_truth": "5500", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": "inklusive 400.- technische Zulage", "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "20. Okt. 1944", "ground_truth": "20. Okt. 1944", "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Techn. Leiter", "ground_truth": "Techn. Leiter", "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "?", "ground_truth": "?", "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": "Techn. Leiter", "ground_truth": "Technischer Leiter", "score": 0.7741935483870968}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'160.-", "ground_truth": "3'160.-", "score": 1.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}}, "total_fields": 152}, "raw_response": "{\"id\":\"chatcmpl-D7UKg7MechvHuKwUf9W6P7I31NVUh\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Techn. Hilfsleiter\\\",\\\"interpretation\\\":\\\"Technischer Hilfsleiter\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3'160.-\\\",\\\"interpretation\\\":\\\"3160\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1.6. Aug. 1943\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"inkl. 400.- techn. z.\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Techn. Hilfsleiter\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":\\\"Techn. Hilfsleiter\\\",\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3'220.-\\\",\\\"interpretation\\\":\\\"3220\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1.1. Jan. 1944\\\",\\\"interpretation\\\":\\\"1944-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"inkl. 400.- techn. z.\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":3,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Techn. Hilfsleiter\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":\\\"Techn. Hilfsleiter\\\",\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3'490.-\\\",\\\"interpretation\\\":\\\"3490\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Juli 1944\\\",\\\"interpretation\\\":\\\"1944-07-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"inkl. 400.- techn. z.\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":4,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Techn. Leiter\\\",\\\"interpretation\\\":\\\"Technischer Leiter\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4'090.-\\\",\\\"interpretation\\\":\\\"4090\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Aug. 1944\\\",\\\"interpretation\\\":\\\"1944-08-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"inkl. 400.- techn. z.\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":5,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Techn. Leiter\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"20. Okt. 1944\\\",\\\"interpretation\\\":\\\"1944-10-20\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"1/2 Haushaltungszul.\\\",\\\"interpretation\\\":\\\"Halbe Haushaltungszulage\\\",\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":6,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Techn. Leiter\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"5'500.-\\\",\\\"interpretation\\\":\\\"5500\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Januar 1945\\\",\\\"interpretation\\\":\\\"1945-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":7,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Techn. Leiter\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"5'720.-\\\",\\\"interpretation\\\":\\\"5720\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"?\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":8,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. 10 47\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Fr. 1.60 pro Monat\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Techn. Hilfsleiter\",\"interpretation\":\"Technischer Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'160.-\",\"interpretation\":\"3160\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.6. Aug. 1943\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. 400.- techn. z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Techn. Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":\"Techn. Hilfsleiter\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'220.-\",\"interpretation\":\"3220\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. 400.- techn. z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Techn. Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":\"Techn. Hilfsleiter\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'490.-\",\"interpretation\":\"3490\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1944\",\"interpretation\":\"1944-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. 400.- techn. z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Techn. Leiter\",\"interpretation\":\"Technischer Leiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'090.-\",\"interpretation\":\"4090\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Aug. 1944\",\"interpretation\":\"1944-08-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl. 400.- techn. z.\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Techn. Leiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"20. Okt. 1944\",\"interpretation\":\"1944-10-20\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"1/2 Haushaltungszul.\",\"interpretation\":\"Halbe Haushaltungszulage\",\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Techn. Leiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5'500.-\",\"interpretation\":\"5500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Techn. Leiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5'720.-\",\"interpretation\":\"5720\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"?\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":8,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. 10 47\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Fr. 1.60 pro Monat\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1770677266,\"model\":\"gpt-4.1-mini-2025-04-14\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":\"fp_75546bd1a7\",\"usage\":{\"completion_tokens\":1419,\"prompt_tokens\":4582,\"total_tokens\":6001,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1792}}}"}, "scoring": {"f1_micro": 0.873056994818653, "f1_macro": 0.8254098360655738, "micro_precision": 0.8362282878411911, "micro_recall": 0.9132791327913279, "total_instances": 61, "total_tp": 2359, "total_fp": 462, "total_fn": 224, "cost_summary": {"total_input_tokens": 281677, "total_output_tokens": 37385, "total_tokens": 319062, "input_cost_usd": 0.11267079999999992, "output_cost_usd": 0.05981599999999998, "total_cost_usd": 0.17248679999999994}}, "normalized_score": 87.30569948186529}, {"_id": {"$oid": "69d4eb12b877594bc5718c3e"}, "test_id": "T0587", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "genai", "model": "gemini-2.0-flash-lite", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Okt. 1943\",\"interpretation\":\"1943-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'438.-\",\"interpretation\":\"2438\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2708.-\",\"interpretation\":\"2708\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1944\",\"interpretation\":\"1944-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4,500.-\",\"interpretation\":\"4500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. februrar 1945\",\"interpretation\":\"1945-02-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen /\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.720.-\",\"interpretation\":\"4720\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.020.-\",\"interpretation\":\"5020\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. April 1946\",\"interpretation\":\"1946-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.094.-\",\"interpretation\":\"5094\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":8,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.314.-\",\"interpretation\":\"5314\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gemini-2.0-flash-lite", "provider": "genai", "finish_reason": "STOP", "usage": {"input_tokens": 3626, "output_tokens": 2302, "total_tokens": 5928, "input_cost_usd": 0.00027194999999999997, "output_cost_usd": 0.0006905999999999999, "estimated_cost_usd": 0.0009625499999999998}, "duration": 13.544314622879028, "timestamp": "2026-02-09T16:35:55.532572", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'400.-", "interpretation": "2400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Okt. 1943", "interpretation": "1943-10-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'438.-", "interpretation": "2438", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2708.-", "interpretation": "2708", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1944", "interpretation": "1944-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Lagerleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4,500.-", "interpretation": "4500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. februrar 1945", "interpretation": "1945-02-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen /", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.720.-", "interpretation": "4720", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.020.-", "interpretation": "5020", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. April 1946", "interpretation": "1946-04-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.094.-", "interpretation": "5094", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 8, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.314.-", "interpretation": "5314", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1948", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "09ba204c-8022-4cb0-932a-6bde7586144d", "score": {"f1_score": 0.97, "precision": 0.967032967032967, "recall": 0.967032967032967, "true_positives": 88, "false_positives": 3, "false_negatives": 3, "field_scores": {"rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2400", "ground_truth": "2400", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'438.-", "ground_truth": "2'438.-", "score": 1.0}, "rows[7].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Lagerleiterin", "ground_truth": "Lagerleiterin", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.720.-", "ground_truth": "4.720.-", "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4500", "ground_truth": "4500", "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": "1. Jan. 1946", "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1946-01-01", "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.314.-", "ground_truth": "5.314.-", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-02-01", "ground_truth": "1945-02-01", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.020.-", "ground_truth": "5.020.-", "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": "1. Jan. 1947", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-07-01", "ground_truth": "1944-07-01", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'400.-", "ground_truth": "2'400.-", "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4720", "ground_truth": "4720", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. februrar 1945", "ground_truth": "1.Februar 1945", "score": 0.8666666666666667}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2708.-", "ground_truth": "2708.-", "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-10-01", "ground_truth": "1943-10-01", "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1944", "ground_truth": "1. Juli 1944", "score": 1.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen /", "ground_truth": "+ Zulagen", "score": 0.9}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5020", "ground_truth": "5020", "score": 1.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Okt. 1943", "ground_truth": "1. Okt. 1943", "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.094.-", "ground_truth": "5.094.-", "score": 1.0}, "rows[7].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": "1948-01-01", "score": 1.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. April 1946", "ground_truth": "1. April 1946", "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5094", "ground_truth": "5094", "score": 1.0}, "rows[7].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-04-01", "ground_truth": "1946-04-01", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2438", "ground_truth": "2438", "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2708", "ground_truth": "2708", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1948", "ground_truth": "1. Jan. 1948", "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4,500.-", "ground_truth": "4,500.-", "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5314", "ground_truth": "5134", "score": 0.75}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 152}, "raw_response": "{\"sdk_http_response\":{\"headers\":{\"content-type\":\"application/json; charset=UTF-8\",\"vary\":\"Origin, X-Origin, Referer\",\"content-encoding\":\"gzip\",\"date\":\"Mon, 09 Feb 2026 15:35:49 GMT\",\"server\":\"scaffolding on HTTPServer2\",\"x-xss-protection\":\"0\",\"x-frame-options\":\"SAMEORIGIN\",\"x-content-type-options\":\"nosniff\",\"server-timing\":\"gfet4t7; dur=13393\",\"alt-svc\":\"h3=\\\":443\\\"; ma=2592000,h3-29=\\\":443\\\"; ma=2592000\",\"transfer-encoding\":\"chunked\"},\"body\":null},\"candidates\":[{\"content\":{\"parts\":[{\"video_metadata\":null,\"thought\":null,\"inline_data\":null,\"file_data\":null,\"thought_signature\":null,\"function_call\":null,\"code_execution_result\":null,\"executable_code\":null,\"function_response\":null,\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"2'400.-\\\",\\n \\\"interpretation\\\": \\\"2400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Okt. 1943\\\",\\n \\\"interpretation\\\": \\\"1943-10-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"2'438.-\\\",\\n \\\"interpretation\\\": \\\"2438\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"2708.-\\\",\\n \\\"interpretation\\\": \\\"2708\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1944\\\",\\n \\\"interpretation\\\": \\\"1944-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Lagerleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4,500.-\\\",\\n \\\"interpretation\\\": \\\"4500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. februrar 1945\\\",\\n \\\"interpretation\\\": \\\"1945-02-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen /\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.720.-\\\",\\n \\\"interpretation\\\": \\\"4720\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 6,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.020.-\\\",\\n \\\"interpretation\\\": \\\"5020\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. April 1946\\\",\\n \\\"interpretation\\\": \\\"1946-04-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 7,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.094.-\\\",\\n \\\"interpretation\\\": \\\"5094\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1947\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 8,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.314.-\\\",\\n \\\"interpretation\\\": \\\"5314\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1948\\\",\\n \\\"interpretation\\\": \\\"1948-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\"}],\"role\":\"model\"},\"citation_metadata\":null,\"finish_message\":null,\"token_count\":null,\"finish_reason\":\"STOP\",\"url_context_metadata\":null,\"avg_logprobs\":-0.0005804667982404694,\"grounding_metadata\":null,\"index\":null,\"logprobs_result\":null,\"safety_ratings\":null}],\"create_time\":null,\"model_version\":\"gemini-2.0-flash-lite\",\"prompt_feedback\":null,\"response_id\":\"yP6JaY66GviK7M8P19vcqQ8\",\"usage_metadata\":{\"cache_tokens_details\":null,\"cached_content_token_count\":null,\"candidates_token_count\":2302,\"candidates_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":2302}],\"prompt_token_count\":3626,\"prompt_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":1820},{\"modality\":\"IMAGE\",\"token_count\":1806}],\"thoughts_token_count\":null,\"tool_use_prompt_token_count\":null,\"tool_use_prompt_tokens_details\":null,\"total_token_count\":5928,\"traffic_type\":null},\"automatic_function_calling_history\":[],\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Okt. 1943\",\"interpretation\":\"1943-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'438.-\",\"interpretation\":\"2438\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2708.-\",\"interpretation\":\"2708\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1944\",\"interpretation\":\"1944-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4,500.-\",\"interpretation\":\"4500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. februrar 1945\",\"interpretation\":\"1945-02-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen /\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.720.-\",\"interpretation\":\"4720\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.020.-\",\"interpretation\":\"5020\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. April 1946\",\"interpretation\":\"1946-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.094.-\",\"interpretation\":\"5094\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":8,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.314.-\",\"interpretation\":\"5314\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}"}, "scoring": {"f1_micro": 0.8934639216470118, "f1_macro": 0.8357377049180328, "micro_precision": 0.8993963782696177, "micro_recall": 0.8876092136616363, "total_instances": 61, "total_tp": 2235, "total_fp": 250, "total_fn": 283, "cost_summary": {"total_input_tokens": 221186, "total_output_tokens": 68118, "total_tokens": 289304, "input_cost_usd": 0.016588949999999998, "output_cost_usd": 0.020435400000000006, "total_cost_usd": 0.037024350000000004}}, "normalized_score": 89.34639216470119}, {"_id": {"$oid": "69d4eb12b877594bc5718c3f"}, "test_id": "T0598", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "mistral", "model": "ministral-8b-2512", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Assistent\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Assistent\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. April 1947\",\"interpretation\":\"1947-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Versetzung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5.094.-\",\"interpretation\":\"5094\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5.094.-\",\"interpretation\":\"5094\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1950\",\"interpretation\":\"1950-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Versetzung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5.400.-\",\"interpretation\":\"5400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1952\",\"interpretation\":\"1952-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Gehaltserh\u00f6hung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 6.300.-\",\"interpretation\":\"6300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1955\",\"interpretation\":\"1955-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Gehaltserh\u00f6hung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 6.300.-\",\"interpretation\":\"6300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Pensionierung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":8,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":9,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Sekret\u00e4r\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 4.500.-\",\"interpretation\":\"4500\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1956\",\"interpretation\":\"1956-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Neuanstellung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":10,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Sekret\u00e4r\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 4.800.-\",\"interpretation\":\"4800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1958\",\"interpretation\":\"1958-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Gehaltserh\u00f6hung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":11,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Sekret\u00e4r\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5.100.-\",\"interpretation\":\"5100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1960\",\"interpretation\":\"1960-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Gehaltserh\u00f6hung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":12,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Sekret\u00e4r\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5.400.-\",\"interpretation\":\"5400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1962\",\"interpretation\":\"1962-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Gehaltserh\u00f6hung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":13,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Sekret\u00e4r\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5.700.-\",\"interpretation\":\"5700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1965\",\"interpretation\":\"1965-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Gehaltserh\u00f6hung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":14,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Sekret\u00e4r\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 6.000.-\",\"interpretation\":\"6000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1968\",\"interpretation\":\"1968-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Gehaltserh\u00f6hung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":15,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Sekret\u00e4r\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 6.300.-\",\"interpretation\":\"6300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1970\",\"interpretation\":\"1970-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Gehaltserh\u00f6hung\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "ministral-8b-2512", "provider": "mistral", "finish_reason": "stop", "usage": {"input_tokens": 1810, "output_tokens": 4225, "total_tokens": 6035, "input_cost_usd": 0.0002715, "output_cost_usd": 0.0006337499999999999, "estimated_cost_usd": 0.0009052499999999998}, "duration": 76.1306300163269, "timestamp": "2026-02-09T18:36:27.983578", "parsed": {"$schema": "http://json-schema.org/draft-07/schema#", "rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Assistent", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'400.-", "interpretation": "2400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "Assistent", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. April 1947", "interpretation": "1947-04-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Versetzung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5.094.-", "interpretation": "5094", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1948", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5.094.-", "interpretation": "5094", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1950", "interpretation": "1950-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Versetzung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5.400.-", "interpretation": "5400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1952", "interpretation": "1952-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Gehaltserh\u00f6hung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 6.300.-", "interpretation": "6300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1955", "interpretation": "1955-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Gehaltserh\u00f6hung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 6.300.-", "interpretation": "6300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Pensionierung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 8, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 9, "dienstliche_stellung": {"diplomatic_transcript": "Sekret\u00e4r", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 4.500.-", "interpretation": "4500", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1956", "interpretation": "1956-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Neuanstellung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 10, "dienstliche_stellung": {"diplomatic_transcript": "Sekret\u00e4r", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 4.800.-", "interpretation": "4800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1958", "interpretation": "1958-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Gehaltserh\u00f6hung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 11, "dienstliche_stellung": {"diplomatic_transcript": "Sekret\u00e4r", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5.100.-", "interpretation": "5100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1960", "interpretation": "1960-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Gehaltserh\u00f6hung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 12, "dienstliche_stellung": {"diplomatic_transcript": "Sekret\u00e4r", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5.400.-", "interpretation": "5400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1962", "interpretation": "1962-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Gehaltserh\u00f6hung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 13, "dienstliche_stellung": {"diplomatic_transcript": "Sekret\u00e4r", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5.700.-", "interpretation": "5700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1965", "interpretation": "1965-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Gehaltserh\u00f6hung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 14, "dienstliche_stellung": {"diplomatic_transcript": "Sekret\u00e4r", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 6.000.-", "interpretation": "6000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1968", "interpretation": "1968-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Gehaltserh\u00f6hung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 15, "dienstliche_stellung": {"diplomatic_transcript": "Sekret\u00e4r", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 6.300.-", "interpretation": "6300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1970", "interpretation": "1970-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Gehaltserh\u00f6hung", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "ed31b2b8-06b2-475e-a158-85c85c927046", "score": {"f1_score": 0.15, "precision": 0.08653846153846154, "recall": 0.5294117647058824, "true_positives": 18, "false_positives": 190, "false_negatives": 16, "field_scores": {"rows[13].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'400.-", "ground_truth": "4600.-", "score": 0.5882352941176471}, "rows[8].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[12].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1948", "ground_truth": "1. Januar 1947", "score": 0.7692307692307692}, "rows[11].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5.094.-", "ground_truth": "4945.-", "score": 0.4705882352941176}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[9].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 6.300.-", "ground_truth": null, "score": 0.0}, "rows[9].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[12].datum_gehalts\u00e4nderung.interpretation": {"response": "1965-01-01", "ground_truth": null, "score": 0.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[12].dienstliche_stellung.diplomatic_transcript": {"response": "Sekret\u00e4r", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[9].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 4.800.-", "ground_truth": null, "score": 0.0}, "rows[8].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1956", "ground_truth": null, "score": 0.0}, "rows[7].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[14].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[13].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[9].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2400", "ground_truth": "4600", "score": 0.75}, "rows[10].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[13].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].dienstliche_stellung.diplomatic_transcript": {"response": "Sekret\u00e4r", "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5.400.-", "ground_truth": null, "score": 0.0}, "rows[6].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1945-12-01", "score": 0.8}, "rows[14].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1970", "ground_truth": null, "score": 0.0}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "Gehaltserh\u00f6hung", "ground_truth": null, "score": 0.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": "Pensionierung", "ground_truth": null, "score": 0.0}, "$schema": {"response": "http://json-schema.org/draft-07/schema#", "ground_truth": null, "score": 0.0}, "rows[10].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "Versetzung", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5094", "ground_truth": null, "score": 0.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6300", "ground_truth": null, "score": 0.0}, "rows[13].datum_gehalts\u00e4nderung.interpretation": {"response": "1968-01-01", "ground_truth": null, "score": 0.0}, "rows[10].dienstliche_stellung.diplomatic_transcript": {"response": "Sekret\u00e4r", "ground_truth": null, "score": 0.0}, "rows[11].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[13].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].bemerkungen.diplomatic_transcript": {"response": "Gehaltserh\u00f6hung", "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[9].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4800", "ground_truth": null, "score": 0.0}, "rows[11].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1955", "ground_truth": null, "score": 0.0}, "rows[8].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 6.300.-", "ground_truth": null, "score": 0.0}, "rows[10].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": "1947-01-01", "score": 0.9}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 6.300.-", "ground_truth": null, "score": 0.0}, "rows[11].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[13].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[12].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-04-01", "ground_truth": "1946-01-01", "score": 0.8}, "rows[14].dienstliche_stellung.diplomatic_transcript": {"response": "Sekret\u00e4r", "ground_truth": null, "score": 0.0}, "rows[11].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5.094.-", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1955-01-01", "ground_truth": null, "score": 0.0}, "rows[9].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[13].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1968", "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[13].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[12].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[7].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[10].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "Versetzung", "ground_truth": "+ Zulagen", "score": 0.21052631578947367}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[13].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5.400.-", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].bemerkungen.diplomatic_transcript": {"response": "Neuanstellung", "ground_truth": null, "score": 0.0}, "rows[8].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[9].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1958", "ground_truth": null, "score": 0.0}, "rows[9].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "Assistent", "ground_truth": null, "score": 0.0}, "rows[13].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6000", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": "1. Dez. 45", "score": 0.5454545454545454}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'700.-", "ground_truth": "4765.-", "score": 0.3529411764705882}, "rows[9].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. April 1947", "ground_truth": "1. Januar 1946", "score": 0.5925925925925926}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1952", "ground_truth": null, "score": 0.0}, "rows[6].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "Gehaltserh\u00f6hung", "ground_truth": null, "score": 0.0}, "rows[8].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[13].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[12].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1965", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[13].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[13].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[14].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[13].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 6.000.-", "ground_truth": null, "score": 0.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].dienstliche_stellung.diplomatic_transcript": {"response": "Sekret\u00e4r", "ground_truth": null, "score": 0.0}, "rows[10].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1952-01-01", "ground_truth": null, "score": 0.0}, "rows[14].bemerkungen.diplomatic_transcript": {"response": "Gehaltserh\u00f6hung", "ground_truth": null, "score": 0.0}, "rows[13].bemerkungen.diplomatic_transcript": {"response": "Gehaltserh\u00f6hung", "ground_truth": null, "score": 0.0}, "rows[9].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[14].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Assistent", "ground_truth": "Hilfsleiter", "score": 0.4}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": null, "score": 0.0}, "rows[6].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6300", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[10].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[10].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[14].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[12].bemerkungen.diplomatic_transcript": {"response": "Gehaltserh\u00f6hung", "ground_truth": null, "score": 0.0}, "rows[10].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5.100.-", "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[8].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[14].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[11].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[13].dienstliche_stellung.diplomatic_transcript": {"response": "Sekret\u00e4r", "ground_truth": null, "score": 0.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[12].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[5].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[10].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[13].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[14].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].datum_gehalts\u00e4nderung.interpretation": {"response": "1956-01-01", "ground_truth": null, "score": 0.0}, "rows[14].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[13].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].datum_gehalts\u00e4nderung.interpretation": {"response": "1958-01-01", "ground_truth": null, "score": 0.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[11].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5400", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1950-07-01", "ground_truth": null, "score": 0.0}, "rows[7].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4500", "ground_truth": null, "score": 0.0}, "rows[11].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[11].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5400", "ground_truth": null, "score": 0.0}, "rows[14].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[11].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[14].datum_gehalts\u00e4nderung.interpretation": {"response": "1970-01-01", "ground_truth": null, "score": 0.0}, "rows[10].datum_gehalts\u00e4nderung.interpretation": {"response": "1960-01-01", "ground_truth": null, "score": 0.0}, "rows[12].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[10].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1960", "ground_truth": null, "score": 0.0}, "rows[11].datum_gehalts\u00e4nderung.interpretation": {"response": "1962-01-01", "ground_truth": null, "score": 0.0}, "rows[14].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6300", "ground_truth": null, "score": 0.0}, "rows[6].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[11].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1962", "ground_truth": null, "score": 0.0}, "rows[14].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": null, "score": 0.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": "4765", "score": 0.25}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[12].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": null, "score": 0.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 4.500.-", "ground_truth": null, "score": 0.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5.700.-", "ground_truth": null, "score": 0.0}, "rows[12].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5700", "ground_truth": null, "score": 0.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5094", "ground_truth": "4945", "score": 0.5}, "rows[10].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5100", "ground_truth": null, "score": 0.0}, "rows[9].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].dienstliche_stellung.diplomatic_transcript": {"response": "Sekret\u00e4r", "ground_truth": null, "score": 0.0}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1950", "ground_truth": null, "score": 0.0}, "rows[9].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[11].bemerkungen.diplomatic_transcript": {"response": "Gehaltserh\u00f6hung", "ground_truth": null, "score": 0.0}, "rows[9].bemerkungen.diplomatic_transcript": {"response": "Gehaltserh\u00f6hung", "ground_truth": null, "score": 0.0}, "rows[14].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[10].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}}, "total_fields": 286}, "raw_response": "{\"id\":\"4cab042ea30942129e6e1e5fc0d2bf33\",\"object\":\"chat.completion\",\"model\":\"ministral-8b-2512\",\"usage\":{\"prompt_tokens\":1810,\"completion_tokens\":4225,\"total_tokens\":6035,\"num_cached_tokens\":0},\"created\":1770658506,\"choices\":[{\"index\":0,\"message\":{\"content\":\"{\\n \\\"$schema\\\": \\\"http://json-schema.org/draft-07/schema#\\\",\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Assistent\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'400.-\\\",\\n \\\"interpretation\\\": \\\"2400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Assistent\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. April 1947\\\",\\n \\\"interpretation\\\": \\\"1947-04-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Versetzung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5.094.-\\\",\\n \\\"interpretation\\\": \\\"5094\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1948\\\",\\n \\\"interpretation\\\": \\\"1948-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5.094.-\\\",\\n \\\"interpretation\\\": \\\"5094\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1950\\\",\\n \\\"interpretation\\\": \\\"1950-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Versetzung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5.400.-\\\",\\n \\\"interpretation\\\": \\\"5400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1952\\\",\\n \\\"interpretation\\\": \\\"1952-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Gehaltserh\u00f6hung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 6,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 6.300.-\\\",\\n \\\"interpretation\\\": \\\"6300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1955\\\",\\n \\\"interpretation\\\": \\\"1955-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Gehaltserh\u00f6hung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 7,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 6.300.-\\\",\\n \\\"interpretation\\\": \\\"6300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Pensionierung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 8,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 9,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Sekret\u00e4r\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 4.500.-\\\",\\n \\\"interpretation\\\": \\\"4500\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1956\\\",\\n \\\"interpretation\\\": \\\"1956-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Neuanstellung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 10,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Sekret\u00e4r\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 4.800.-\\\",\\n \\\"interpretation\\\": \\\"4800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1958\\\",\\n \\\"interpretation\\\": \\\"1958-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Gehaltserh\u00f6hung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 11,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Sekret\u00e4r\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5.100.-\\\",\\n \\\"interpretation\\\": \\\"5100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1960\\\",\\n \\\"interpretation\\\": \\\"1960-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Gehaltserh\u00f6hung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 12,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Sekret\u00e4r\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5.400.-\\\",\\n \\\"interpretation\\\": \\\"5400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1962\\\",\\n \\\"interpretation\\\": \\\"1962-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Gehaltserh\u00f6hung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 13,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Sekret\u00e4r\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5.700.-\\\",\\n \\\"interpretation\\\": \\\"5700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1965\\\",\\n \\\"interpretation\\\": \\\"1965-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Gehaltserh\u00f6hung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 14,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Sekret\u00e4r\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 6.000.-\\\",\\n \\\"interpretation\\\": \\\"6000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1968\\\",\\n \\\"interpretation\\\": \\\"1968-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Gehaltserh\u00f6hung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 15,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Sekret\u00e4r\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 6.300.-\\\",\\n \\\"interpretation\\\": \\\"6300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1970\\\",\\n \\\"interpretation\\\": \\\"1970-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Gehaltserh\u00f6hung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"tool_calls\":null,\"prefix\":false,\"role\":\"assistant\"},\"finish_reason\":\"stop\"}]}"}, "scoring": {"f1_micro": 0.1259625163446172, "f1_macro": 0.11049180327868853, "micro_precision": 0.07708036984352774, "micro_recall": 0.3443208895949166, "total_instances": 61, "total_tp": 867, "total_fp": 10381, "total_fn": 1651, "cost_summary": {"total_input_tokens": 110410, "total_output_tokens": 223464, "total_tokens": 333874, "input_cost_usd": 0.01656149999999998, "output_cost_usd": 0.0335196, "total_cost_usd": 0.0500811}}, "normalized_score": 12.59625163446172}, {"_id": {"$oid": "69d4eb12b877594bc5718c40"}, "test_id": "T0576", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "anthropic", "model": "claude-haiku-4-5-20251001", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"G\u00e4rtnerin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"190.--\",\"interpretation\":\"190\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"15. Okt. 1942\",\"interpretation\":\"1942-10-15\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Teuerungszulage\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'280.--\",\"interpretation\":\"2280\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1943\",\"interpretation\":\"1943-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'280.-\",\"interpretation\":\"2280\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"200.-\",\"interpretation\":\"200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. M\u00e4rz 1944\",\"interpretation\":\"1944-03-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'800.--\",\"interpretation\":\"2800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. August 1944\",\"interpretation\":\"1944-08-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.140.--\",\"interpretation\":\"4140\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juni 1945\",\"interpretation\":\"1945-06-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "claude-haiku-4-5-20251001", "provider": "anthropic", "finish_reason": "tool_use", "usage": {"input_tokens": 4027, "output_tokens": 2006, "total_tokens": 6033, "input_cost_usd": 0.004027, "output_cost_usd": 0.01003, "estimated_cost_usd": 0.014057}, "duration": 9.450099229812622, "timestamp": "2026-02-09T16:26:27.002124", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "G\u00e4rtnerin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "190.--", "interpretation": "190", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "15. Okt. 1942", "interpretation": "1942-10-15", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Teuerungszulage", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "G\u00e4rtnerin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'280.--", "interpretation": "2280", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1943", "interpretation": "1943-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "G\u00e4rtnerin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'280.-", "interpretation": "2280", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "G\u00e4rtnerin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "200.-", "interpretation": "200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. M\u00e4rz 1944", "interpretation": "1944-03-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'800.--", "interpretation": "2800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. August 1944", "interpretation": "1944-08-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.140.--", "interpretation": "4140", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "Lagerleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juni 1945", "interpretation": "1945-06-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "5a1ad5c4-ec27-42f8-bfb6-a75c35fcb720", "score": {"f1_score": 1.0, "precision": 1.0, "recall": 1.0, "true_positives": 84, "false_positives": 0, "false_negatives": 0, "field_scores": {"rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-06-01", "ground_truth": "1945-06-01", "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.140.--", "ground_truth": "4.140.--", "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'800.--", "ground_truth": "2'800.--", "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-03-01", "ground_truth": "1944-03-01", "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2280", "ground_truth": "2280", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2800", "ground_truth": "2800", "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.600.-", "ground_truth": "4.600.-", "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 1.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": "Lagerleiterin", "ground_truth": "Lagerleiterin", "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-01-01", "ground_truth": "1943-01-01", "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Teuerungszulage", "ground_truth": "+ Teuerungszulage", "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'280.-", "ground_truth": "2'280.-", "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-08-01", "ground_truth": "1944-08-01", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "200", "ground_truth": "200", "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2280", "ground_truth": "2280", "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "190", "ground_truth": "190", "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "190.--", "ground_truth": "190.--", "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1943", "ground_truth": "1. Jan. 1943", "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4140", "ground_truth": "4140", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. M\u00e4rz 1944", "ground_truth": "1. M\u00e4rz 1944", "score": 1.0}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1942-10-15", "ground_truth": "1942-10-15", "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4600", "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. August 1944", "ground_truth": "1. August 1944", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'280.--", "ground_truth": "2'280.--", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juni 1945", "ground_truth": "1. Juni 1945", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "15. Okt. 1942", "ground_truth": "15. Okt. 1942", "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "200.-", "ground_truth": "200.-", "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 133}, "raw_response": "{\"id\":\"msg_01RbuCaU1ThkeT6ga8Si41fA\",\"content\":[{\"id\":\"toolu_01QP4C1VWRB7MQaXCCgGNdY9\",\"input\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"G\u00e4rtnerin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"190.--\",\"interpretation\":\"190\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"15. Okt. 1942\",\"interpretation\":\"1942-10-15\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Teuerungszulage\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'280.--\",\"interpretation\":\"2280\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1943\",\"interpretation\":\"1943-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'280.-\",\"interpretation\":\"2280\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"200.-\",\"interpretation\":\"200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. M\u00e4rz 1944\",\"interpretation\":\"1944-03-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'800.--\",\"interpretation\":\"2800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. August 1944\",\"interpretation\":\"1944-08-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.140.--\",\"interpretation\":\"4140\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juni 1945\",\"interpretation\":\"1945-06-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]},\"name\":\"extract_structured_data\",\"type\":\"tool_use\"}],\"model\":\"claude-haiku-4-5-20251001\",\"role\":\"assistant\",\"stop_reason\":\"tool_use\",\"stop_sequence\":null,\"type\":\"message\",\"usage\":{\"cache_creation\":{\"ephemeral_1h_input_tokens\":0,\"ephemeral_5m_input_tokens\":0},\"cache_creation_input_tokens\":0,\"cache_read_input_tokens\":0,\"input_tokens\":4027,\"output_tokens\":2006,\"server_tool_use\":null,\"service_tier\":\"standard\",\"inference_geo\":\"not_available\"}}"}, "scoring": {"f1_micro": 0.8543405676126877, "f1_macro": 0.8372131147540983, "micro_precision": 0.9001759014951627, "micro_recall": 0.812946783161239, "total_instances": 61, "total_tp": 2047, "total_fp": 227, "total_fn": 471, "cost_summary": {"total_input_tokens": 245626, "total_output_tokens": 59080, "total_tokens": 304706, "input_cost_usd": 0.24562600000000007, "output_cost_usd": 0.2954, "total_cost_usd": 0.5410259999999998}}, "normalized_score": 85.43405676126878}, {"_id": {"$oid": "69d4eb12b877594bc5718c41"}, "test_id": "T0607", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-4.1-nano", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ allowances\",\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ allowances\",\"is_crossed_out\":false}}]}", "model": "gpt-4.1-nano-2025-04-14", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 5932, "output_tokens": 319, "total_tokens": 6251, "cached_tokens": 1792, "input_cost_usd": 0.0005932, "output_cost_usd": 0.0001276, "estimated_cost_usd": 0.0007208}, "duration": 4.412214517593384, "timestamp": "2026-02-10T00:01:19.559046", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": "+ allowances", "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": "+ allowances", "is_crossed_out": false}}]}, "conversation_id": "b3c67ef6-a934-40ec-8028-918d8fb3e4c7", "score": {"f1_score": 0.76, "precision": 0.85, "recall": 0.68, "true_positives": 17, "false_positives": 3, "false_negatives": 8, "field_scores": {"rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1944-02-17", "score": 0.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": "+ allowances", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": null, "ground_truth": "17. Febr. 44", "score": 0.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": "2000", "score": 0.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": "3.315.-", "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": null, "ground_truth": "1. Jamar 1945", "score": 0.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": null, "ground_truth": "3315", "score": 0.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": "+ allowances", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": null, "ground_truth": "1945-01-01", "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": null, "ground_truth": "2000.-", "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 38}, "raw_response": "{\"id\":\"chatcmpl-D7UXks73WWjiw6KvcdApmF59cfWnJ\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiterin\\\",\\\"interpretation\\\":\\\"Hilfsleiterin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":\\\"+ allowances\\\",\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiterin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":\\\"+ allowances\\\",\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ allowances\",\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":\"+ allowances\",\"is_crossed_out\":false}}]}}}],\"created\":1770678076,\"model\":\"gpt-4.1-nano-2025-04-14\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":\"fp_70fc5e01a5\",\"usage\":{\"completion_tokens\":319,\"prompt_tokens\":5932,\"total_tokens\":6251,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1792}}}"}, "scoring": {"f1_micro": 0.7106256206554121, "f1_macro": 0.7001639344262295, "micro_precision": 0.7296084828711256, "micro_recall": 0.6926054974835463, "total_instances": 61, "total_tp": 1789, "total_fp": 663, "total_fn": 794, "cost_summary": {"total_input_tokens": 358231, "total_output_tokens": 34182, "total_tokens": 392413, "input_cost_usd": 0.03582309999999999, "output_cost_usd": 0.013672800000000006, "total_cost_usd": 0.04949590000000001}}, "normalized_score": 71.06256206554121}, {"_id": {"$oid": "69d4eb12b877594bc5718c42"}, "test_id": "T0597", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "mistral", "model": "ministral-14b-2512", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Assistentin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Sekret\u00e4rin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'000.-\",\"interpretation\":\"3000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. April 1947\",\"interpretation\":\"1947-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Provisorisch\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"B\u00fcroleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Genf\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"15. Juni 1950\",\"interpretation\":\"1950-06-15\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Abteilungsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"VI\",\"interpretation\":\"6\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5'094.-\",\"interpretation\":\"5094\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1955\",\"interpretation\":\"1955-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Neue Stelle\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"~Hilfsleiterin~\",\"interpretation\":null,\"is_crossed_out\":true},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'100.-\",\"interpretation\":\"2100\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Oktober 1948\",\"interpretation\":\"1948-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Tempor\u00e4r\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"~Sekret\u00e4rin~\",\"interpretation\":null,\"is_crossed_out\":true},\"dienstort\":{\"diplomatic_transcript\":\"~Genf~\",\"interpretation\":null,\"is_crossed_out\":true},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'700.-\",\"interpretation\":\"2700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. M\u00e4rz 1949\",\"interpretation\":\"1949-03-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"B\u00fcroleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Genf\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'400.-\",\"interpretation\":\"3400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1951\",\"interpretation\":\"1951-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Gehaltserh\u00f6hung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":8,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"B\u00fcroleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Genf\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1953\",\"interpretation\":\"1953-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Tarifliche Anpassung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":9,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"~\\\"~\",\"interpretation\":null,\"is_crossed_out\":true},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Genf\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 4'200.-\",\"interpretation\":\"4200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Oktober 1954\",\"interpretation\":\"1954-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Leistungszulage\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":10,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"~\\\"~\",\"interpretation\":null,\"is_crossed_out\":true},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"VI\",\"interpretation\":\"6\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5'094.-\",\"interpretation\":\"5094\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1955\",\"interpretation\":\"1955-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Stellenwechsel\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":11,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Abteilungsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Bern\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"VI\",\"interpretation\":\"6\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5'600.-\",\"interpretation\":\"5600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1957\",\"interpretation\":\"1957-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Gehaltsanpassung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":12,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Abteilungsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Bern\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"6\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 6'300.-\",\"interpretation\":\"6300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1958\",\"interpretation\":\"1958-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Erh\u00f6hung aufgrund Erfahrung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":13,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"~\\\"~\",\"interpretation\":null,\"is_crossed_out\":true},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"VII\",\"interpretation\":\"7\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 7'200.-\",\"interpretation\":\"7200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1960\",\"interpretation\":\"1960-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Bef\u00f6rderung\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "ministral-14b-2512", "provider": "mistral", "finish_reason": "stop", "usage": {"input_tokens": 1810, "output_tokens": 4403, "total_tokens": 6213, "input_cost_usd": 0.000362, "output_cost_usd": 0.0008806, "estimated_cost_usd": 0.0012426}, "duration": 33.22454786300659, "timestamp": "2026-02-09T17:50:56.285860", "parsed": {"$schema": "http://json-schema.org/draft-07/schema#", "$defs": {"FieldValue": {"description": "Represents a single field value with transcript and interpretation.", "properties": {"diplomatic_transcript": {"description": "Exact text as written on the card, including abbreviations", "title": "Diplomatic Transcript", "type": "string"}, "interpretation": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "description": "Interpretation or expansion of abbreviations and meanings", "title": "Interpretation"}, "is_crossed_out": {"default": false, "description": "Whether the text has been crossed out on the card", "title": "Is Crossed Out", "type": "boolean"}}, "required": ["diplomatic_transcript"], "title": "FieldValue", "type": "object"}, "TableRow": {"description": "Represents a single row in the personnel card table.", "properties": {"row_number": {"description": "Sequential row number from top to bottom", "title": "Row Number", "type": "integer"}, "dienstliche_stellung": {"$ref": "#/$defs/FieldValue", "description": "Official position/job title"}, "dienstort": {"$ref": "#/$defs/FieldValue", "description": "Place of service/work location"}, "gehaltsklasse": {"$ref": "#/$defs/FieldValue", "description": "Salary class/grade"}, "jahresgehalt_monatsgehalt_taglohn": {"$ref": "#/$defs/FieldValue", "description": "Annual salary, monthly salary, or daily wage"}, "datum_gehalts\u00e4nderung": {"$ref": "#/$defs/FieldValue", "description": "Date of salary change (day, month, year)"}, "bemerkungen": {"$ref": "#/$defs/FieldValue", "description": "Remarks, notes, or additional information"}}, "required": ["row_number", "dienstliche_stellung", "dienstort", "gehaltsklasse", "jahresgehalt_monatsgehalt_taglohn", "datum_gehalts\u00e4nderung", "bemerkungen"], "title": "TableRow", "type": "object"}}, "description": "Main output structure for Personnel Cards.", "properties": {"rows": {"description": "List of all rows in the personnel card table", "items": {"$ref": "#/$defs/TableRow"}, "title": "Rows", "type": "array"}}, "title": "Table", "type": "object", "rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Assistentin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'400.-", "interpretation": "2400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "Sekret\u00e4rin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'000.-", "interpretation": "3000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. April 1947", "interpretation": "1947-04-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Provisorisch", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "B\u00fcroleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Genf", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": "5", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "15. Juni 1950", "interpretation": "1950-06-15", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "Abteilungsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "VI", "interpretation": "6", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5'094.-", "interpretation": "5094", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1955", "interpretation": "1955-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Neue Stelle", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "~Hilfsleiterin~", "interpretation": null, "is_crossed_out": true}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'100.-", "interpretation": "2100", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Oktober 1948", "interpretation": "1948-10-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Tempor\u00e4r", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "~Sekret\u00e4rin~", "interpretation": null, "is_crossed_out": true}, "dienstort": {"diplomatic_transcript": "~Genf~", "interpretation": null, "is_crossed_out": true}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'700.-", "interpretation": "2700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. M\u00e4rz 1949", "interpretation": "1949-03-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "B\u00fcroleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Genf", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": "5", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'400.-", "interpretation": "3400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1951", "interpretation": "1951-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Gehaltserh\u00f6hung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 8, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "B\u00fcroleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Genf", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "5", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1953", "interpretation": "1953-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Tarifliche Anpassung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 9, "dienstliche_stellung": {"diplomatic_transcript": "~\"~", "interpretation": null, "is_crossed_out": true}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Genf", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "5", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 4'200.-", "interpretation": "4200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Oktober 1954", "interpretation": "1954-10-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Leistungszulage", "interpretation": null, "is_crossed_out": false}}, {"row_number": 10, "dienstliche_stellung": {"diplomatic_transcript": "~\"~", "interpretation": null, "is_crossed_out": true}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "VI", "interpretation": "6", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5'094.-", "interpretation": "5094", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1955", "interpretation": "1955-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Stellenwechsel", "interpretation": null, "is_crossed_out": false}}, {"row_number": 11, "dienstliche_stellung": {"diplomatic_transcript": "Abteilungsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Bern", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "VI", "interpretation": "6", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5'600.-", "interpretation": "5600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1957", "interpretation": "1957-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Gehaltsanpassung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 12, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Abteilungsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Bern", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "6", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 6'300.-", "interpretation": "6300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1958", "interpretation": "1958-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Erh\u00f6hung aufgrund Erfahrung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 13, "dienstliche_stellung": {"diplomatic_transcript": "~\"~", "interpretation": null, "is_crossed_out": true}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "VII", "interpretation": "7", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 7'200.-", "interpretation": "7200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1960", "interpretation": "1960-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Bef\u00f6rderung", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "5ba595aa-5b16-41ba-814d-e79c4cb30548", "score": {"f1_score": 0.13, "precision": 0.07346938775510205, "recall": 0.5, "true_positives": 18, "false_positives": 227, "false_negatives": 18, "field_scores": {"rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'400.-", "ground_truth": "2'100.-", "score": 0.6666666666666667}, "rows[8].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[12].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "15. Juni 1950", "ground_truth": "1.Januar 1945", "score": 0.6153846153846154}, "rows[11].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'700.-", "ground_truth": "3.478.-", "score": 0.4444444444444444}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "$defs.TableRow.required[3]": {"response": "gehaltsklasse", "ground_truth": null, "score": 0.0}, "rows[9].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[5].dienstort.is_crossed_out": {"response": true, "ground_truth": null, "score": 0.0}, "rows[9].gehaltsklasse.interpretation": {"response": "6", "ground_truth": null, "score": 0.0}, "rows[12].datum_gehalts\u00e4nderung.interpretation": {"response": "1960-01-01", "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.jahresgehalt_monatsgehalt_taglohn.description": {"response": "Annual salary, monthly salary, or daily wage", "ground_truth": null, "score": 0.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "~Sekret\u00e4rin~", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.row_number.type": {"response": "integer", "ground_truth": null, "score": 0.0}, "properties.rows.type": {"response": "array", "ground_truth": null, "score": 0.0}, "rows[12].dienstliche_stellung.diplomatic_transcript": {"response": "~\"~", "ground_truth": null, "score": 0.0}, "title": {"response": "Table", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "$defs.TableRow.type": {"response": "object", "ground_truth": null, "score": 0.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[9].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5'094.-", "ground_truth": null, "score": 0.0}, "rows[8].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Oktober 1954", "ground_truth": null, "score": 0.0}, "rows[7].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "$defs.FieldValue.properties.interpretation.description": {"response": "Interpretation or expansion of abbreviations and meanings", "ground_truth": null, "score": 0.0}, "rows[7].bemerkungen.diplomatic_transcript": {"response": "Tarifliche Anpassung", "ground_truth": null, "score": 0.0}, "rows[9].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "$defs.TableRow.description": {"response": "Represents a single row in the personnel card table.", "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2400", "ground_truth": "2100", "score": 0.75}, "rows[10].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": true, "ground_truth": null, "score": 0.0}, "rows[11].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 6'300.-", "ground_truth": null, "score": 0.0}, "rows[6].dienstliche_stellung.interpretation": {"response": "B\u00fcroleiterin", "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1943-02-09", "score": 0.7}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.dienstliche_stellung.description": {"response": "Official position/job title", "ground_truth": null, "score": 0.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "$defs.FieldValue.properties.interpretation.anyOf[0].type": {"response": "string", "ground_truth": null, "score": 0.0}, "rows[11].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "$defs.FieldValue.properties.is_crossed_out.title": {"response": "Is Crossed Out", "ground_truth": null, "score": 0.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": "Gehaltserh\u00f6hung", "ground_truth": null, "score": 0.0}, "$defs.TableRow.required[1]": {"response": "dienstliche_stellung", "ground_truth": null, "score": 0.0}, "$schema": {"response": "http://json-schema.org/draft-07/schema#", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.properties.is_crossed_out.description": {"response": "Whether the text has been crossed out on the card", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "Neue Stelle", "ground_truth": null, "score": 0.0}, "rows[10].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "$defs.TableRow.required[6]": {"response": "bemerkungen", "ground_truth": null, "score": 0.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": "1951-07-01", "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5094", "ground_truth": null, "score": 0.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2700", "ground_truth": null, "score": 0.0}, "rows[7].dienstort.interpretation": {"response": "Genf", "ground_truth": null, "score": 0.0}, "rows[10].dienstliche_stellung.diplomatic_transcript": {"response": "Abteilungsleiterin", "ground_truth": null, "score": 0.0}, "rows[11].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].bemerkungen.diplomatic_transcript": {"response": "Gehaltsanpassung", "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Arbeitslehrerin", "score": 0.0}, "rows[9].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5094", "ground_truth": null, "score": 0.0}, "rows[11].gehaltsklasse.interpretation": {"response": "6", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. M\u00e4rz 1949", "ground_truth": null, "score": 0.0}, "rows[8].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'400.-", "ground_truth": null, "score": 0.0}, "rows[10].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1950-06-15", "ground_truth": "1945-01-01", "score": 0.7}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'700.-", "ground_truth": null, "score": 0.0}, "rows[11].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[12].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-04-01", "ground_truth": "1944-01-01", "score": 0.8}, "properties.rows.title": {"response": "Rows", "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5'094.-", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.required[0]": {"response": "diplomatic_transcript", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1949-03-01", "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[9].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.row_number.description": {"response": "Sequential row number from top to bottom", "ground_truth": null, "score": 0.0}, "rows[12].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": "Genf", "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.gehaltsklasse.$ref": {"response": "#/$defs/FieldValue", "ground_truth": null, "score": 0.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].dienstliche_stellung.interpretation": {"response": "B\u00fcroleiterin", "ground_truth": null, "score": 0.0}, "rows[10].gehaltsklasse.interpretation": {"response": "6", "ground_truth": null, "score": 0.0}, "rows[5].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[10].gehaltsklasse.diplomatic_transcript": {"response": "VI", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "Provisorisch", "ground_truth": null, "score": 0.0}, "rows[3].gehaltsklasse.interpretation": {"response": "6", "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.interpretation": {"response": "5", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.properties.interpretation.default": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'100.-", "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.dienstliche_stellung.$ref": {"response": "#/$defs/FieldValue", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].bemerkungen.diplomatic_transcript": {"response": "Leistungszulage", "ground_truth": null, "score": 0.0}, "rows[8].dienstliche_stellung.is_crossed_out": {"response": true, "ground_truth": null, "score": 0.0}, "$defs.TableRow.required[5]": {"response": "datum_gehalts\u00e4nderung", "ground_truth": null, "score": 0.0}, "rows[10].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.properties.is_crossed_out.type": {"response": "boolean", "ground_truth": null, "score": 0.0}, "rows[9].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.datum_gehalts\u00e4nderung.description": {"response": "Date of salary change (day, month, year)", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.properties.diplomatic_transcript.description": {"response": "Exact text as written on the card, including abbreviations", "ground_truth": null, "score": 0.0}, "rows[9].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[9].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1955", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "Sekret\u00e4rin", "ground_truth": "\"", "score": 0.0}, "$defs.TableRow.properties.bemerkungen.$ref": {"response": "#/$defs/FieldValue", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": "9. Feb. 1943", "score": 0.5833333333333333}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'000.-", "ground_truth": "2'225.-", "score": 0.33333333333333337}, "rows[9].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. April 1947", "ground_truth": "1. Jan. 1944", "score": 0.56}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].gehaltsklasse.interpretation": {"response": "5", "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "Abteilungsleiterin", "ground_truth": null, "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[11].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Oktober 1948", "ground_truth": null, "score": 0.0}, "rows[6].dienstort.interpretation": {"response": "Genf", "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].dienstliche_stellung.is_crossed_out": {"response": true, "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": "Tempor\u00e4r", "ground_truth": null, "score": 0.0}, "rows[8].dienstort.interpretation": {"response": "Genf", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.properties.interpretation.anyOf[1].type": {"response": "null", "ground_truth": null, "score": 0.0}, "rows[12].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[12].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1960", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Arbeitslehrerin", "score": 0.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.interpretation": {"response": "5", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.properties.interpretation.title": {"response": "Interpretation", "ground_truth": null, "score": 0.0}, "rows[12].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": true, "ground_truth": null, "score": 0.0}, "rows[8].dienstliche_stellung.diplomatic_transcript": {"response": "~\"~", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.properties.diplomatic_transcript.type": {"response": "string", "ground_truth": null, "score": 0.0}, "rows[10].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-10-01", "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.bemerkungen.description": {"response": "Remarks, notes, or additional information", "ground_truth": null, "score": 0.0}, "rows[9].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "$defs.TableRow.required[4]": {"response": "jahresgehalt_monatsgehalt_taglohn", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.properties.diplomatic_transcript.title": {"response": "Diplomatic Transcript", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Assistentin", "ground_truth": "Arbeitslehrerin", "score": 0.4615384615384615}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.interpretation": {"response": "5", "ground_truth": null, "score": 0.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3400", "ground_truth": null, "score": 0.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'700.-", "ground_truth": null, "score": 0.0}, "rows[10].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[4].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "type": {"response": "object", "ground_truth": null, "score": 0.0}, "rows[10].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5'600.-", "ground_truth": null, "score": 0.0}, "rows[12].bemerkungen.diplomatic_transcript": {"response": "Bef\u00f6rderung", "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[8].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": "~Hilfsleiterin~", "ground_truth": null, "score": 0.0}, "rows[11].dienstort.interpretation": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "B\u00fcroleiterin", "ground_truth": "\"", "score": 0.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].dienstliche_stellung.is_crossed_out": {"response": true, "ground_truth": null, "score": 0.0}, "rows[12].gehaltsklasse.interpretation": {"response": "7", "ground_truth": null, "score": 0.0}, "rows[5].dienstort.diplomatic_transcript": {"response": "~Genf~", "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.interpretation": {"response": "1953-01-01", "ground_truth": null, "score": 0.0}, "rows[10].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "$defs.TableRow.title": {"response": "TableRow", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "description": {"response": "Main output structure for Personnel Cards.", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[8].datum_gehalts\u00e4nderung.interpretation": {"response": "1954-10-01", "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.jahresgehalt_monatsgehalt_taglohn.$ref": {"response": "#/$defs/FieldValue", "ground_truth": null, "score": 0.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "$defs.FieldValue.title": {"response": "FieldValue", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.type": {"response": "object", "ground_truth": null, "score": 0.0}, "rows[9].datum_gehalts\u00e4nderung.interpretation": {"response": "1955-01-01", "ground_truth": null, "score": 0.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[11].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "6300", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1955-01-01", "ground_truth": null, "score": 0.0}, "rows[7].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.diplomatic_transcript": {"response": "Bern", "ground_truth": null, "score": 0.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4200", "ground_truth": null, "score": 0.0}, "rows[11].dienstliche_stellung.interpretation": {"response": "Abteilungsleiterin", "ground_truth": null, "score": 0.0}, "rows[11].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2100", "ground_truth": null, "score": 0.0}, "rows[11].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[11].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.dienstort.description": {"response": "Place of service/work location", "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.datum_gehalts\u00e4nderung.$ref": {"response": "#/$defs/FieldValue", "ground_truth": null, "score": 0.0}, "rows[10].datum_gehalts\u00e4nderung.interpretation": {"response": "1957-01-01", "ground_truth": null, "score": 0.0}, "rows[12].gehaltsklasse.diplomatic_transcript": {"response": "VII", "ground_truth": null, "score": 0.0}, "rows[10].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1957", "ground_truth": null, "score": 0.0}, "rows[11].datum_gehalts\u00e4nderung.interpretation": {"response": "1958-07-01", "ground_truth": null, "score": 0.0}, "rows[6].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[11].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1958", "ground_truth": null, "score": 0.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].gehaltsklasse.diplomatic_transcript": {"response": "VI", "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1953", "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "$defs.FieldValue.description": {"response": "Represents a single field value with transcript and interpretation.", "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "VI", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3000", "ground_truth": "2225", "score": 0.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[12].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "$defs.TableRow.required[0]": {"response": "row_number", "ground_truth": null, "score": 0.0}, "properties.rows.description": {"response": "List of all rows in the personnel card table", "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": null, "score": 0.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 4'200.-", "ground_truth": null, "score": 0.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[12].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 7'200.-", "ground_truth": null, "score": 0.0}, "rows[12].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "7200", "ground_truth": null, "score": 0.0}, "$defs.FieldValue.properties.is_crossed_out.default": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": "3478", "score": 0.5}, "$defs.TableRow.properties.row_number.title": {"response": "Row Number", "ground_truth": null, "score": 0.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[10].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5600", "ground_truth": null, "score": 0.0}, "rows[9].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[9].dienstliche_stellung.diplomatic_transcript": {"response": "~\"~", "ground_truth": null, "score": 0.0}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1951", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1955", "ground_truth": null, "score": 0.0}, "rows[9].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.gehaltsklasse.description": {"response": "Salary class/grade", "ground_truth": null, "score": 0.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "properties.rows.items.$ref": {"response": "#/$defs/TableRow", "ground_truth": null, "score": 0.0}, "rows[11].bemerkungen.diplomatic_transcript": {"response": "Erh\u00f6hung aufgrund Erfahrung", "ground_truth": null, "score": 0.0}, "rows[9].bemerkungen.diplomatic_transcript": {"response": "Stellenwechsel", "ground_truth": null, "score": 0.0}, "$defs.TableRow.properties.dienstort.$ref": {"response": "#/$defs/FieldValue", "ground_truth": null, "score": 0.0}, "rows[10].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "$defs.TableRow.required[2]": {"response": "dienstort", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 296}, "raw_response": "{\"id\":\"8dca02d3d16f4feb83cfed9d978b7324\",\"object\":\"chat.completion\",\"model\":\"ministral-14b-2512\",\"usage\":{\"prompt_tokens\":1810,\"completion_tokens\":4403,\"total_tokens\":6213,\"num_cached_tokens\":1792},\"created\":1770655817,\"choices\":[{\"index\":0,\"message\":{\"content\":\"{\\n \\\"$schema\\\": \\\"http://json-schema.org/draft-07/schema#\\\",\\n \\\"$defs\\\": {\\n \\\"FieldValue\\\": {\\n \\\"description\\\": \\\"Represents a single field value with transcript and interpretation.\\\",\\n \\\"properties\\\": {\\n \\\"diplomatic_transcript\\\": {\\n \\\"description\\\": \\\"Exact text as written on the card, including abbreviations\\\",\\n \\\"title\\\": \\\"Diplomatic Transcript\\\",\\n \\\"type\\\": \\\"string\\\"\\n },\\n \\\"interpretation\\\": {\\n \\\"anyOf\\\": [\\n {\\\"type\\\": \\\"string\\\"},\\n {\\\"type\\\": \\\"null\\\"}\\n ],\\n \\\"default\\\": null,\\n \\\"description\\\": \\\"Interpretation or expansion of abbreviations and meanings\\\",\\n \\\"title\\\": \\\"Interpretation\\\"\\n },\\n \\\"is_crossed_out\\\": {\\n \\\"default\\\": false,\\n \\\"description\\\": \\\"Whether the text has been crossed out on the card\\\",\\n \\\"title\\\": \\\"Is Crossed Out\\\",\\n \\\"type\\\": \\\"boolean\\\"\\n }\\n },\\n \\\"required\\\": [\\\"diplomatic_transcript\\\"],\\n \\\"title\\\": \\\"FieldValue\\\",\\n \\\"type\\\": \\\"object\\\"\\n },\\n \\\"TableRow\\\": {\\n \\\"description\\\": \\\"Represents a single row in the personnel card table.\\\",\\n \\\"properties\\\": {\\n \\\"row_number\\\": {\\n \\\"description\\\": \\\"Sequential row number from top to bottom\\\",\\n \\\"title\\\": \\\"Row Number\\\",\\n \\\"type\\\": \\\"integer\\\"\\n },\\n \\\"dienstliche_stellung\\\": {\\n \\\"$ref\\\": \\\"#/$defs/FieldValue\\\",\\n \\\"description\\\": \\\"Official position/job title\\\"\\n },\\n \\\"dienstort\\\": {\\n \\\"$ref\\\": \\\"#/$defs/FieldValue\\\",\\n \\\"description\\\": \\\"Place of service/work location\\\"\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"$ref\\\": \\\"#/$defs/FieldValue\\\",\\n \\\"description\\\": \\\"Salary class/grade\\\"\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"$ref\\\": \\\"#/$defs/FieldValue\\\",\\n \\\"description\\\": \\\"Annual salary, monthly salary, or daily wage\\\"\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"$ref\\\": \\\"#/$defs/FieldValue\\\",\\n \\\"description\\\": \\\"Date of salary change (day, month, year)\\\"\\n },\\n \\\"bemerkungen\\\": {\\n \\\"$ref\\\": \\\"#/$defs/FieldValue\\\",\\n \\\"description\\\": \\\"Remarks, notes, or additional information\\\"\\n }\\n },\\n \\\"required\\\": [\\n \\\"row_number\\\",\\n \\\"dienstliche_stellung\\\",\\n \\\"dienstort\\\",\\n \\\"gehaltsklasse\\\",\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\",\\n \\\"datum_gehalts\u00e4nderung\\\",\\n \\\"bemerkungen\\\"\\n ],\\n \\\"title\\\": \\\"TableRow\\\",\\n \\\"type\\\": \\\"object\\\"\\n }\\n },\\n \\\"description\\\": \\\"Main output structure for Personnel Cards.\\\",\\n \\\"properties\\\": {\\n \\\"rows\\\": {\\n \\\"description\\\": \\\"List of all rows in the personnel card table\\\",\\n \\\"items\\\": {\\n \\\"$ref\\\": \\\"#/$defs/TableRow\\\"\\n },\\n \\\"title\\\": \\\"Rows\\\",\\n \\\"type\\\": \\\"array\\\"\\n }\\n },\\n \\\"title\\\": \\\"Table\\\",\\n \\\"type\\\": \\\"object\\\",\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Assistentin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'400.-\\\",\\n \\\"interpretation\\\": \\\"2400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Sekret\u00e4rin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'000.-\\\",\\n \\\"interpretation\\\": \\\"3000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. April 1947\\\",\\n \\\"interpretation\\\": \\\"1947-04-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Provisorisch\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"B\u00fcroleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Genf\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": \\\"5\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"15. Juni 1950\\\",\\n \\\"interpretation\\\": \\\"1950-06-15\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Abteilungsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"VI\\\",\\n \\\"interpretation\\\": \\\"6\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5'094.-\\\",\\n \\\"interpretation\\\": \\\"5094\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1955\\\",\\n \\\"interpretation\\\": \\\"1955-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Neue Stelle\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"~Hilfsleiterin~\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": true\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'100.-\\\",\\n \\\"interpretation\\\": \\\"2100\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Oktober 1948\\\",\\n \\\"interpretation\\\": \\\"1948-10-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Tempor\u00e4r\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 6,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"~Sekret\u00e4rin~\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": true\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"~Genf~\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": true\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'700.-\\\",\\n \\\"interpretation\\\": \\\"2700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. M\u00e4rz 1949\\\",\\n \\\"interpretation\\\": \\\"1949-03-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 7,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"B\u00fcroleiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Genf\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": \\\"5\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'400.-\\\",\\n \\\"interpretation\\\": \\\"3400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1951\\\",\\n \\\"interpretation\\\": \\\"1951-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Gehaltserh\u00f6hung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 8,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"B\u00fcroleiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Genf\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"5\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1953\\\",\\n \\\"interpretation\\\": \\\"1953-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Tarifliche Anpassung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 9,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"~\\\\\\\"~\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": true\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Genf\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"5\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 4'200.-\\\",\\n \\\"interpretation\\\": \\\"4200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Oktober 1954\\\",\\n \\\"interpretation\\\": \\\"1954-10-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Leistungszulage\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 10,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"~\\\\\\\"~\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": true\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"VI\\\",\\n \\\"interpretation\\\": \\\"6\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5'094.-\\\",\\n \\\"interpretation\\\": \\\"5094\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1955\\\",\\n \\\"interpretation\\\": \\\"1955-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Stellenwechsel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 11,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Abteilungsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bern\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"VI\\\",\\n \\\"interpretation\\\": \\\"6\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5'600.-\\\",\\n \\\"interpretation\\\": \\\"5600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1957\\\",\\n \\\"interpretation\\\": \\\"1957-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Gehaltsanpassung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 12,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Abteilungsleiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Bern\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"6\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 6'300.-\\\",\\n \\\"interpretation\\\": \\\"6300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1958\\\",\\n \\\"interpretation\\\": \\\"1958-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Erh\u00f6hung aufgrund Erfahrung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 13,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"~\\\\\\\"~\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": true\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"VII\\\",\\n \\\"interpretation\\\": \\\"7\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 7'200.-\\\",\\n \\\"interpretation\\\": \\\"7200\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1960\\\",\\n \\\"interpretation\\\": \\\"1960-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bef\u00f6rderung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"tool_calls\":null,\"prefix\":false,\"role\":\"assistant\"},\"finish_reason\":\"stop\"}]}"}, "scoring": {"f1_micro": 0.08550434201736808, "f1_macro": 0.045737704918032786, "micro_precision": 0.051397365884998394, "micro_recall": 0.2541699761715647, "total_instances": 61, "total_tp": 640, "total_fp": 11812, "total_fn": 1878, "cost_summary": {"total_input_tokens": 110410, "total_output_tokens": 239159, "total_tokens": 349569, "input_cost_usd": 0.02208200000000001, "output_cost_usd": 0.04783179999999998, "total_cost_usd": 0.06991380000000003}}, "normalized_score": 8.550434201736808}, {"_id": {"$oid": "69d4eb12b877594bc5718c43"}, "test_id": "T0619", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openrouter", "model": "qwen/qwen3-vl-8b-thinking", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3120.--\",\"interpretation\":\"3120\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"22. Mai 1944\",\"interpretation\":\"1944-05-22\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"II\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.415.--\",\"interpretation\":\"4415\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "qwen/qwen3-vl-8b-thinking", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 5243, "output_tokens": 9058, "total_tokens": 14301}, "duration": 73.43185877799988, "timestamp": "2026-02-09T17:36:08.774890", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3120.--", "interpretation": "3120", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "22. Mai 1944", "interpretation": "1944-05-22", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "II", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.415.--", "interpretation": "4415", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "1b3f73c8-ad3f-4a07-a72f-5881f97d69b5", "score": {"f1_score": 0.94, "precision": 0.9565217391304348, "recall": 0.9166666666666666, "true_positives": 22, "false_positives": 1, "false_negatives": 2, "field_scores": {"rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Hilfsleiter", "score": 0.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3120.--", "ground_truth": "3120.--", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3120", "ground_truth": "3120", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4415", "ground_truth": "4415", "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.415.--", "ground_truth": "4.415.--", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "22. Mai 1944", "ground_truth": "22. Mai 1944", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-05-22", "ground_truth": "1944-05-22", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "II", "ground_truth": "\"", "score": 0.0}}, "total_fields": 38}, "raw_response": "{\"id\":\"gen-1770654889-aYmbyQD1mOav5isRGsHn\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"22. Mai 1944\\\",\\n \\\"interpretation\\\": \\\"1944-05-22\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3120.--\\\",\\n \\\"interpretation\\\": \\\"3120\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"row_number\\\": 1\\n },\\n {\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1945\\\",\\n \\\"interpretation\\\": \\\"1945-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"II\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.415.--\\\",\\n \\\"interpretation\\\": \\\"4415\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"row_number\\\": 2\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3120.--\",\"interpretation\":\"3120\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"22. Mai 1944\",\"interpretation\":\"1944-05-22\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"II\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.415.--\",\"interpretation\":\"4415\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]},\"reasoning\":\"Okay, let's tackle this problem step by step. So, I need to extract information from the provided personnel card table and format it into a structured JSON object as per the given schema. Let me first understand the requirements thoroughly.\\n\\nFirst, the user has provided a JSON schema that defines the structure of the output. The main object should have a \\\"rows\\\" array, each containing a TableRow object. Each TableRow has specific fields: row_number, dienstliche_stellung, dienstort, gehaltsklasse, jahresgehalt_monatsgehalt_taglohn, datum_gehalts\u00e4nderung, and bemerkungen. Each of these fields must have their own diplomatic_transcript, interpretation, and is_crossed_out properties.\\n\\nThe key here is to accurately transcribe the data from the image, following the rules provided. Let me look at the image again. The table has headers: Dienstliche Stellung, Dienstort, Gehaltsklasse, Jahresgehalt Monatsgehalt Taglohn, Zeitpunkt der Gehalts\u00e4nderung (with subcolumns Tag, Monat, Jahr), and Bemerkungen, Akten etc.\\n\\nLooking at the rows:\\n\\n1. First row: Dienstliche Stellung is \\\"Hilfsleiter\\\", Dienstort is empty (since it's blank), Gehaltsklasse is empty, Jahresgehalt is \\\"3120.--\\\", Zeitpunkt has \\\"22. Mai 1944\\\", and Bemerkungen is empty.\\n\\nWait, no. Wait, the first row has \\\"Hilfsleiter\\\" in Dienstliche Stellung, then the next row has a \\\"II\\\" in Dienstliche Stellung. Wait, let me check the image again.\\n\\nLooking at the image:\\n\\nThe first row (row 1) has:\\n- Dienstliche Stellung: \\\"Hilfsleiter\\\"\\n- Dienstort: empty\\n- Gehaltsklasse: empty\\n- Jahresgehalt: \\\"3120.--\\\"\\n- Zeitpunkt: Tag \\\"22.\\\", Monat \\\"Mai\\\", Jahr \\\"1944\\\"\\n- Bemerkungen: empty\\n\\nSecond row (row 2):\\n- Dienstliche Stellung: \\\"II\\\" (maybe this is a ditto mark? Wait, no. Wait, in the image, there's a \\\"II\\\" in the Dienstliche Stellung column for the second row. Wait, looking again, the first row has \\\"Hilfsleiter\\\", then the second row has a \\\"II\\\" in the same column. Wait, maybe the \\\"II\\\" is a typo or a specific code. Wait, the first row's Dienstliche Stellung is \\\"Hilfsleiter\\\", and the second row has \\\"II\\\" in that column. Hmm, but maybe it's a ditto mark? Wait, the image shows the second row's Dienstliche Stellung as \\\"II\\\", but perhaps that's a mistake. Wait, the problem statement says that if a field has a ditto mark (like `\\\"`), then it should be replaced by the previous row's value in the same column.\\n\\nWait, in the example given in the rules, if a row has a ditto mark (e.g., `\\\"`), then the interpretation should be the value from the previous row. However, in the image, the second row's Dienstliche Stellung is \\\"II\\\", which might not be a ditto mark. Wait, perhaps there's a typo here. Let me check the image again.\\n\\nWait, the user provided an image where the second row under Dienstliche Stellung has \\\"II\\\". Let me look at the image description:\\n\\nThe user provided an image where the first row has \\\"Hilfsleiter\\\" in Dienstliche Stellung, then the next line has \\\"II\\\" in that column. Wait, maybe that's a mistake in transcription. Wait, looking at the original problem statement, the image shows:\\n\\nDienstliche Stellung | Dienstort | Gehaltsklasse | Jahresgehalt Monatsgehalt Taglohn | Zeitpunkt der Gehalts\u00e4nderung (Tag, Monat, Jahr) | Bemerkungen, Akten etc.\\n\\nFirst row:\\nHilfsleiter | [empty] | [empty] | 3120.-- | 22. Mai 1944 | [empty]\\n\\nSecond row:\\nII | [empty] | [empty] | 4.415.-- | 1. Januar 1945 | + Zulagen\\n\\nWait, but the second row's Dienstliche Stellung is \\\"II\\\", but perhaps this is a ditto mark. Wait, but \\\"II\\\" as a value. Hmm. Wait, maybe the \\\"II\\\" is the actual value. But perhaps in the image, the second row's Dienstliche Stellung is a repeat of the previous row's value. Wait, but the problem states that if the field contains a ditto mark (like `\\\"`), then replace with the previous row's value. But in this case, the second row's Dienstliche Stellung is \\\"II\\\", which is not a ditto mark. Wait, maybe there's a mistake here. Alternatively, perhaps the \\\"II\\\" is the actual value.\\n\\nWait, let's check the user's instruction again. The problem says:\\n\\n\\\"PROCESS THE ENTIRE TABLE FROM TOP TO BOTTOM\\\"\\n\\nAnd the column definitions.\\n\\nIn the image, the first row has \\\"Hilfsleiter\\\" in Dienstliche Stellung. The second row has \\\"II\\\" in the same column. But maybe this \\\"II\\\" is a ditto mark? Wait, the example given in the rules is:\\n\\n\\\"If previous row's dienstliche_stellung is 'Hilfsleiter' and current row has `\\\"`, interpret as 'Hilfsleiter'\\\"\\n\\nBut the current row here has \\\"II\\\", which isn't a ditto mark. So perhaps \\\"II\\\" is an actual value.\\n\\nWait, but \\\"II\\\" is a Roman numeral for 2. Maybe in the context of salary class, but the salary class column is \\\"Gehaltsklasse\\\". Wait, no, the second row's Gehaltsklasse is empty. Wait, maybe \\\"II\\\" is the salary class. Wait, but in the first row, Gehaltsklasse is empty. Hmm.\\n\\nWait, let me re-examine the structure.\\n\\nThe table has columns:\\n\\n- Dienstliche Stellung (position)\\n- Dienstort (location)\\n- Gehaltsklasse (salary class)\\n- Jahresgehalt Monatsgehalt Taglohn (salary amount)\\n- Zeitpunkt der Gehalts\u00e4nderung (Tag, Monat, Jahr)\\n- Bemerkungen, Akten etc.\\n\\nLooking at the rows:\\n\\nFirst row:\\n- Dienstliche Stellung: \\\"Hilfsleiter\\\"\\n- Dienstort: empty\\n- Gehaltsklasse: empty\\n- Jahresgehalt: \\\"3120.--\\\"\\n- Zeitpunkt: Tag=22., Monat=Mai, Jahr=1944\\n- Bemerkungen: empty\\n\\nSecond row:\\n- Dienstliche Stellung: \\\"II\\\" (maybe this is a typo, but assuming it's \\\"II\\\")\\n- Dienstort: empty\\n- Gehaltsklasse: empty\\n- Jahresgehalt: \\\"4.415.--\\\"\\n- Zeitpunkt: Tag=1., Monat=Januar, Jahr=1945\\n- Bemerkungen: \\\"+ Zulagen\\\"\\n\\nWait, but the second row's Dienstliche Stellung is \\\"II\\\". Maybe this is a ditto mark. Wait, but the example shows that a ditto mark (like `\\\"` or \\\"quote\\\") would be replaced. However, in this case, it's written as \\\"II\\\". So perhaps it's a valid entry, not a ditto mark.\\n\\nWait, but in the user's example, the rule is: \\\"For ditto marks (repetition marks such as `\\\"`), replace with the actual repeated value from the previous row in the same column.\\\"\\n\\nSo if the current row has a ditto mark (e.g., `\\\"`), then interpret as previous row's value. But if it's written as \\\"II\\\", then it's an actual value.\\n\\nSo perhaps the second row's Dienstliche Stellung is \\\"II\\\", which is a valid entry. So that's the case here. Let me proceed with that.\\n\\nNow, for each field, need to extract:\\n\\n- diplomatic_transcript: exact as written, including formatting.\\n- interpretation: depending on rules, e.g., dates converted, salaries as numeric, etc.\\n- is_crossed_out: true if crossed out, else false.\\n\\nLooking at the first row:\\n\\ndienstliche_stellung: \\\"Hilfsleiter\\\" \u2013 exact as written. No crossing, so is_crossed_out is false. Interpretation is \\\"Hilfsleiter\\\" (no expansion needed).\\n\\ndienstort: empty string. So diplomatic_transcript is \\\"\\\", interpretation null, is_crossed_out false.\\n\\ngehaltsklasse: empty. Same as above.\\n\\njahresgehalt_monatsgehalt_taglohn: \\\"3120.--\\\" \u2013 diplomatic_transcript. Interpretation should be \\\"3120\\\" (numeric value, removing currency and separators). So \\\"3120\\\".\\n\\ndatum_gehalts\u00e4nderung: the date fields. The columns for Tag, Monat, Jahr. So Tag=22., Monat=Mai, Jahr=1944. The exact string would be \\\"22. Mai 1944\\\". For interpretation, need to convert to ISO format: 1944-05-22.\\n\\nWait, the date format in the card is \\\"22. Mai 1944\\\", so day is 22, month is Mai (May), year 1944. So ISO is 1944-05-22.\\n\\nbemerkungen: empty.\\n\\nNow the second row:\\n\\ndienstliche_stellung: \\\"II\\\" \u2013 diplomatic_transcript is \\\"II\\\". Interpretation: as per salary class, convert Roman numerals to Arabic. So \\\"II\\\" is 2, so interpretation \\\"2\\\". But wait, the rule says: \\\"For salary class: Convert roman numerals to arabic if clear. 'III' \u2192 '3', 'IV' \u2192 '4'\\\". However, the salary class is in \\\"Gehaltsklasse\\\" column, which is empty in both rows. Wait, in this case, the second row's Dienstliche Stellung is \\\"II\\\", but that's part of the position. Wait, no \u2013 the \\\"dienstliche_stellung\\\" column is for position, so \\\"II\\\" here is part of the position title, not the salary class.\\n\\nWait, maybe \\\"II\\\" here is the position? But that's unclear. Let's read the rules again.\\n\\nThe user's column definitions:\\n\\n1. dienstliche_stellung: Official position or job title (e.g., \\\"Assistent\\\", \\\"Professor\\\", \\\"Sekret\u00e4r\\\")\\n\\nSo if the position is \\\"II\\\", that's a bit odd. Maybe it's a typo, but according to the instructions, we have to transcribe exactly as written. So diplomatic_transcript is \\\"II\\\".\\n\\nInterpretation: the rule says for salary class (gehaltsklasse) convert Roman numerals to Arabic. But here, it's in the dienstliche_stellung column. So unless \\\"II\\\" is a salary class, which would be in the gehaltsklasse column. Wait, no. The second row has \\\"II\\\" in dienstliche_stellung, and gehaltsklasse is empty.\\n\\nSo, for dienstliche_stellung, the interpretation would be \\\"II\\\" as a position title. But maybe it's a typo. But according to the rules, we don't expand abbreviations, so interpretation is null unless it's a ditto mark.\\n\\nWait, the rule for interpretation says:\\n\\n- For ditto marks: replace with previous row's value.\\n\\nBut \\\"II\\\" is not a ditto mark. So interpretation would be null? Or is there a standard interpretation for positions?\\n\\nWait, the rule states: \\\"Use null if no interpretation/expansion is needed or if the field is empty.\\\"\\n\\nSo unless it's a case where a ditto mark is present, interpretation would be null. But since \\\"II\\\" is written as part of the position, perhaps it's a standard entry, but according to the rules, we don't expand abbreviations. So the interpretation would be null.\\n\\nWait, the example given in the rules for interpretation is only for specific cases like dates, salaries, salary class, and ditto marks. For position titles, since the user didn't specify expanding positions, perhaps interpretation is null.\\n\\nSo for the first row's dienstliche_stellung: \\\"Hilfsleiter\\\" \u2013 interpretation is \\\"Hilfsleiter\\\" (since it's a standard term, but the rule says not to expand abbreviations. Wait, but the rule says: \\\"Never expand abbreviations\\\". So if the position is \\\"Hilfsleiter\\\", which is a standard German term for \\\"Assistant\\\", but according to the rules, we don't expand. So interpretation is \\\"Hilfsleiter\\\". Wait, but the rules say for interpretation:\\n\\n\\\"For ditto marks (repetition marks such as `\\\"`): Replace with the actual repeated value from the previous row in the same column. Do NOT add explanatory text like \\\"wie oben\\\" or similar - just provide the repeated value.\\\"\\n\\nSo for positions that are expanded, but in this case, maybe \\\"Hilfsleiter\\\" is already the standard term, so no need to interpret.\\n\\nWait, the user says: \\\"interpretation or expansion of abbreviations and meanings\\\". So if the abbreviation is \\\"Hilfsleiter\\\", which is a full German term, then no expansion is needed. So interpretation would be \\\"Hilfsleiter\\\".\\n\\nBut in the case of the second row, \\\"II\\\" \u2013 is that an abbreviation? If it's \\\"II\\\" as a position, maybe it's \\\"II. Assist. Something\\\", but in the card it's written as \\\"II\\\". Since the user said not to expand abbreviations, interpretation would be null unless it's a ditto mark.\\n\\nWait, no. The user's example says that for ditto marks, we replace with previous value. But for other abbreviations, like a salary class \\\"III\\\", we convert to Arabic. But for position titles, if it's a standard term, perhaps no interpretation is needed.\\n\\nWait, but the second row's \\\"II\\\" is likely a typo or a specific entry. For example, in the first row, the position is \\\"Hilfsleiter\\\", and the second row has \\\"II\\\" in the same column. Maybe it's a mistake where the position was supposed to be the same as the previous row, but written as \\\"II\\\" (maybe a typo for \\\"Hilfsleiter\\\", but that doesn't make sense). Alternatively, perhaps \\\"II\\\" refers to the position as part of a higher title.\\n\\nBut according to the instructions, we must not expand abbreviations. So if the position is written as \\\"II\\\", then the interpretation is \\\"II\\\", but the user said to use null if no interpretation is needed. Wait, but the user says: \\\"interpretation can be null when no expansion/standardization applies\\\".\\n\\nIn the case of \\\"II\\\", since it's not a standard abbreviation that needs conversion (like Roman numerals to Arabic), but the salary class column does convert Roman numerals to Arabic. However, this is in the dienstliche_stellung column.\\n\\nWait, but the second row's Gehaltsklasse is empty, so the \\\"II\\\" is in the position column. Maybe it's an error. Let's proceed.\\n\\nAssuming that \\\"II\\\" is the actual value. So diplomatic_transcript is \\\"II\\\", interpretation is null (since there's no standard expansion), is_crossed_out false.\\n\\nWait, but maybe the \\\"II\\\" in the position column is actually a salary class. Wait, no. The columns are fixed: Dienstliche Stellung is position, Gehaltsklasse is salary class.\\n\\nWait, looking back, in the first row:\\n\\ndienstliche_stellung: Hilfsleiter\\n\\nGehaltsklasse: empty\\n\\nJahresgehalt: 3120.-- \\n\\nThen the second row:\\n\\ndienstliche_stellung: II\\n\\nGehaltsklasse: empty\\n\\nJahresgehalt: 4.415.--\\n\\nSo the \\\"II\\\" is in the position column. So it's a position title of \\\"II\\\", which might not make sense. But according to the instructions, we transcribe exactly as written, so interpretation would be null unless it's a ditto mark.\\n\\nWait, the user mentioned: \\\"For ditto marks (repetition marks such as `\\\"`), replace with the actual repeated value from the previous row in the same column\\\".\\n\\nIn the image, the second row's position is \\\"II\\\". But if it's written as a quote, like `\\\"` to indicate \\\"same as above\\\", but the problem is that in the image, it's written as \\\"II\\\" \u2013 perhaps the user made a mistake in the image transcription.\\n\\nAlternatively, maybe the second row's position is a ditto mark. Let me check again.\\n\\nThe image shows the second row's position as \\\"II\\\". But maybe it's written with a ditto mark, like `\\\"` followed by II, but perhaps in the original image, it's \\\"Hilfsleiter\\\" again with a ditto mark, but here it's mistyped.\\n\\nWait, the user's image description is:\\n\\nDienstliche Stellung | Dienstort | Gehaltsklasse | Jahresgehalt Monatsgehalt Taglohn | Zeitpunkt der Gehalts\u00e4nderung | Bemerkungen...\\n\\nFirst row:\\nHilfsleiter | [empty] | [empty] | 3120.-- | 22. Mai 1944 | [empty]\\n\\nSecond row:\\nII | [empty] | [empty] | 4.415.-- | 1. Januar 1945 | + Zulagen\\n\\nSo perhaps the second row's position is \\\"II\\\" (as in \\\"II. Hilfsleiter\\\" but truncated), but according to the rules, if it's a ditto mark, we replace with the previous value.\\n\\nBut since it's written as \\\"II\\\", not a quote mark, it's not a ditto mark. So interpretation is null.\\n\\nWait, but maybe \\\"II\\\" is a typo for the previous position. For example, maybe it's a ditto mark, but the user wrote \\\"II\\\" by mistake. But the instructions say to use the exact transcription.\\n\\nSo for now, proceed as per the given data.\\n\\nFor the second row's date:\\n\\n\\\"1. Januar 1945\\\" \u2192 interpretation \\\"1945-01-01\\\"\\n\\nSalary: \\\"4.415.--\\\" \u2192 interpretation \\\"4415\\\" (numeric value)\\n\\nBemerkungen: \\\"+ Zulagen\\\" \u2192 no ditto mark, so interpretation is \\\"+ Zulagen\\\" or null? Wait, the rule says interpretation is for expansion. Since it's a note like \\\"+ Zulagen\\\" (which means \\\"plus allowances\\\"), but according to the rules, \\\"Never expand abbreviations\\\". So interpretation should be null unless it's a ditto mark or specific conversion. So for remarks, interpretation is null.\\n\\nWait, but the user says: \\\"For remarks, notes, or additional comments\\\" \u2192 the interpretation is expanded/standardized. So if the remark is \\\"+ Zulagen\\\", which is an abbreviation, perhaps the interpretation is \\\"plus allowances\\\".\\n\\nBut according to the rules, \\\"Never expand abbreviations\\\", so interpretation should be null.\\n\\nWait, the rule says:\\n\\n\\\"interpretation or expansion of abbreviations and meanings\\\"\\n\\nBut the rule also says: \\\"Never expand abbreviations\\\"\\n\\nSo if a remark is \\\"+ Zulagen\\\", which is a standard abbreviation, but the user says not to expand. So interpretation is null.\\n\\nAlternatively, if \\\"Zulagen\\\" is a German term meaning allowances, but since the rule says not to expand, interpretation should be null.\\n\\nHmm. The user example for interpretation says: \\\"For ditto marks... Replace with the actual repeated value from the previous row in the same column. Do NOT add explanatory text like 'wie oben' or similar - just provide the repeated value.\\\"\\n\\nSo for remarks, if there's a standard term that needs expanding, but the user says not to expand, so interpretation is null.\\n\\nSo for \\\"bemerkungen\\\" in the second row: diplomatic_transcript is \\\"+ Zulagen\\\", interpretation is null.\\n\\nNow, let's process each field for each row.\\n\\nRow 1:\\n\\n- dienstliche_stellung: diplomatic_transcript \\\"Hilfsleiter\\\", interpretation \\\"Hilfsleiter\\\", is_crossed_out false.\\n- dienstort: \\\"\\\" (empty), interpretation null, is_crossed_out false.\\n- gehaltsklasse: \\\"\\\" (empty), interpretation null, is_crossed_out false.\\n- jahresgehalt_monatsgehalt_taglohn: \\\"3120.--\\\", interpretation \\\"3120\\\", is_crossed_out false.\\n- datum_gehalts\u00e4nderung: \\\"22. Mai 1944\\\", interpretation \\\"1944-05-22\\\", is_crossed_out false.\\n- bemerkungen: \\\"\\\", interpretation null, is_crossed_out false.\\n\\nRow 2:\\n\\n- dienstliche_stellung: diplomatic_transcript \\\"II\\\", interpretation \\\"II\\\" (but according to the salary class conversion rule, but this is in position column; maybe the rule for interpretation says to convert Roman numerals to Arabic only for salary class. So in this case, interpretation would be \\\"II\\\", since it's not salary class. Wait, no: the user's rule says: \\\"For salary class: Convert roman numerals to arabic if clear\\\". So if the salary class column has \\\"III\\\", convert to \\\"3\\\", but here the position column has \\\"II\\\". So for dienstliche_stellung, interpretation would be null unless it's a ditto mark.\\n\\nWait, the rule for interpretation: \\\"For salary class: Convert roman numerals to arabic if clear\\\". So only applies to gehaltsklasse. For other fields, like dienstliche_stellung, unless it's a ditto mark or specific format (like dates, salary amounts), interpretation is null.\\n\\nSo for row 2's dienstliche_stellung: diplomatic_transcript \\\"II\\\", interpretation null, is_crossed_out false.\\n\\nBut wait, the user example says for ditto marks, replace with previous value. But since it's not a ditto mark, interpretation is null.\\n\\nSimilarly for gehaltsklasse: both rows have empty, so interpretation null.\\n\\nJahresgehalt for row 2: \\\"4.415.--\\\" \u2192 \\\"4415\\\"\\n\\nDate: \\\"1. Januar 1945\\\" \u2192 \\\"1945-01-01\\\"\\n\\nBemerkungen: \\\"+ Zulagen\\\" \u2192 interpretation null.\\n\\nWait, but the user's rule for salary amounts says to extract numeric value. So for \\\"4.415.--\\\", it's 4415.\\n\\nAlso, check if the salary amount has separators like commas. But in this case, it's a dot: \\\"4.415.--\\\", so 4415.\\n\\nNow, check if any fields are crossed out. The image doesn't show any crossing out, so is_crossed_out is false for all.\\n\\nLet me verify each field:\\n\\nRow 1:\\n\\ndienstliche_stellung: \\\"Hilfsleiter\\\" \u2192 not crossed out.\\n\\ndienstort: empty \u2192 is_crossed_out false.\\n\\ngehaltsklasse: empty \u2192 false.\\n\\njahresgehalt: \\\"3120.--\\\" \u2192 not crossed out.\\n\\ndatum_gehalts\u00e4nderung: \\\"22. Mai 1944\\\" \u2192 no crossing.\\n\\nbemerkungen: empty.\\n\\nRow 2:\\n\\ndienstliche_stellung: \\\"II\\\" \u2192 not crossed.\\n\\ndienstort: empty.\\n\\ngehaltsklasse: empty.\\n\\njahresgehalt: \\\"4.415.--\\\" \u2192 not crossed.\\n\\ndatum: \\\"1. Januar 1945\\\" \u2192 no crossing.\\n\\nbemerkungen: \\\"+ Zulagen\\\" \u2192 not crossed.\\n\\nNow, process the interpretation:\\n\\nRow 1:\\n\\n- jahresgehalt_monatsgehalt_taglohn: \\\"3120.\\\" \u2192 interpretation \\\"3120\\\"\\n\\n- datum_gehalts\u00e4nderung: \\\"22. Mai 1944\\\" \u2192 \\\"1944-05-22\\\"\\n\\nRow 2:\\n\\n- jahresgehalt_monatsgehalt_taglohn: \\\"4.415.--\\\" \u2192 \\\"4415\\\"\\n\\n- datum_gehalts\u00e4nderung: \\\"1. Januar 1945\\\" \u2192 \\\"1945-01-01\\\"\\n\\nNow, check the salary class. In row 1, gehaltsklasse is empty, so interpretation null. Same for row 2.\\n\\nWait, but the user's column definition says gehaltsklasse is salary class. In the image, both rows have empty gehaltsklasse, so for both rows, gehaltsklasse fields will have diplomatic_transcript as empty string, interpretation null, is_crossed_out false.\\n\\nNow, about the second row's \\\"II\\\" in dienstliche_stellung: is there a possibility that it's a ditto mark? For example, if the \\\"II\\\" was written as a quote (\\\") followed by \\\"Hilfsleiter\\\", but in the image, it's written as \\\"II\\\". However, according to the problem statement, if it's a ditto mark (like `\\\"`), replace with previous value. But if it's written as \\\"II\\\", then no.\\n\\nGiven the image's description, it's written as \\\"II\\\", so diplomatic_transcript is \\\"II\\\".\\n\\nInterpretation: since it's not a ditto mark and not part of salary class (which is a separate column), interpretation would be null.\\n\\nWait, but maybe \\\"II\\\" here is a typo for \\\"Hilfsleiter\\\", and the \\\"II\\\" is a mistake. However, per the instructions, we must transcribe exactly as written. So \\\"II\\\" is the diplomatic_transcript.\\n\\nNow, for the first row's dienstliche_stellung, \\\"Hilfsleiter\\\" is the correct value, and the second row's is \\\"II\\\".\\n\\nNow, constructing the JSON.\\n\\nRows:\\n\\nRow 1: row_number 1\\n\\nRow 2: row_number 2\\n\\nNow, check if any empty rows exist. The image shows two rows with data, so two rows.\\n\\nEach row must have all fields filled with their respective sub-fields.\\n\\nLet me structure each row.\\n\\nRow 1:\\n\\ndienstliche_stellung:\\n\\n- diplomatic_transcript: \\\"Hilfsleiter\\\"\\n\\n- interpretation: \\\"Hilfsleiter\\\" (but according to the rules, do we expand? The rule says \\\"Never expand abbreviations\\\". So if \\\"Hilfsleiter\\\" is a full term, no expansion. However, the user example says for interpretation, \\\"For ditto marks...\\\". But here, it's a normal entry. The user says: \\\"Use null if no interpretation/expansion is needed or if the field is empty.\\\"\\n\\nWait, the interpretation for dienstliche_stellung would be null unless there's a specific reason to interpret (like ditto marks or salary conversions). So perhaps \\\"Hilfsleiter\\\" should have interpretation as null. Wait, this is a critical point.\\n\\nWait, looking at the user's example:\\n\\nThe required JSON structure shows that for the jahresgehalt_monatsgehalt_taglohn field, interpretation is \\\"standardized numeric form or null\\\".\\n\\nSimilarly, for datum_gehalts\u00e4nderung, interpretation is ISO format.\\n\\nFor salary class, convert Roman numerals to Arabic.\\n\\nFor ditto marks, replace with previous value.\\n\\nFor other fields (dienstliche_stellung, dienstort, bemerkungen), interpretation is null unless it's a ditto mark or specific conversion.\\n\\nSo for \\\"dienstliche_stellung\\\", if there's a ditto mark (e.g., `\\\"`), replace with previous row's value. Otherwise, interpretation is null.\\n\\nTherefore, for row 1's dienstliche_stellung: \\\"Hilfsleiter\\\" \u2192 interpretation null.\\n\\nFor row 2's dienstliche_stellung: \\\"II\\\" \u2192 interpretation null.\\n\\nWait, but the example says for interpretation: \\\"For ditto marks (repetition marks such as `\\\"`): Replace with the actual repeated value from the previous row in the same column. Do NOT add explanatory text like \\\"wie oben\\\" or similar - just provide the repeated value.\\\"\\n\\nSo if the current row's dienstliche_stellung is a ditto mark, then it's replaced with the previous value. But if it's written as \\\"II\\\", then it's not a ditto mark, so interpretation is null.\\n\\nThus, for row 1: dienstliche_stellung interpretation is null.\\n\\nBut wait, the user's column definition says \\\"dienstliche_stellung\\\": Official position/job title. So \\\"Hilfsleiter\\\" is a proper German title, so the interpretation would be the same. But according to the rules, \\\"Never expand abbreviations\\\". So if the entry is already expanded (not an abbreviation), then interpretation is null.\\n\\nAh, the key is whether the field's value is an abbreviation that needs expanding. For example, if it's \\\"Prof.\\\" for \\\"Professor\\\", then interpretation would be \\\"Professor\\\". But if it's \\\"Hilfsleiter\\\" (which is the full term), then no expansion is needed, so interpretation is null.\\n\\nWait, but the user's example for interpretation includes the case where for salary class, Roman numerals are converted to Arabic. So for fields that have specific conventions (like salary class, dates, salary amounts), interpretation is done. For others, only if it's a ditto mark.\\n\\nSo for dienstliche_stellung, unless it's a ditto mark or a specific abbreviation (like \\\"Prof.\\\"), interpretation is null.\\n\\nTherefore, for row 1's position \\\"Hilfsleiter\\\", interpretation is null.\\n\\nSimilarly, row 2's \\\"II\\\" is not a ditto mark, so interpretation null.\\n\\nWait, but the problem states that the \\\"interpretation\\\" field is optional, with null if not applicable.\\n\\nSo let's re-examine:\\n\\nFor each field:\\n\\n- dienstliche_stellung: diplomatic_transcript is exact. If it's a ditto mark, replace with previous. Otherwise, interpretation is null.\\n\\n- Similarly, dienstort: if empty or not ditto, null.\\n\\nBut in this case, the fields are:\\n\\nRow 1:\\n\\ndienstliche_stellung: \\\"Hilfsleiter\\\" \u2192 not a ditto mark. So interpretation null.\\n\\nRow 2:\\n\\ndienstliche_stellung: \\\"II\\\" \u2192 not a ditto mark \u2192 interpretation null.\\n\\nBut wait, the second row's \\\"II\\\" is possibly a ditto mark. For example, if it's written as `\\\"` followed by \\\"II\\\", but in the problem statement, the image shows \\\"II\\\". However, according to the image description given by the user, it's written as \\\"II\\\", not a quote mark. So it's considered a separate entry.\\n\\nSo in this case, interpretation for dienstliche_stellung is null.\\n\\nWait, but if it's written as a repeat (ditto mark), the user's example shows that the interpretation should be the previous row's value. But since it's written as \\\"II\\\", not a quote mark, it's not a ditto.\\n\\nNow, for the jahresgehalt_monatsgehalt_taglohn:\\n\\nRow 1: \\\"3120.--\\\" \u2192 interpretation \\\"3120\\\"\\n\\nRow 2: \\\"4.415.--\\\" \u2192 \\\"4415\\\"\\n\\nDatum_gehalts\u00e4nderung:\\n\\nRow 1: \\\"22. Mai 1944\\\" \u2192 \\\"1944-05-22\\\"\\n\\nRow 2: \\\"1. Januar 1945\\\" \u2192 \\\"1945-01-01\\\"\\n\\nBemerkungen:\\n\\nRow 2 has \\\"+ Zulagen\\\" \u2192 interpretation null.\\n\\nNow, the salary class (gehaltsklasse) is empty in both rows, so interpretation null.\\n\\nNow, compiling all this into the JSON.\\n\\nLet me check each row's structure.\\n\\nRow 1:\\n\\n- row_number: 1\\n\\n- dienstliche_stellung: { \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- dienstort: { \\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- gehaltsklasse: { \\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- jahresgehalt_monatsgehalt_taglohn: { \\\"diplomatic_transcript\\\": \\\"3120.--\\\", \\\"interpretation\\\": \\\"3120\\\", \\\"is_crossed_out\\\": false }\\n\\n- datum_gehalts\u00e4nderung: { \\\"diplomatic_transcript\\\": \\\"22. Mai 1944\\\", \\\"interpretation\\\": \\\"1944-05-22\\\", \\\"is_crossed_out\\\": false }\\n\\n- bemerkungen: { \\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\nRow 2:\\n\\n- row_number: 2\\n\\n- dienstliche_stellung: { \\\"diplomatic_transcript\\\": \\\"II\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- dienstort: { \\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- gehaltsklasse: { \\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- jahresgehalt_monatsgehalt_taglohn: { \\\"diplomatic_transcript\\\": \\\"4.415.--\\\", \\\"interpretation\\\": \\\"4415\\\", \\\"is_crossed_out\\\": false }\\n\\n- datum_gehalts\u00e4nderung: { \\\"diplomatic_transcript\\\": \\\"1. Januar 1945\\\", \\\"interpretation\\\": \\\"1945-01-01\\\", \\\"is_crossed_out\\\": false }\\n\\n- bemerkungen: { \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\nNow, verifying all fields have diplomatic_transcript as required.\\n\\nFor example, in row 2's bemerkungen, diplomatic_transcript is \\\"+ Zulagen\\\" \u2013 which is the exact string.\\n\\nCheck if the dates are correctly converted.\\n\\nFor datum_gehalts\u00e4nderung, \\\"22. Mai 1944\\\" \u2192 May is the 5th month, so 1944-05-22.\\n\\n\\\"1. Januar 1945\\\" \u2192 January is month 1, so 1945-01-01.\\n\\nSalary amounts:\\n\\n\\\"3120.--\\\" \u2192 remove currency and separators \u2192 \\\"3120\\\"\\n\\n\\\"4.415.--\\\" \u2192 \\\"4415\\\"\\n\\nNow, check if the interpretation for salary class is correct. The Gehaltsklasse column is empty in both rows, so interpretation null.\\n\\nCheck for crossed out: none are crossed out in the image, so is_crossed_out is false for all.\\n\\nNow, constructing the JSON:\\n\\n[\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3120.--\\\",\\n \\\"interpretation\\\": \\\"3120\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"22. Mai 1944\\\",\\n \\\"interpretation\\\": \\\"1944-05-22\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"II\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.415.--\\\",\\n \\\"interpretation\\\": \\\"4415\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1945\\\",\\n \\\"interpretation\\\": \\\"1945-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n]\\n\\nWait, but in the problem statement's example, the interpretation for salary amounts is a string like \\\"3120\\\", but the user said \\\"standardized numeric form or null\\\".\\n\\nYes, \\\"3120\\\" is correct.\\n\\nSimilarly, for the second row's salary amount, \\\"4.415.--\\\" \u2192 \\\"4415\\\".\\n\\nAlso, the date formatting.\\n\\nNow, check if all required fields are present.\\n\\nThe schema requires that all fields have diplomatic_transcript, interpretation, is_crossed_out.\\n\\nYes, for each row, all seven fields are present.\\n\\nIn the output, the rows are in order, numbered from 1.\\n\\nThe JSON should be a list of rows, each as described.\\n\\nNow, one possible error: the user mentioned that the second row's position is \\\"II\\\", but maybe it's a typo and should be a ditto mark. However, given the instructions, we have to take the exact transcription.\\n\\nAnother point: in row 2's jahresgehalt, the amount is \\\"4.415.--\\\", which should be \\\"4415\\\", but the correct numeric value is 4415 (since 4.415 is 4,415 in European formatting, which is 4415 without the decimal separator).\\n\\nYes, the rule says: \\\"For salary amounts: Extract numeric value only (remove currency symbols, separators)\\\"\\n\\nSo \\\"4.415.--\\\" \u2192 remove the dot (separator) \u2192 \\\"4415\\\".\\n\\nSimilarly, \\\"3120.--\\\" \u2192 \\\"3120\\\".\\n\\nNow, the final JSON should have these values.\\n\\nI think this covers all requirements.\\n\",\"reasoning_details\":[{\"format\":\"unknown\",\"index\":0,\"type\":\"reasoning.text\",\"text\":\"Okay, let's tackle this problem step by step. So, I need to extract information from the provided personnel card table and format it into a structured JSON object as per the given schema. Let me first understand the requirements thoroughly.\\n\\nFirst, the user has provided a JSON schema that defines the structure of the output. The main object should have a \\\"rows\\\" array, each containing a TableRow object. Each TableRow has specific fields: row_number, dienstliche_stellung, dienstort, gehaltsklasse, jahresgehalt_monatsgehalt_taglohn, datum_gehalts\u00e4nderung, and bemerkungen. Each of these fields must have their own diplomatic_transcript, interpretation, and is_crossed_out properties.\\n\\nThe key here is to accurately transcribe the data from the image, following the rules provided. Let me look at the image again. The table has headers: Dienstliche Stellung, Dienstort, Gehaltsklasse, Jahresgehalt Monatsgehalt Taglohn, Zeitpunkt der Gehalts\u00e4nderung (with subcolumns Tag, Monat, Jahr), and Bemerkungen, Akten etc.\\n\\nLooking at the rows:\\n\\n1. First row: Dienstliche Stellung is \\\"Hilfsleiter\\\", Dienstort is empty (since it's blank), Gehaltsklasse is empty, Jahresgehalt is \\\"3120.--\\\", Zeitpunkt has \\\"22. Mai 1944\\\", and Bemerkungen is empty.\\n\\nWait, no. Wait, the first row has \\\"Hilfsleiter\\\" in Dienstliche Stellung, then the next row has a \\\"II\\\" in Dienstliche Stellung. Wait, let me check the image again.\\n\\nLooking at the image:\\n\\nThe first row (row 1) has:\\n- Dienstliche Stellung: \\\"Hilfsleiter\\\"\\n- Dienstort: empty\\n- Gehaltsklasse: empty\\n- Jahresgehalt: \\\"3120.--\\\"\\n- Zeitpunkt: Tag \\\"22.\\\", Monat \\\"Mai\\\", Jahr \\\"1944\\\"\\n- Bemerkungen: empty\\n\\nSecond row (row 2):\\n- Dienstliche Stellung: \\\"II\\\" (maybe this is a ditto mark? Wait, no. Wait, in the image, there's a \\\"II\\\" in the Dienstliche Stellung column for the second row. Wait, looking again, the first row has \\\"Hilfsleiter\\\", then the second row has a \\\"II\\\" in the same column. Wait, maybe the \\\"II\\\" is a typo or a specific code. Wait, the first row's Dienstliche Stellung is \\\"Hilfsleiter\\\", and the second row has \\\"II\\\" in that column. Hmm, but maybe it's a ditto mark? Wait, the image shows the second row's Dienstliche Stellung as \\\"II\\\", but perhaps that's a mistake. Wait, the problem statement says that if a field has a ditto mark (like `\\\"`), then it should be replaced by the previous row's value in the same column.\\n\\nWait, in the example given in the rules, if a row has a ditto mark (e.g., `\\\"`), then the interpretation should be the value from the previous row. However, in the image, the second row's Dienstliche Stellung is \\\"II\\\", which might not be a ditto mark. Wait, perhaps there's a typo here. Let me check the image again.\\n\\nWait, the user provided an image where the second row under Dienstliche Stellung has \\\"II\\\". Let me look at the image description:\\n\\nThe user provided an image where the first row has \\\"Hilfsleiter\\\" in Dienstliche Stellung, then the next line has \\\"II\\\" in that column. Wait, maybe that's a mistake in transcription. Wait, looking at the original problem statement, the image shows:\\n\\nDienstliche Stellung | Dienstort | Gehaltsklasse | Jahresgehalt Monatsgehalt Taglohn | Zeitpunkt der Gehalts\u00e4nderung (Tag, Monat, Jahr) | Bemerkungen, Akten etc.\\n\\nFirst row:\\nHilfsleiter | [empty] | [empty] | 3120.-- | 22. Mai 1944 | [empty]\\n\\nSecond row:\\nII | [empty] | [empty] | 4.415.-- | 1. Januar 1945 | + Zulagen\\n\\nWait, but the second row's Dienstliche Stellung is \\\"II\\\", but perhaps this is a ditto mark. Wait, but \\\"II\\\" as a value. Hmm. Wait, maybe the \\\"II\\\" is the actual value. But perhaps in the image, the second row's Dienstliche Stellung is a repeat of the previous row's value. Wait, but the problem states that if the field contains a ditto mark (like `\\\"`), then replace with the previous row's value. But in this case, the second row's Dienstliche Stellung is \\\"II\\\", which is not a ditto mark. Wait, maybe there's a mistake here. Alternatively, perhaps the \\\"II\\\" is the actual value.\\n\\nWait, let's check the user's instruction again. The problem says:\\n\\n\\\"PROCESS THE ENTIRE TABLE FROM TOP TO BOTTOM\\\"\\n\\nAnd the column definitions.\\n\\nIn the image, the first row has \\\"Hilfsleiter\\\" in Dienstliche Stellung. The second row has \\\"II\\\" in the same column. But maybe this \\\"II\\\" is a ditto mark? Wait, the example given in the rules is:\\n\\n\\\"If previous row's dienstliche_stellung is 'Hilfsleiter' and current row has `\\\"`, interpret as 'Hilfsleiter'\\\"\\n\\nBut the current row here has \\\"II\\\", which isn't a ditto mark. So perhaps \\\"II\\\" is an actual value.\\n\\nWait, but \\\"II\\\" is a Roman numeral for 2. Maybe in the context of salary class, but the salary class column is \\\"Gehaltsklasse\\\". Wait, no, the second row's Gehaltsklasse is empty. Wait, maybe \\\"II\\\" is the salary class. Wait, but in the first row, Gehaltsklasse is empty. Hmm.\\n\\nWait, let me re-examine the structure.\\n\\nThe table has columns:\\n\\n- Dienstliche Stellung (position)\\n- Dienstort (location)\\n- Gehaltsklasse (salary class)\\n- Jahresgehalt Monatsgehalt Taglohn (salary amount)\\n- Zeitpunkt der Gehalts\u00e4nderung (Tag, Monat, Jahr)\\n- Bemerkungen, Akten etc.\\n\\nLooking at the rows:\\n\\nFirst row:\\n- Dienstliche Stellung: \\\"Hilfsleiter\\\"\\n- Dienstort: empty\\n- Gehaltsklasse: empty\\n- Jahresgehalt: \\\"3120.--\\\"\\n- Zeitpunkt: Tag=22., Monat=Mai, Jahr=1944\\n- Bemerkungen: empty\\n\\nSecond row:\\n- Dienstliche Stellung: \\\"II\\\" (maybe this is a typo, but assuming it's \\\"II\\\")\\n- Dienstort: empty\\n- Gehaltsklasse: empty\\n- Jahresgehalt: \\\"4.415.--\\\"\\n- Zeitpunkt: Tag=1., Monat=Januar, Jahr=1945\\n- Bemerkungen: \\\"+ Zulagen\\\"\\n\\nWait, but the second row's Dienstliche Stellung is \\\"II\\\". Maybe this is a ditto mark. Wait, but the example shows that a ditto mark (like `\\\"` or \\\"quote\\\") would be replaced. However, in this case, it's written as \\\"II\\\". So perhaps it's a valid entry, not a ditto mark.\\n\\nWait, but in the user's example, the rule is: \\\"For ditto marks (repetition marks such as `\\\"`), replace with the actual repeated value from the previous row in the same column.\\\"\\n\\nSo if the current row has a ditto mark (e.g., `\\\"`), then interpret as previous row's value. But if it's written as \\\"II\\\", then it's an actual value.\\n\\nSo perhaps the second row's Dienstliche Stellung is \\\"II\\\", which is a valid entry. So that's the case here. Let me proceed with that.\\n\\nNow, for each field, need to extract:\\n\\n- diplomatic_transcript: exact as written, including formatting.\\n- interpretation: depending on rules, e.g., dates converted, salaries as numeric, etc.\\n- is_crossed_out: true if crossed out, else false.\\n\\nLooking at the first row:\\n\\ndienstliche_stellung: \\\"Hilfsleiter\\\" \u2013 exact as written. No crossing, so is_crossed_out is false. Interpretation is \\\"Hilfsleiter\\\" (no expansion needed).\\n\\ndienstort: empty string. So diplomatic_transcript is \\\"\\\", interpretation null, is_crossed_out false.\\n\\ngehaltsklasse: empty. Same as above.\\n\\njahresgehalt_monatsgehalt_taglohn: \\\"3120.--\\\" \u2013 diplomatic_transcript. Interpretation should be \\\"3120\\\" (numeric value, removing currency and separators). So \\\"3120\\\".\\n\\ndatum_gehalts\u00e4nderung: the date fields. The columns for Tag, Monat, Jahr. So Tag=22., Monat=Mai, Jahr=1944. The exact string would be \\\"22. Mai 1944\\\". For interpretation, need to convert to ISO format: 1944-05-22.\\n\\nWait, the date format in the card is \\\"22. Mai 1944\\\", so day is 22, month is Mai (May), year 1944. So ISO is 1944-05-22.\\n\\nbemerkungen: empty.\\n\\nNow the second row:\\n\\ndienstliche_stellung: \\\"II\\\" \u2013 diplomatic_transcript is \\\"II\\\". Interpretation: as per salary class, convert Roman numerals to Arabic. So \\\"II\\\" is 2, so interpretation \\\"2\\\". But wait, the rule says: \\\"For salary class: Convert roman numerals to arabic if clear. 'III' \u2192 '3', 'IV' \u2192 '4'\\\". However, the salary class is in \\\"Gehaltsklasse\\\" column, which is empty in both rows. Wait, in this case, the second row's Dienstliche Stellung is \\\"II\\\", but that's part of the position. Wait, no \u2013 the \\\"dienstliche_stellung\\\" column is for position, so \\\"II\\\" here is part of the position title, not the salary class.\\n\\nWait, maybe \\\"II\\\" here is the position? But that's unclear. Let's read the rules again.\\n\\nThe user's column definitions:\\n\\n1. dienstliche_stellung: Official position or job title (e.g., \\\"Assistent\\\", \\\"Professor\\\", \\\"Sekret\u00e4r\\\")\\n\\nSo if the position is \\\"II\\\", that's a bit odd. Maybe it's a typo, but according to the instructions, we have to transcribe exactly as written. So diplomatic_transcript is \\\"II\\\".\\n\\nInterpretation: the rule says for salary class (gehaltsklasse) convert Roman numerals to Arabic. But here, it's in the dienstliche_stellung column. So unless \\\"II\\\" is a salary class, which would be in the gehaltsklasse column. Wait, no. The second row has \\\"II\\\" in dienstliche_stellung, and gehaltsklasse is empty.\\n\\nSo, for dienstliche_stellung, the interpretation would be \\\"II\\\" as a position title. But maybe it's a typo. But according to the rules, we don't expand abbreviations, so interpretation is null unless it's a ditto mark.\\n\\nWait, the rule for interpretation says:\\n\\n- For ditto marks: replace with previous row's value.\\n\\nBut \\\"II\\\" is not a ditto mark. So interpretation would be null? Or is there a standard interpretation for positions?\\n\\nWait, the rule states: \\\"Use null if no interpretation/expansion is needed or if the field is empty.\\\"\\n\\nSo unless it's a case where a ditto mark is present, interpretation would be null. But since \\\"II\\\" is written as part of the position, perhaps it's a standard entry, but according to the rules, we don't expand abbreviations. So the interpretation would be null.\\n\\nWait, the example given in the rules for interpretation is only for specific cases like dates, salaries, salary class, and ditto marks. For position titles, since the user didn't specify expanding positions, perhaps interpretation is null.\\n\\nSo for the first row's dienstliche_stellung: \\\"Hilfsleiter\\\" \u2013 interpretation is \\\"Hilfsleiter\\\" (since it's a standard term, but the rule says not to expand abbreviations. Wait, but the rule says: \\\"Never expand abbreviations\\\". So if the position is \\\"Hilfsleiter\\\", which is a standard German term for \\\"Assistant\\\", but according to the rules, we don't expand. So interpretation is \\\"Hilfsleiter\\\". Wait, but the rules say for interpretation:\\n\\n\\\"For ditto marks (repetition marks such as `\\\"`): Replace with the actual repeated value from the previous row in the same column. Do NOT add explanatory text like \\\"wie oben\\\" or similar - just provide the repeated value.\\\"\\n\\nSo for positions that are expanded, but in this case, maybe \\\"Hilfsleiter\\\" is already the standard term, so no need to interpret.\\n\\nWait, the user says: \\\"interpretation or expansion of abbreviations and meanings\\\". So if the abbreviation is \\\"Hilfsleiter\\\", which is a full German term, then no expansion is needed. So interpretation would be \\\"Hilfsleiter\\\".\\n\\nBut in the case of the second row, \\\"II\\\" \u2013 is that an abbreviation? If it's \\\"II\\\" as a position, maybe it's \\\"II. Assist. Something\\\", but in the card it's written as \\\"II\\\". Since the user said not to expand abbreviations, interpretation would be null unless it's a ditto mark.\\n\\nWait, no. The user's example says that for ditto marks, we replace with previous value. But for other abbreviations, like a salary class \\\"III\\\", we convert to Arabic. But for position titles, if it's a standard term, perhaps no interpretation is needed.\\n\\nWait, but the second row's \\\"II\\\" is likely a typo or a specific entry. For example, in the first row, the position is \\\"Hilfsleiter\\\", and the second row has \\\"II\\\" in the same column. Maybe it's a mistake where the position was supposed to be the same as the previous row, but written as \\\"II\\\" (maybe a typo for \\\"Hilfsleiter\\\", but that doesn't make sense). Alternatively, perhaps \\\"II\\\" refers to the position as part of a higher title.\\n\\nBut according to the instructions, we must not expand abbreviations. So if the position is written as \\\"II\\\", then the interpretation is \\\"II\\\", but the user said to use null if no interpretation is needed. Wait, but the user says: \\\"interpretation can be null when no expansion/standardization applies\\\".\\n\\nIn the case of \\\"II\\\", since it's not a standard abbreviation that needs conversion (like Roman numerals to Arabic), but the salary class column does convert Roman numerals to Arabic. However, this is in the dienstliche_stellung column.\\n\\nWait, but the second row's Gehaltsklasse is empty, so the \\\"II\\\" is in the position column. Maybe it's an error. Let's proceed.\\n\\nAssuming that \\\"II\\\" is the actual value. So diplomatic_transcript is \\\"II\\\", interpretation is null (since there's no standard expansion), is_crossed_out false.\\n\\nWait, but maybe the \\\"II\\\" in the position column is actually a salary class. Wait, no. The columns are fixed: Dienstliche Stellung is position, Gehaltsklasse is salary class.\\n\\nWait, looking back, in the first row:\\n\\ndienstliche_stellung: Hilfsleiter\\n\\nGehaltsklasse: empty\\n\\nJahresgehalt: 3120.-- \\n\\nThen the second row:\\n\\ndienstliche_stellung: II\\n\\nGehaltsklasse: empty\\n\\nJahresgehalt: 4.415.--\\n\\nSo the \\\"II\\\" is in the position column. So it's a position title of \\\"II\\\", which might not make sense. But according to the instructions, we transcribe exactly as written, so interpretation would be null unless it's a ditto mark.\\n\\nWait, the user mentioned: \\\"For ditto marks (repetition marks such as `\\\"`), replace with the actual repeated value from the previous row in the same column\\\".\\n\\nIn the image, the second row's position is \\\"II\\\". But if it's written as a quote, like `\\\"` to indicate \\\"same as above\\\", but the problem is that in the image, it's written as \\\"II\\\" \u2013 perhaps the user made a mistake in the image transcription.\\n\\nAlternatively, maybe the second row's position is a ditto mark. Let me check again.\\n\\nThe image shows the second row's position as \\\"II\\\". But maybe it's written with a ditto mark, like `\\\"` followed by II, but perhaps in the original image, it's \\\"Hilfsleiter\\\" again with a ditto mark, but here it's mistyped.\\n\\nWait, the user's image description is:\\n\\nDienstliche Stellung | Dienstort | Gehaltsklasse | Jahresgehalt Monatsgehalt Taglohn | Zeitpunkt der Gehalts\u00e4nderung | Bemerkungen...\\n\\nFirst row:\\nHilfsleiter | [empty] | [empty] | 3120.-- | 22. Mai 1944 | [empty]\\n\\nSecond row:\\nII | [empty] | [empty] | 4.415.-- | 1. Januar 1945 | + Zulagen\\n\\nSo perhaps the second row's position is \\\"II\\\" (as in \\\"II. Hilfsleiter\\\" but truncated), but according to the rules, if it's a ditto mark, we replace with the previous value.\\n\\nBut since it's written as \\\"II\\\", not a quote mark, it's not a ditto mark. So interpretation is null.\\n\\nWait, but maybe \\\"II\\\" is a typo for the previous position. For example, maybe it's a ditto mark, but the user wrote \\\"II\\\" by mistake. But the instructions say to use the exact transcription.\\n\\nSo for now, proceed as per the given data.\\n\\nFor the second row's date:\\n\\n\\\"1. Januar 1945\\\" \u2192 interpretation \\\"1945-01-01\\\"\\n\\nSalary: \\\"4.415.--\\\" \u2192 interpretation \\\"4415\\\" (numeric value)\\n\\nBemerkungen: \\\"+ Zulagen\\\" \u2192 no ditto mark, so interpretation is \\\"+ Zulagen\\\" or null? Wait, the rule says interpretation is for expansion. Since it's a note like \\\"+ Zulagen\\\" (which means \\\"plus allowances\\\"), but according to the rules, \\\"Never expand abbreviations\\\". So interpretation should be null unless it's a ditto mark or specific conversion. So for remarks, interpretation is null.\\n\\nWait, but the user says: \\\"For remarks, notes, or additional comments\\\" \u2192 the interpretation is expanded/standardized. So if the remark is \\\"+ Zulagen\\\", which is an abbreviation, perhaps the interpretation is \\\"plus allowances\\\".\\n\\nBut according to the rules, \\\"Never expand abbreviations\\\", so interpretation should be null.\\n\\nWait, the rule says:\\n\\n\\\"interpretation or expansion of abbreviations and meanings\\\"\\n\\nBut the rule also says: \\\"Never expand abbreviations\\\"\\n\\nSo if a remark is \\\"+ Zulagen\\\", which is a standard abbreviation, but the user says not to expand. So interpretation is null.\\n\\nAlternatively, if \\\"Zulagen\\\" is a German term meaning allowances, but since the rule says not to expand, interpretation should be null.\\n\\nHmm. The user example for interpretation says: \\\"For ditto marks... Replace with the actual repeated value from the previous row in the same column. Do NOT add explanatory text like 'wie oben' or similar - just provide the repeated value.\\\"\\n\\nSo for remarks, if there's a standard term that needs expanding, but the user says not to expand, so interpretation is null.\\n\\nSo for \\\"bemerkungen\\\" in the second row: diplomatic_transcript is \\\"+ Zulagen\\\", interpretation is null.\\n\\nNow, let's process each field for each row.\\n\\nRow 1:\\n\\n- dienstliche_stellung: diplomatic_transcript \\\"Hilfsleiter\\\", interpretation \\\"Hilfsleiter\\\", is_crossed_out false.\\n- dienstort: \\\"\\\" (empty), interpretation null, is_crossed_out false.\\n- gehaltsklasse: \\\"\\\" (empty), interpretation null, is_crossed_out false.\\n- jahresgehalt_monatsgehalt_taglohn: \\\"3120.--\\\", interpretation \\\"3120\\\", is_crossed_out false.\\n- datum_gehalts\u00e4nderung: \\\"22. Mai 1944\\\", interpretation \\\"1944-05-22\\\", is_crossed_out false.\\n- bemerkungen: \\\"\\\", interpretation null, is_crossed_out false.\\n\\nRow 2:\\n\\n- dienstliche_stellung: diplomatic_transcript \\\"II\\\", interpretation \\\"II\\\" (but according to the salary class conversion rule, but this is in position column; maybe the rule for interpretation says to convert Roman numerals to Arabic only for salary class. So in this case, interpretation would be \\\"II\\\", since it's not salary class. Wait, no: the user's rule says: \\\"For salary class: Convert roman numerals to arabic if clear\\\". So if the salary class column has \\\"III\\\", convert to \\\"3\\\", but here the position column has \\\"II\\\". So for dienstliche_stellung, interpretation would be null unless it's a ditto mark.\\n\\nWait, the rule for interpretation: \\\"For salary class: Convert roman numerals to arabic if clear\\\". So only applies to gehaltsklasse. For other fields, like dienstliche_stellung, unless it's a ditto mark or specific format (like dates, salary amounts), interpretation is null.\\n\\nSo for row 2's dienstliche_stellung: diplomatic_transcript \\\"II\\\", interpretation null, is_crossed_out false.\\n\\nBut wait, the user example says for ditto marks, replace with previous value. But since it's not a ditto mark, interpretation is null.\\n\\nSimilarly for gehaltsklasse: both rows have empty, so interpretation null.\\n\\nJahresgehalt for row 2: \\\"4.415.--\\\" \u2192 \\\"4415\\\"\\n\\nDate: \\\"1. Januar 1945\\\" \u2192 \\\"1945-01-01\\\"\\n\\nBemerkungen: \\\"+ Zulagen\\\" \u2192 interpretation null.\\n\\nWait, but the user's rule for salary amounts says to extract numeric value. So for \\\"4.415.--\\\", it's 4415.\\n\\nAlso, check if the salary amount has separators like commas. But in this case, it's a dot: \\\"4.415.--\\\", so 4415.\\n\\nNow, check if any fields are crossed out. The image doesn't show any crossing out, so is_crossed_out is false for all.\\n\\nLet me verify each field:\\n\\nRow 1:\\n\\ndienstliche_stellung: \\\"Hilfsleiter\\\" \u2192 not crossed out.\\n\\ndienstort: empty \u2192 is_crossed_out false.\\n\\ngehaltsklasse: empty \u2192 false.\\n\\njahresgehalt: \\\"3120.--\\\" \u2192 not crossed out.\\n\\ndatum_gehalts\u00e4nderung: \\\"22. Mai 1944\\\" \u2192 no crossing.\\n\\nbemerkungen: empty.\\n\\nRow 2:\\n\\ndienstliche_stellung: \\\"II\\\" \u2192 not crossed.\\n\\ndienstort: empty.\\n\\ngehaltsklasse: empty.\\n\\njahresgehalt: \\\"4.415.--\\\" \u2192 not crossed.\\n\\ndatum: \\\"1. Januar 1945\\\" \u2192 no crossing.\\n\\nbemerkungen: \\\"+ Zulagen\\\" \u2192 not crossed.\\n\\nNow, process the interpretation:\\n\\nRow 1:\\n\\n- jahresgehalt_monatsgehalt_taglohn: \\\"3120.\\\" \u2192 interpretation \\\"3120\\\"\\n\\n- datum_gehalts\u00e4nderung: \\\"22. Mai 1944\\\" \u2192 \\\"1944-05-22\\\"\\n\\nRow 2:\\n\\n- jahresgehalt_monatsgehalt_taglohn: \\\"4.415.--\\\" \u2192 \\\"4415\\\"\\n\\n- datum_gehalts\u00e4nderung: \\\"1. Januar 1945\\\" \u2192 \\\"1945-01-01\\\"\\n\\nNow, check the salary class. In row 1, gehaltsklasse is empty, so interpretation null. Same for row 2.\\n\\nWait, but the user's column definition says gehaltsklasse is salary class. In the image, both rows have empty gehaltsklasse, so for both rows, gehaltsklasse fields will have diplomatic_transcript as empty string, interpretation null, is_crossed_out false.\\n\\nNow, about the second row's \\\"II\\\" in dienstliche_stellung: is there a possibility that it's a ditto mark? For example, if the \\\"II\\\" was written as a quote (\\\") followed by \\\"Hilfsleiter\\\", but in the image, it's written as \\\"II\\\". However, according to the problem statement, if it's a ditto mark (like `\\\"`), replace with previous value. But if it's written as \\\"II\\\", then no.\\n\\nGiven the image's description, it's written as \\\"II\\\", so diplomatic_transcript is \\\"II\\\".\\n\\nInterpretation: since it's not a ditto mark and not part of salary class (which is a separate column), interpretation would be null.\\n\\nWait, but maybe \\\"II\\\" here is a typo for \\\"Hilfsleiter\\\", and the \\\"II\\\" is a mistake. However, per the instructions, we must transcribe exactly as written. So \\\"II\\\" is the diplomatic_transcript.\\n\\nNow, for the first row's dienstliche_stellung, \\\"Hilfsleiter\\\" is the correct value, and the second row's is \\\"II\\\".\\n\\nNow, constructing the JSON.\\n\\nRows:\\n\\nRow 1: row_number 1\\n\\nRow 2: row_number 2\\n\\nNow, check if any empty rows exist. The image shows two rows with data, so two rows.\\n\\nEach row must have all fields filled with their respective sub-fields.\\n\\nLet me structure each row.\\n\\nRow 1:\\n\\ndienstliche_stellung:\\n\\n- diplomatic_transcript: \\\"Hilfsleiter\\\"\\n\\n- interpretation: \\\"Hilfsleiter\\\" (but according to the rules, do we expand? The rule says \\\"Never expand abbreviations\\\". So if \\\"Hilfsleiter\\\" is a full term, no expansion. However, the user example says for interpretation, \\\"For ditto marks...\\\". But here, it's a normal entry. The user says: \\\"Use null if no interpretation/expansion is needed or if the field is empty.\\\"\\n\\nWait, the interpretation for dienstliche_stellung would be null unless there's a specific reason to interpret (like ditto marks or salary conversions). So perhaps \\\"Hilfsleiter\\\" should have interpretation as null. Wait, this is a critical point.\\n\\nWait, looking at the user's example:\\n\\nThe required JSON structure shows that for the jahresgehalt_monatsgehalt_taglohn field, interpretation is \\\"standardized numeric form or null\\\".\\n\\nSimilarly, for datum_gehalts\u00e4nderung, interpretation is ISO format.\\n\\nFor salary class, convert Roman numerals to Arabic.\\n\\nFor ditto marks, replace with previous value.\\n\\nFor other fields (dienstliche_stellung, dienstort, bemerkungen), interpretation is null unless it's a ditto mark or specific conversion.\\n\\nSo for \\\"dienstliche_stellung\\\", if there's a ditto mark (e.g., `\\\"`), replace with previous row's value. Otherwise, interpretation is null.\\n\\nTherefore, for row 1's dienstliche_stellung: \\\"Hilfsleiter\\\" \u2192 interpretation null.\\n\\nFor row 2's dienstliche_stellung: \\\"II\\\" \u2192 interpretation null.\\n\\nWait, but the example says for interpretation: \\\"For ditto marks (repetition marks such as `\\\"`): Replace with the actual repeated value from the previous row in the same column. Do NOT add explanatory text like \\\"wie oben\\\" or similar - just provide the repeated value.\\\"\\n\\nSo if the current row's dienstliche_stellung is a ditto mark, then it's replaced with the previous value. But if it's written as \\\"II\\\", then it's not a ditto mark, so interpretation is null.\\n\\nThus, for row 1: dienstliche_stellung interpretation is null.\\n\\nBut wait, the user's column definition says \\\"dienstliche_stellung\\\": Official position/job title. So \\\"Hilfsleiter\\\" is a proper German title, so the interpretation would be the same. But according to the rules, \\\"Never expand abbreviations\\\". So if the entry is already expanded (not an abbreviation), then interpretation is null.\\n\\nAh, the key is whether the field's value is an abbreviation that needs expanding. For example, if it's \\\"Prof.\\\" for \\\"Professor\\\", then interpretation would be \\\"Professor\\\". But if it's \\\"Hilfsleiter\\\" (which is the full term), then no expansion is needed, so interpretation is null.\\n\\nWait, but the user's example for interpretation includes the case where for salary class, Roman numerals are converted to Arabic. So for fields that have specific conventions (like salary class, dates, salary amounts), interpretation is done. For others, only if it's a ditto mark.\\n\\nSo for dienstliche_stellung, unless it's a ditto mark or a specific abbreviation (like \\\"Prof.\\\"), interpretation is null.\\n\\nTherefore, for row 1's position \\\"Hilfsleiter\\\", interpretation is null.\\n\\nSimilarly, row 2's \\\"II\\\" is not a ditto mark, so interpretation null.\\n\\nWait, but the problem states that the \\\"interpretation\\\" field is optional, with null if not applicable.\\n\\nSo let's re-examine:\\n\\nFor each field:\\n\\n- dienstliche_stellung: diplomatic_transcript is exact. If it's a ditto mark, replace with previous. Otherwise, interpretation is null.\\n\\n- Similarly, dienstort: if empty or not ditto, null.\\n\\nBut in this case, the fields are:\\n\\nRow 1:\\n\\ndienstliche_stellung: \\\"Hilfsleiter\\\" \u2192 not a ditto mark. So interpretation null.\\n\\nRow 2:\\n\\ndienstliche_stellung: \\\"II\\\" \u2192 not a ditto mark \u2192 interpretation null.\\n\\nBut wait, the second row's \\\"II\\\" is possibly a ditto mark. For example, if it's written as `\\\"` followed by \\\"II\\\", but in the problem statement, the image shows \\\"II\\\". However, according to the image description given by the user, it's written as \\\"II\\\", not a quote mark. So it's considered a separate entry.\\n\\nSo in this case, interpretation for dienstliche_stellung is null.\\n\\nWait, but if it's written as a repeat (ditto mark), the user's example shows that the interpretation should be the previous row's value. But since it's written as \\\"II\\\", not a quote mark, it's not a ditto.\\n\\nNow, for the jahresgehalt_monatsgehalt_taglohn:\\n\\nRow 1: \\\"3120.--\\\" \u2192 interpretation \\\"3120\\\"\\n\\nRow 2: \\\"4.415.--\\\" \u2192 \\\"4415\\\"\\n\\nDatum_gehalts\u00e4nderung:\\n\\nRow 1: \\\"22. Mai 1944\\\" \u2192 \\\"1944-05-22\\\"\\n\\nRow 2: \\\"1. Januar 1945\\\" \u2192 \\\"1945-01-01\\\"\\n\\nBemerkungen:\\n\\nRow 2 has \\\"+ Zulagen\\\" \u2192 interpretation null.\\n\\nNow, the salary class (gehaltsklasse) is empty in both rows, so interpretation null.\\n\\nNow, compiling all this into the JSON.\\n\\nLet me check each row's structure.\\n\\nRow 1:\\n\\n- row_number: 1\\n\\n- dienstliche_stellung: { \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- dienstort: { \\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- gehaltsklasse: { \\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- jahresgehalt_monatsgehalt_taglohn: { \\\"diplomatic_transcript\\\": \\\"3120.--\\\", \\\"interpretation\\\": \\\"3120\\\", \\\"is_crossed_out\\\": false }\\n\\n- datum_gehalts\u00e4nderung: { \\\"diplomatic_transcript\\\": \\\"22. Mai 1944\\\", \\\"interpretation\\\": \\\"1944-05-22\\\", \\\"is_crossed_out\\\": false }\\n\\n- bemerkungen: { \\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\nRow 2:\\n\\n- row_number: 2\\n\\n- dienstliche_stellung: { \\\"diplomatic_transcript\\\": \\\"II\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- dienstort: { \\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- gehaltsklasse: { \\\"diplomatic_transcript\\\": \\\"\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\n- jahresgehalt_monatsgehalt_taglohn: { \\\"diplomatic_transcript\\\": \\\"4.415.--\\\", \\\"interpretation\\\": \\\"4415\\\", \\\"is_crossed_out\\\": false }\\n\\n- datum_gehalts\u00e4nderung: { \\\"diplomatic_transcript\\\": \\\"1. Januar 1945\\\", \\\"interpretation\\\": \\\"1945-01-01\\\", \\\"is_crossed_out\\\": false }\\n\\n- bemerkungen: { \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\", \\\"interpretation\\\": null, \\\"is_crossed_out\\\": false }\\n\\nNow, verifying all fields have diplomatic_transcript as required.\\n\\nFor example, in row 2's bemerkungen, diplomatic_transcript is \\\"+ Zulagen\\\" \u2013 which is the exact string.\\n\\nCheck if the dates are correctly converted.\\n\\nFor datum_gehalts\u00e4nderung, \\\"22. Mai 1944\\\" \u2192 May is the 5th month, so 1944-05-22.\\n\\n\\\"1. Januar 1945\\\" \u2192 January is month 1, so 1945-01-01.\\n\\nSalary amounts:\\n\\n\\\"3120.--\\\" \u2192 remove currency and separators \u2192 \\\"3120\\\"\\n\\n\\\"4.415.--\\\" \u2192 \\\"4415\\\"\\n\\nNow, check if the interpretation for salary class is correct. The Gehaltsklasse column is empty in both rows, so interpretation null.\\n\\nCheck for crossed out: none are crossed out in the image, so is_crossed_out is false for all.\\n\\nNow, constructing the JSON:\\n\\n[\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3120.--\\\",\\n \\\"interpretation\\\": \\\"3120\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"22. Mai 1944\\\",\\n \\\"interpretation\\\": \\\"1944-05-22\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"II\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4.415.--\\\",\\n \\\"interpretation\\\": \\\"4415\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Januar 1945\\\",\\n \\\"interpretation\\\": \\\"1945-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n]\\n\\nWait, but in the problem statement's example, the interpretation for salary amounts is a string like \\\"3120\\\", but the user said \\\"standardized numeric form or null\\\".\\n\\nYes, \\\"3120\\\" is correct.\\n\\nSimilarly, for the second row's salary amount, \\\"4.415.--\\\" \u2192 \\\"4415\\\".\\n\\nAlso, the date formatting.\\n\\nNow, check if all required fields are present.\\n\\nThe schema requires that all fields have diplomatic_transcript, interpretation, is_crossed_out.\\n\\nYes, for each row, all seven fields are present.\\n\\nIn the output, the rows are in order, numbered from 1.\\n\\nThe JSON should be a list of rows, each as described.\\n\\nNow, one possible error: the user mentioned that the second row's position is \\\"II\\\", but maybe it's a typo and should be a ditto mark. However, given the instructions, we have to take the exact transcription.\\n\\nAnother point: in row 2's jahresgehalt, the amount is \\\"4.415.--\\\", which should be \\\"4415\\\", but the correct numeric value is 4415 (since 4.415 is 4,415 in European formatting, which is 4415 without the decimal separator).\\n\\nYes, the rule says: \\\"For salary amounts: Extract numeric value only (remove currency symbols, separators)\\\"\\n\\nSo \\\"4.415.--\\\" \u2192 remove the dot (separator) \u2192 \\\"4415\\\".\\n\\nSimilarly, \\\"3120.--\\\" \u2192 \\\"3120\\\".\\n\\nNow, the final JSON should have these values.\\n\\nI think this covers all requirements.\\n\"}]},\"native_finish_reason\":\"stop\"}],\"created\":1770654889,\"model\":\"qwen/qwen3-vl-8b-thinking\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":9058,\"prompt_tokens\":5243,\"total_tokens\":14301,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":null,\"reasoning_tokens\":8505,\"rejected_prediction_tokens\":null,\"image_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":0,\"video_tokens\":0},\"cost\":0.01996554,\"is_byok\":false,\"cost_details\":{\"upstream_inference_cost\":null,\"upstream_inference_prompt_cost\":0.00094374,\"upstream_inference_completions_cost\":0.0190218}},\"provider\":\"Alibaba\"}"}, "scoring": {"f1_micro": 0.8967957538824454, "f1_macro": 0.8544262295081967, "micro_precision": 0.8878941222265473, "micro_recall": 0.9058776806989675, "total_instances": 61, "total_tp": 2281, "total_fp": 288, "total_fn": 237, "cost_summary": {"total_input_tokens": 319122, "total_output_tokens": 516656, "total_tokens": 835778, "input_cost_usd": 0.0, "output_cost_usd": 0.0, "total_cost_usd": 0.0}}, "normalized_score": 89.67957538824453}, {"_id": {"$oid": "69d4eb12b877594bc5718c44"}, "test_id": "T0579", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "anthropic", "model": "claude-opus-4-5-20251101", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Dez. 45\",\"interpretation\":\"1945-12-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "claude-opus-4-5-20251101", "provider": "anthropic", "finish_reason": "tool_use", "usage": {"input_tokens": 4027, "output_tokens": 244, "total_tokens": 4271, "input_cost_usd": 0.020135, "output_cost_usd": 0.0060999999999999995, "estimated_cost_usd": 0.026235}, "duration": 4.786287546157837, "timestamp": "2026-02-09T17:11:43.113098", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Dez. 45", "interpretation": "1945-12-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "cec212e7-b2e0-4586-b696-f6b06dfed461", "score": {"f1_score": 1.0, "precision": 1.0, "recall": 1.0, "true_positives": 12, "false_positives": 0, "false_negatives": 0, "field_scores": {"rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-12-01", "ground_truth": "1945-12-01", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": "3700", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Dez. 45", "ground_truth": "1. Dez. 45", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3700.-", "ground_truth": "3700.-", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 19}, "raw_response": "{\"id\":\"msg_01WTpRva8XSFZbWwmZWFRhnQ\",\"content\":[{\"id\":\"toolu_01RW1WcEpbJZbywURon1nhiv\",\"input\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Dez. 45\",\"interpretation\":\"1945-12-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]},\"name\":\"extract_structured_data\",\"type\":\"tool_use\"}],\"model\":\"claude-opus-4-5-20251101\",\"role\":\"assistant\",\"stop_reason\":\"tool_use\",\"stop_sequence\":null,\"type\":\"message\",\"usage\":{\"cache_creation\":{\"ephemeral_1h_input_tokens\":0,\"ephemeral_5m_input_tokens\":0},\"cache_creation_input_tokens\":0,\"cache_read_input_tokens\":0,\"input_tokens\":4027,\"output_tokens\":244,\"server_tool_use\":null,\"service_tier\":\"standard\",\"inference_geo\":\"not_available\"}}"}, "scoring": {"f1_micro": 0.9112130054189245, "f1_macro": 0.8904918032786885, "micro_precision": 0.9587719298245614, "micro_recall": 0.8681493248610008, "total_instances": 61, "total_tp": 2186, "total_fp": 94, "total_fn": 332, "cost_summary": {"total_input_tokens": 245626, "total_output_tokens": 45669, "total_tokens": 291295, "input_cost_usd": 1.2281300000000004, "output_cost_usd": 1.1417250000000003, "total_cost_usd": 2.3698550000000003}}, "normalized_score": 91.12130054189245}, {"_id": {"$oid": "69d4eb12b877594bc5718c45"}, "test_id": "T0596", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "mistral", "model": "magistral-small-2509", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Assistent\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Assistent\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'600.-\",\"interpretation\":\"2600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. April 1946\",\"interpretation\":\"1946-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Bef\u00f6rderung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Oberassistent\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"~Oberassistent\",\"interpretation\":null,\"is_crossed_out\":true},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Streichung\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "magistral-small-2509", "provider": "mistral", "finish_reason": "stop", "usage": {"input_tokens": 1810, "output_tokens": 1139, "total_tokens": 2949, "input_cost_usd": 0.000905, "output_cost_usd": 0.0005695, "estimated_cost_usd": 0.0014745000000000001}, "duration": 4.707181215286255, "timestamp": "2026-02-09T17:31:58.580693", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Assistent", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'400.-", "interpretation": "2400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Assistent", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'600.-", "interpretation": "2600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. April 1946", "interpretation": "1946-04-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Bef\u00f6rderung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "Oberassistent", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "~Oberassistent", "interpretation": null, "is_crossed_out": true}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Streichung", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "0ea3d067-eee7-4763-b9fc-8a744f8126c5", "score": {"f1_score": 0.38, "precision": 0.3050847457627119, "recall": 0.5142857142857142, "true_positives": 18, "false_positives": 41, "false_negatives": 17, "field_scores": {"rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": "6. April 1943", "score": 0.48}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'400.-", "ground_truth": "3340.-", "score": 0.4705882352941176}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'600.-", "ground_truth": "3460.-", "score": 0.4705882352941176}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": "1. Januar 1945", "score": 0.7692307692307692}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. April 1946", "ground_truth": "1. Feb. 1944", "score": 0.56}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": true, "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'700.-", "ground_truth": "4.830.--", "score": 0.5263157894736843}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "~Oberassistent", "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Hilfsleiter", "score": 0.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Assistent", "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1945-01-01", "score": 0.9}, "rows[2].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-04-01", "ground_truth": "1944-02-01", "score": 0.8}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'700.-", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "Streichung", "ground_truth": null, "score": 0.0}, "rows[2].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2600", "ground_truth": "3460", "score": 0.5}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Assistent", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "Bef\u00f6rderung", "ground_truth": "(inkl.400.- tech.Zl.)", "score": 0.0625}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2400", "ground_truth": "3340", "score": 0.5}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": "4830", "score": 0.5}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "Oberassistent", "ground_truth": "\"", "score": 0.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1943-04-06", "score": 0.7}, "rows[1].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "Hilfsleiter", "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 76}, "raw_response": "{\"id\":\"3da4643f6e67405a8458bd156b200859\",\"object\":\"chat.completion\",\"model\":\"magistral-small-2509\",\"usage\":{\"prompt_tokens\":1810,\"completion_tokens\":1139,\"total_tokens\":2949,\"num_cached_tokens\":1920},\"created\":1770654708,\"choices\":[{\"index\":0,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Assistent\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'400.-\\\",\\n \\\"interpretation\\\": \\\"2400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Assistent\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'600.-\\\",\\n \\\"interpretation\\\": \\\"2600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. April 1946\\\",\\n \\\"interpretation\\\": \\\"1946-04-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bef\u00f6rderung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Oberassistent\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1947\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"~Oberassistent\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": true\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1947\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Streichung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"tool_calls\":null,\"prefix\":false,\"role\":\"assistant\"},\"finish_reason\":\"stop\"}]}"}, "scoring": {"f1_micro": 0.25261261261261264, "f1_macro": 0.21016393442622952, "micro_precision": 0.2312005277044855, "micro_recall": 0.278395552025417, "total_instances": 61, "total_tp": 701, "total_fp": 2331, "total_fn": 1817, "cost_summary": {"total_input_tokens": 110410, "total_output_tokens": 56291, "total_tokens": 166701, "input_cost_usd": 0.055205000000000067, "output_cost_usd": 0.028145500000000004, "total_cost_usd": 0.08335049999999995}}, "normalized_score": 25.261261261261264}, {"_id": {"$oid": "69d4eb12b877594bc5718c46"}, "test_id": "T0588", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "genai", "model": "gemini-2.5-flash", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3.000.-\",\"interpretation\":\"3000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"7. Mai 1945\",\"interpretation\":\"1945-05-07\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3088.-\",\"interpretation\":\"3088\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3238.-\",\"interpretation\":\"3238\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1946\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3388.-\",\"interpretation\":\"3388\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gemini-2.5-flash", "provider": "genai", "finish_reason": "STOP", "usage": {"input_tokens": 1483, "output_tokens": 1152, "total_tokens": 4278, "input_cost_usd": 0.00044489999999999997, "output_cost_usd": 0.00288, "estimated_cost_usd": 0.0033249}, "duration": 11.745630979537964, "timestamp": "2026-02-09T16:46:35.894156", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3.000.-", "interpretation": "3000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "7. Mai 1945", "interpretation": "1945-05-07", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3088.-", "interpretation": "3088", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3238.-", "interpretation": "3238", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1946", "interpretation": "1946-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3388.-", "interpretation": "3388", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "955bba2b-a71e-43a2-830a-a9f7a6fd5365", "score": {"f1_score": 0.97, "precision": 0.9777777777777777, "recall": 0.9565217391304348, "true_positives": 44, "false_positives": 1, "false_negatives": 2, "field_scores": {"rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": "1. Jan. 1946", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": "Hilfsleiterin", "score": 0.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3000", "ground_truth": "3000", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-05-07", "ground_truth": "1945-05-07", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3088.-", "ground_truth": "3088.-", "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1946-01-01", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1946", "ground_truth": "1. Juli 1946", "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "7. Mai 1945", "ground_truth": "7. Mai 1945", "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3088", "ground_truth": "3088", "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3238", "ground_truth": "3238", "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3388", "ground_truth": "3388", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-07-01", "ground_truth": "1946-07-01", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3.000.-", "ground_truth": "3.000.-", "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilflsieterin", "score": 0.8461538461538461}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3388.-", "ground_truth": "3388.-", "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3238.-", "ground_truth": "3238.-", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": "1. Jan. 1947", "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}}, "total_fields": 76}, "raw_response": "{\"sdk_http_response\":{\"headers\":{\"content-type\":\"application/json; charset=UTF-8\",\"vary\":\"Origin, X-Origin, Referer\",\"content-encoding\":\"gzip\",\"date\":\"Mon, 09 Feb 2026 15:46:29 GMT\",\"server\":\"scaffolding on HTTPServer2\",\"x-xss-protection\":\"0\",\"x-frame-options\":\"SAMEORIGIN\",\"x-content-type-options\":\"nosniff\",\"server-timing\":\"gfet4t7; dur=11599\",\"alt-svc\":\"h3=\\\":443\\\"; ma=2592000,h3-29=\\\":443\\\"; ma=2592000\",\"transfer-encoding\":\"chunked\"},\"body\":null},\"candidates\":[{\"content\":{\"parts\":[{\"video_metadata\":null,\"thought\":null,\"inline_data\":null,\"file_data\":null,\"thought_signature\":null,\"function_call\":null,\"code_execution_result\":null,\"executable_code\":null,\"function_response\":null,\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3.000.-\\\",\\n \\\"interpretation\\\": \\\"3000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"7. Mai 1945\\\",\\n \\\"interpretation\\\": \\\"1945-05-07\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3088.-\\\",\\n \\\"interpretation\\\": \\\"3088\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3238.-\\\",\\n \\\"interpretation\\\": \\\"3238\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1946\\\",\\n \\\"interpretation\\\": \\\"1946-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3388.-\\\",\\n \\\"interpretation\\\": \\\"3388\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1947\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\"}],\"role\":\"model\"},\"citation_metadata\":null,\"finish_message\":null,\"token_count\":null,\"finish_reason\":\"STOP\",\"url_context_metadata\":null,\"avg_logprobs\":null,\"grounding_metadata\":null,\"index\":0,\"logprobs_result\":null,\"safety_ratings\":null}],\"create_time\":null,\"model_version\":\"gemini-2.5-flash\",\"prompt_feedback\":null,\"response_id\":\"VQGKaYOyMtSgnsEPoMmOiQU\",\"usage_metadata\":{\"cache_tokens_details\":[{\"modality\":\"IMAGE\",\"token_count\":236},{\"modality\":\"TEXT\",\"token_count\":1124}],\"cached_content_token_count\":1360,\"candidates_token_count\":1152,\"candidates_tokens_details\":null,\"prompt_token_count\":1483,\"prompt_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":1225},{\"modality\":\"IMAGE\",\"token_count\":258}],\"thoughts_token_count\":1643,\"tool_use_prompt_token_count\":null,\"tool_use_prompt_tokens_details\":null,\"total_token_count\":4278,\"traffic_type\":null},\"automatic_function_calling_history\":[],\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3.000.-\",\"interpretation\":\"3000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"7. Mai 1945\",\"interpretation\":\"1945-05-07\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3088.-\",\"interpretation\":\"3088\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3238.-\",\"interpretation\":\"3238\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1946\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3388.-\",\"interpretation\":\"3388\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}"}, "scoring": {"f1_micro": 0.9540957657301147, "f1_macro": 0.9024590163934426, "micro_precision": 0.9507097791798107, "micro_recall": 0.9575059571088165, "total_instances": 61, "total_tp": 2411, "total_fp": 125, "total_fn": 107, "cost_summary": {"total_input_tokens": 90463, "total_output_tokens": 60064, "total_tokens": 150527, "input_cost_usd": 0.027138900000000035, "output_cost_usd": 0.15016000000000002, "total_cost_usd": 0.17729889999999993}}, "normalized_score": 95.40957657301146}, {"_id": {"$oid": "69d4eb12b877594bc5718c48"}, "test_id": "T0616", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openrouter", "model": "meta-llama/llama-4-maverick", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Koch\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"3. Dez. 45\",\"interpretation\":\"1945-12-03\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "meta-llama/llama-4-maverick", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 3998, "output_tokens": 257, "total_tokens": 4255, "estimated_cost_usd": 0.0007539}, "duration": 8.31207823753357, "timestamp": "2026-02-09T16:29:11.630014", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Koch", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "3. Dez. 45", "interpretation": "1945-12-03", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "daedb662-b100-4527-9101-3df3e01291cb", "score": {"f1_score": 1.0, "precision": 1.0, "recall": 1.0, "true_positives": 12, "false_positives": 0, "false_negatives": 0, "field_scores": {"rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4600.-", "ground_truth": "4600.-", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Koch", "ground_truth": "Koch", "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4600", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "3. Dez. 45", "ground_truth": "3. Dez. 45", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-12-03", "ground_truth": "1945-12-03", "score": 1.0}}, "total_fields": 19}, "raw_response": "{\"id\":\"gen-1770650941-V74cfqXNVFx7JWiI8EqT\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Koch\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4600.-\\\",\\n \\\"interpretation\\\": \\\"4600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3. Dez. 45\\\",\\n \\\"interpretation\\\": \\\"1945-12-03\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":null,\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"reasoning\":null},\"native_finish_reason\":\"stop\"}],\"created\":1770650941,\"model\":\"meta-llama/llama-4-maverick\",\"object\":\"chat.completion\",\"service_tier\":null,\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":257,\"prompt_tokens\":3998,\"total_tokens\":4255,\"completion_tokens_details\":{\"accepted_prediction_tokens\":null,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":null},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":0},\"cost\":0.0007539,\"is_byok\":false,\"cost_details\":{\"upstream_inference_cost\":0.0007539,\"upstream_inference_prompt_cost\":0.0005997,\"upstream_inference_completions_cost\":0.0001542}},\"provider\":\"DeepInfra\"}"}, "scoring": {"f1_micro": 0.8891950403463884, "f1_macro": 0.8578688524590163, "micro_precision": 0.8813889972688256, "micro_recall": 0.8971405877680699, "total_instances": 61, "total_tp": 2259, "total_fp": 304, "total_fn": 259, "cost_summary": {"total_input_tokens": 211334, "total_output_tokens": 50609, "total_tokens": 261943, "input_cost_usd": 0.0, "output_cost_usd": 0.0, "total_cost_usd": 0.00984585}}, "normalized_score": 88.91950403463883}, {"_id": {"$oid": "69d4eb12b877594bc5718c49"}, "test_id": "T0614", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5.2-2025-12-11", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"-\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'200.-\",\"interpretation\":\"2200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"31. Okt. 1943\",\"interpretation\":\"1943-10-31\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'225.-\",\"interpretation\":\"2225\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'565.--\",\"interpretation\":\"3565\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"20. M\u00e4rz 1945\",\"interpretation\":\"1945-03-20\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen (Wiedereintritt.)\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gpt-5.2-2025-12-11", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 4001, "output_tokens": 536, "total_tokens": 4537, "cached_tokens": 1536, "input_cost_usd": 0.00700175, "output_cost_usd": 0.007504, "estimated_cost_usd": 0.014505750000000001}, "duration": 7.932536363601685, "timestamp": "2026-02-09T23:54:29.212378", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "-", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'200.-", "interpretation": "2200", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "31. Okt. 1943", "interpretation": "1943-10-31", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'225.-", "interpretation": "2225", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'565.--", "interpretation": "3565", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "20. M\u00e4rz 1945", "interpretation": "1945-03-20", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen (Wiedereintritt.)", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "c223ea57-81d9-4880-9e73-b5c914e9b437", "score": {"f1_score": 0.92, "precision": 0.918918918918919, "recall": 0.918918918918919, "true_positives": 34, "false_positives": 3, "false_negatives": 3, "field_scores": {"rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'225.-", "ground_truth": "2.225.-", "score": 0.8571428571428572}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "31. Okt. 1943", "ground_truth": "31. Okt. 1943", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-10-31", "ground_truth": "1943-10-31", "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen (Wiedereintritt.)", "ground_truth": "+ Zulagen (Wiedereintritt)", "score": 0.9811320754716981}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "-", "ground_truth": "-", "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2225", "ground_truth": "2225", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2200", "ground_truth": "2200", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "20. M\u00e4rz 1945", "ground_truth": "20. M\u00e4rz 1945", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-03-20", "ground_truth": "1945-03-20", "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'565.--", "ground_truth": "3.565.--", "score": 0.875}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3565", "ground_truth": "3565", "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'200.-", "ground_truth": "2.200.-", "score": 0.8571428571428572}}, "total_fields": 57}, "raw_response": "{\"id\":\"chatcmpl-D7UR4QbA6gc0S99HH2cDsv4XLpujm\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"-\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'200.-\\\",\\\"interpretation\\\":\\\"2200\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"31. Okt. 1943\\\",\\\"interpretation\\\":\\\"1943-10-31\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiterin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'225.-\\\",\\\"interpretation\\\":\\\"2225\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 1944\\\",\\\"interpretation\\\":\\\"1944-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":3,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiterin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3'565.--\\\",\\\"interpretation\\\":\\\"3565\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"20. M\u00e4rz 1945\\\",\\\"interpretation\\\":\\\"1945-03-20\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen (Wiedereintritt.)\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"-\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'200.-\",\"interpretation\":\"2200\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"31. Okt. 1943\",\"interpretation\":\"1943-10-31\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'225.-\",\"interpretation\":\"2225\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'565.--\",\"interpretation\":\"3565\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"20. M\u00e4rz 1945\",\"interpretation\":\"1945-03-20\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen (Wiedereintritt.)\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1770677662,\"model\":\"gpt-5.2-2025-12-11\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":536,\"prompt_tokens\":4001,\"total_tokens\":4537,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1536}}}"}, "scoring": {"f1_micro": 0.953465920061788, "f1_macro": 0.9040983606557377, "micro_precision": 0.9510785824345146, "micro_recall": 0.9558652729384437, "total_instances": 61, "total_tp": 2469, "total_fp": 127, "total_fn": 114, "cost_summary": {"total_input_tokens": 243335, "total_output_tokens": 40005, "total_tokens": 283340, "input_cost_usd": 0.4258362500000001, "output_cost_usd": 0.56007, "total_cost_usd": 0.98590625}}, "normalized_score": 95.3465920061788}, {"_id": {"$oid": "69d4eb12b877594bc5718c4a"}, "test_id": "T0589", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "genai", "model": "gemini-2.5-flash-lite", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\u2014\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'800.-\",\"interpretation\":\"3800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"16. Nov. 1942\",\"interpretation\":\"1942-11-16\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.500.\u2014 techn. Z.\",\"interpretation\":\"inkl.500.\u2014 techn. Z.\",\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"''\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"''\",\"interpretation\":\"\u2014\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"''\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'815.-\",\"interpretation\":\"3815\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1943\",\"interpretation\":\"1943-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.500.\u2014 techn. Z.\",\"interpretation\":\"inkl.500.\u2014 techn. Z.\",\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Techn. Lagerleiter\",\"interpretation\":\"Techn. Lagerleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"''\",\"interpretation\":\"\u2014\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"''\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'415.-\",\"interpretation\":\"4415\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juni 1943\",\"interpretation\":\"1943-06-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.500.\u2014 techn. Z.\",\"interpretation\":\"inkl.500.\u2014 techn. Z.\",\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"''\",\"interpretation\":\"Techn. Lagerleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"''\",\"interpretation\":\"\u2014\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"''\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'635.-\",\"interpretation\":\"4635\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.500.\u2014 techn. Z.\",\"interpretation\":\"inkl.500.\u2014 techn. Z.\",\"is_crossed_out\":false}}]}", "model": "gemini-2.5-flash-lite", "provider": "genai", "finish_reason": "STOP", "usage": {"input_tokens": 1483, "output_tokens": 1260, "total_tokens": 2743, "input_cost_usd": 0.0001483, "output_cost_usd": 0.000504, "estimated_cost_usd": 0.0006523}, "duration": 3.9526612758636475, "timestamp": "2026-02-09T16:49:37.240287", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\u2014", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'800.-", "interpretation": "3800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "16. Nov. 1942", "interpretation": "1942-11-16", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl.500.\u2014 techn. Z.", "interpretation": "inkl.500.\u2014 techn. Z.", "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "''", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "''", "interpretation": "\u2014", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "''", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'815.-", "interpretation": "3815", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1943", "interpretation": "1943-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl.500.\u2014 techn. Z.", "interpretation": "inkl.500.\u2014 techn. Z.", "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "Techn. Lagerleiter", "interpretation": "Techn. Lagerleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "''", "interpretation": "\u2014", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "''", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'415.-", "interpretation": "4415", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juni 1943", "interpretation": "1943-06-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl.500.\u2014 techn. Z.", "interpretation": "inkl.500.\u2014 techn. Z.", "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "''", "interpretation": "Techn. Lagerleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "''", "interpretation": "\u2014", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "''", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'635.-", "interpretation": "4635", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "inkl.500.\u2014 techn. Z.", "interpretation": "inkl.500.\u2014 techn. Z.", "is_crossed_out": false}}]}, "conversation_id": "0cf87247-ef6e-427c-b5cf-073baa0b3fb5", "score": {"f1_score": 0.8, "precision": 0.7121212121212122, "recall": 0.9038461538461539, "true_positives": 47, "false_positives": 19, "false_negatives": 5, "field_scores": {"rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1942-11-16", "ground_truth": "1942-11-16", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4415", "ground_truth": "4415", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'800.-", "ground_truth": "3'800.-", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'815.-", "ground_truth": "3'815.-", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "16. Nov. 1942", "ground_truth": "16. Nov. 1942", "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "''", "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4635", "ground_truth": "4635", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "''", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "inkl.500.\u2014 techn. Z.", "ground_truth": "inkl. 500.- techn. Z.", "score": 0.926829268292683}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": "inkl.500.\u2014 techn. Z.", "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Techn. Lagerleiter", "ground_truth": "Technischer Lagerleiter", "score": 0.8292682926829268}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'635.-", "ground_truth": "4'635.-", "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": "Techn. Lagerleiter", "ground_truth": "Technischer Lagerleiter", "score": 0.8292682926829268}, "rows[2].dienstort.interpretation": {"response": "\u2014", "ground_truth": null, "score": 0.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1943", "ground_truth": "1. Jan. 1943", "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": "inkl.500.\u2014 techn. Z.", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "''", "ground_truth": "\"", "score": 0.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juni 1943", "ground_truth": "1. Juni 1943", "score": 1.0}, "rows[3].dienstort.interpretation": {"response": "\u2014", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": "''", "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'415.-", "ground_truth": "4'415.-", "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": "inkl.500.\u2014 techn. Z.", "ground_truth": null, "score": 0.0}, "rows[1].dienstort.interpretation": {"response": "\u2014", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "inkl.500.\u2014 techn. Z.", "ground_truth": "inkl. 500.- techn. Z.", "score": 0.926829268292683}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "Techn. Lagerleiter", "ground_truth": "Techn. Lagerleiter", "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": "''", "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3815", "ground_truth": "3815", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3800", "ground_truth": "3800", "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "inkl.500.\u2014 techn. Z.", "ground_truth": "inkl. 500.- techn. Z.", "score": 0.926829268292683}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-06-01", "ground_truth": "1943-06-01", "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "''", "ground_truth": "\"", "score": 0.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "inkl.500.\u2014 techn. Z.", "ground_truth": "inkl. 500.- techn. Z.", "score": 0.926829268292683}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-01-01", "ground_truth": "1943-01-01", "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": "inkl.500.\u2014 techn. Z.", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "\u2014", "ground_truth": "-", "score": 0.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "''", "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": "''", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 76}, "raw_response": "{\"sdk_http_response\":{\"headers\":{\"content-type\":\"application/json; charset=UTF-8\",\"vary\":\"Origin, X-Origin, Referer\",\"content-encoding\":\"gzip\",\"date\":\"Mon, 09 Feb 2026 15:49:31 GMT\",\"server\":\"scaffolding on HTTPServer2\",\"x-xss-protection\":\"0\",\"x-frame-options\":\"SAMEORIGIN\",\"x-content-type-options\":\"nosniff\",\"server-timing\":\"gfet4t7; dur=3799\",\"alt-svc\":\"h3=\\\":443\\\"; ma=2592000,h3-29=\\\":443\\\"; ma=2592000\",\"transfer-encoding\":\"chunked\"},\"body\":null},\"candidates\":[{\"content\":{\"parts\":[{\"video_metadata\":null,\"thought\":null,\"inline_data\":null,\"file_data\":null,\"thought_signature\":null,\"function_call\":null,\"code_execution_result\":null,\"executable_code\":null,\"function_response\":null,\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\u2014\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'800.-\\\",\\n \\\"interpretation\\\": \\\"3800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"16. Nov. 1942\\\",\\n \\\"interpretation\\\": \\\"1942-11-16\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl.500.\u2014 techn. Z.\\\",\\n \\\"interpretation\\\": \\\"inkl.500.\u2014 techn. Z.\\\",\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"''\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"''\\\",\\n \\\"interpretation\\\": \\\"\u2014\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"''\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'815.-\\\",\\n \\\"interpretation\\\": \\\"3815\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1943\\\",\\n \\\"interpretation\\\": \\\"1943-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl.500.\u2014 techn. Z.\\\",\\n \\\"interpretation\\\": \\\"inkl.500.\u2014 techn. Z.\\\",\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Techn. Lagerleiter\\\",\\n \\\"interpretation\\\": \\\"Techn. Lagerleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"''\\\",\\n \\\"interpretation\\\": \\\"\u2014\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"''\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4'415.-\\\",\\n \\\"interpretation\\\": \\\"4415\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juni 1943\\\",\\n \\\"interpretation\\\": \\\"1943-06-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl.500.\u2014 techn. Z.\\\",\\n \\\"interpretation\\\": \\\"inkl.500.\u2014 techn. Z.\\\",\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"''\\\",\\n \\\"interpretation\\\": \\\"Techn. Lagerleiter\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"''\\\",\\n \\\"interpretation\\\": \\\"\u2014\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"''\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4'635.-\\\",\\n \\\"interpretation\\\": \\\"4635\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1944\\\",\\n \\\"interpretation\\\": \\\"1944-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"inkl.500.\u2014 techn. Z.\\\",\\n \\\"interpretation\\\": \\\"inkl.500.\u2014 techn. Z.\\\",\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\"}],\"role\":\"model\"},\"citation_metadata\":null,\"finish_message\":null,\"token_count\":null,\"finish_reason\":\"STOP\",\"url_context_metadata\":null,\"avg_logprobs\":null,\"grounding_metadata\":null,\"index\":0,\"logprobs_result\":null,\"safety_ratings\":null}],\"create_time\":null,\"model_version\":\"gemini-2.5-flash-lite\",\"prompt_feedback\":null,\"response_id\":\"CwKKaf2FC4eynsEPsomU2A4\",\"usage_metadata\":{\"cache_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":981},{\"modality\":\"IMAGE\",\"token_count\":206}],\"cached_content_token_count\":1187,\"candidates_token_count\":1260,\"candidates_tokens_details\":null,\"prompt_token_count\":1483,\"prompt_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":1225},{\"modality\":\"IMAGE\",\"token_count\":258}],\"thoughts_token_count\":null,\"tool_use_prompt_token_count\":null,\"tool_use_prompt_tokens_details\":null,\"total_token_count\":2743,\"traffic_type\":null},\"automatic_function_calling_history\":[],\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\u2014\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'800.-\",\"interpretation\":\"3800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"16. Nov. 1942\",\"interpretation\":\"1942-11-16\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.500.\u2014 techn. Z.\",\"interpretation\":\"inkl.500.\u2014 techn. Z.\",\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"''\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"''\",\"interpretation\":\"\u2014\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"''\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'815.-\",\"interpretation\":\"3815\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1943\",\"interpretation\":\"1943-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.500.\u2014 techn. Z.\",\"interpretation\":\"inkl.500.\u2014 techn. Z.\",\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Techn. Lagerleiter\",\"interpretation\":\"Techn. Lagerleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"''\",\"interpretation\":\"\u2014\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"''\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'415.-\",\"interpretation\":\"4415\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juni 1943\",\"interpretation\":\"1943-06-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.500.\u2014 techn. Z.\",\"interpretation\":\"inkl.500.\u2014 techn. Z.\",\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"''\",\"interpretation\":\"Techn. Lagerleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"''\",\"interpretation\":\"\u2014\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"''\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'635.-\",\"interpretation\":\"4635\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"inkl.500.\u2014 techn. Z.\",\"interpretation\":\"inkl.500.\u2014 techn. Z.\",\"is_crossed_out\":false}}]}}"}, "scoring": {"f1_micro": 0.8757148303469309, "f1_macro": 0.8337704918032787, "micro_precision": 0.842008797653959, "micro_recall": 0.9122319301032565, "total_instances": 61, "total_tp": 2297, "total_fp": 431, "total_fn": 221, "cost_summary": {"total_input_tokens": 90463, "total_output_tokens": 62259, "total_tokens": 152722, "input_cost_usd": 0.009046299999999997, "output_cost_usd": 0.0249036, "total_cost_usd": 0.03394990000000001}}, "normalized_score": 87.57148303469309}, {"_id": {"$oid": "69d4eb12b877594bc5718c4b"}, "test_id": "T0578", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "anthropic", "model": "claude-opus-4-20250514", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"K\u00fcchenchef\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3.360.-\",\"interpretation\":\"3360\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"22.April 1943\",\"interpretation\":\"1943-04-22\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"K\u00fcchenchef\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.730.-\",\"interpretation\":\"4730\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"-\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.750.-\",\"interpretation\":\"4750\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "claude-opus-4-20250514", "provider": "anthropic", "finish_reason": "tool_use", "usage": {"input_tokens": 3754, "output_tokens": 873, "total_tokens": 4627, "input_cost_usd": 0.05631, "output_cost_usd": 0.06547499999999999, "estimated_cost_usd": 0.12178499999999999}, "duration": 15.971205234527588, "timestamp": "2026-02-09T16:55:13.631586", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "K\u00fcchenchef", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3.360.-", "interpretation": "3360", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "22.April 1943", "interpretation": "1943-04-22", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "K\u00fcchenchef", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.730.-", "interpretation": "4730", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1.Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "-", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4.750.-", "interpretation": "4750", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "2604aefb-a549-48e1-b331-bc98742d5559", "score": {"f1_score": 0.85, "precision": 0.8333333333333334, "recall": 0.8571428571428571, "true_positives": 30, "false_positives": 6, "false_negatives": 5, "field_scores": {"rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1.Januar 1945", "ground_truth": "1. Januar 1945", "score": 0.962962962962963}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "-", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "K\u00fcchenchef", "ground_truth": "K\u00fcchenchef", "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-04-22", "ground_truth": "1943-04-27", "score": 0.9}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4730", "ground_truth": "4730", "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.750.-", "ground_truth": "4.730.-", "score": 0.8571428571428572}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "K\u00fcchenchef", "ground_truth": "K\u00fcchenchef", "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4.730.-", "ground_truth": "4.730.-", "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4750", "ground_truth": "4730", "score": 0.75}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3360", "ground_truth": "3360", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1947", "ground_truth": "1. Januar 1947", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "22.April 1943", "ground_truth": "27. April 1943", "score": 0.8888888888888888}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3.360.-", "ground_truth": "3'360.-", "score": 0.8571428571428572}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 57}, "raw_response": "{\"id\":\"msg_01Mqd9BzYeR4vSCW49MkPTns\",\"content\":[{\"id\":\"toolu_01X5yfEKmL9AJ32WMxyUw4wE\",\"input\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"K\u00fcchenchef\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3.360.-\",\"interpretation\":\"3360\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"22.April 1943\",\"interpretation\":\"1943-04-22\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"K\u00fcchenchef\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.730.-\",\"interpretation\":\"4730\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"-\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4.750.-\",\"interpretation\":\"4750\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]},\"name\":\"extract_structured_data\",\"type\":\"tool_use\"}],\"model\":\"claude-opus-4-20250514\",\"role\":\"assistant\",\"stop_reason\":\"tool_use\",\"stop_sequence\":null,\"type\":\"message\",\"usage\":{\"cache_creation\":{\"ephemeral_1h_input_tokens\":0,\"ephemeral_5m_input_tokens\":0},\"cache_creation_input_tokens\":0,\"cache_read_input_tokens\":0,\"input_tokens\":3754,\"output_tokens\":873,\"server_tool_use\":null,\"service_tier\":\"standard\",\"inference_geo\":\"not_available\"}}"}, "scoring": {"f1_micro": 0.7598510096059597, "f1_macro": 0.7575409836065574, "micro_precision": 0.7502903600464577, "micro_recall": 0.7696584590945195, "total_instances": 61, "total_tp": 1938, "total_fp": 645, "total_fn": 580, "cost_summary": {"total_input_tokens": 228973, "total_output_tokens": 63472, "total_tokens": 292445, "input_cost_usd": 3.434594999999998, "output_cost_usd": 4.760400000000001, "total_cost_usd": 8.194995000000002}}, "normalized_score": 75.98510096059597}, {"_id": {"$oid": "69d4eb12b877594bc5718c4c"}, "test_id": "T0613", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5.1-2025-11-13", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"G\u00e4rtnerin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"190.-\",\"interpretation\":\"190\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"15. Okt. 1942\",\"interpretation\":\"1942-10-15\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Teuerungszulage\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'180.-\",\"interpretation\":\"2180\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1943\",\"interpretation\":\"1943-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'280.-\",\"interpretation\":\"2280\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'300.-\",\"interpretation\":\"2300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. M\u00e4rz 1944\",\"interpretation\":\"1944-03-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'800.-\",\"interpretation\":\"2800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. August 1944\",\"interpretation\":\"1944-08-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'140.-\",\"interpretation\":\"4140\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juni 1945\",\"interpretation\":\"1945-06-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+. Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gpt-5.1-2025-11-13", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 3105, "output_tokens": 1234, "total_tokens": 4339, "cached_tokens": 2176, "input_cost_usd": 0.00388125, "output_cost_usd": 0.01234, "estimated_cost_usd": 0.01622125}, "duration": 14.716900110244751, "timestamp": "2026-02-09T23:50:08.799807", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "G\u00e4rtnerin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "190.-", "interpretation": "190", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "15. Okt. 1942", "interpretation": "1942-10-15", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Teuerungszulage", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "G\u00e4rtnerin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'180.-", "interpretation": "2180", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1943", "interpretation": "1943-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": ".", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "G\u00e4rtnerin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'280.-", "interpretation": "2280", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1944", "interpretation": "1944-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": ".", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "G\u00e4rtnerin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'300.-", "interpretation": "2300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. M\u00e4rz 1944", "interpretation": "1944-03-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": ".", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'800.-", "interpretation": "2800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. August 1944", "interpretation": "1944-08-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": ".", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'140.-", "interpretation": "4140", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "Lagerleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juni 1945", "interpretation": "1945-06-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+. Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "cb1b13fc-6e68-4c73-b0f7-ba6c81f93549", "score": {"f1_score": 0.9, "precision": 0.875, "recall": 0.9166666666666666, "true_positives": 77, "false_positives": 11, "false_negatives": 7, "field_scores": {"rows[4].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1942-10-15", "ground_truth": "1942-10-15", "score": 1.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": "Lagerleiterin", "ground_truth": "Lagerleiterin", "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Teuerungszulage", "ground_truth": "+ Teuerungszulage", "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'300.-", "ground_truth": "200.-", "score": 0.8333333333333335}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juni 1945", "ground_truth": "1. Juni 1945", "score": 1.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1943-01-01", "ground_truth": "1943-01-01", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-03-01", "ground_truth": "1944-03-01", "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2800", "ground_truth": "2800", "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'800.-", "ground_truth": "2'800.--", "score": 0.9333333333333332}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'600.-", "ground_truth": "4.600.--", "score": 0.8}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1943", "ground_truth": "1. Jan. 1943", "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. August 1944", "ground_truth": "1. August 1944", "score": 1.0}, "rows[4].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": "+. Zulagen", "ground_truth": "+ Zulagen", "score": 0.9473684210526316}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": ".", "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4140", "ground_truth": "4140", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'140.-", "ground_truth": "4.140.--", "score": 0.8}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2180", "ground_truth": "2280", "score": 0.75}, "rows[6].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": ".", "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1944", "ground_truth": "1. Jan. 1944", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-08-01", "ground_truth": "1944-08-01", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'280.-", "ground_truth": "2'280.-", "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2280", "ground_truth": "2280", "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": ".", "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. M\u00e4rz 1944", "ground_truth": "1. M\u00e4rz 1944", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "190.-", "ground_truth": "190.--", "score": 0.9090909090909091}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'180.-", "ground_truth": "2'280.--", "score": 0.8}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "15. Okt. 1942", "ground_truth": "15. Okt. 1942", "score": 1.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "190", "ground_truth": "190", "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-06-01", "ground_truth": "1945-06-01", "score": 1.0}, "rows[6].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": ".", "ground_truth": null, "score": 0.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": "G\u00e4rtnerin", "ground_truth": "G\u00e4rtnerin", "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": "4600", "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2300", "ground_truth": "200", "score": 0.8571428571428572}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-01-01", "ground_truth": "1944-01-01", "score": 1.0}, "rows[6].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}}, "total_fields": 133}, "raw_response": "{\"id\":\"chatcmpl-D7UMmWbhzo7EKfwUxrcg9DcEgpWca\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"G\u00e4rtnerin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"190.-\\\",\\\"interpretation\\\":\\\"190\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"15. Okt. 1942\\\",\\\"interpretation\\\":\\\"1942-10-15\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Teuerungszulage\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"G\u00e4rtnerin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'180.-\\\",\\\"interpretation\\\":\\\"2180\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 1943\\\",\\\"interpretation\\\":\\\"1943-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\".\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":3,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"G\u00e4rtnerin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'280.-\\\",\\\"interpretation\\\":\\\"2280\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 1944\\\",\\\"interpretation\\\":\\\"1944-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\".\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":4,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"G\u00e4rtnerin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'300.-\\\",\\\"interpretation\\\":\\\"2300\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. M\u00e4rz 1944\\\",\\\"interpretation\\\":\\\"1944-03-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\".\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":5,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2'800.-\\\",\\\"interpretation\\\":\\\"2800\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. August 1944\\\",\\\"interpretation\\\":\\\"1944-08-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\".\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":6,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiterin\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4'140.-\\\",\\\"interpretation\\\":\\\"4140\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Januar 1945\\\",\\\"interpretation\\\":\\\"1945-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":7,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Lagerleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4'600.-\\\",\\\"interpretation\\\":\\\"4600\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Juni 1945\\\",\\\"interpretation\\\":\\\"1945-06-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+. Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"G\u00e4rtnerin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"190.-\",\"interpretation\":\"190\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"15. Okt. 1942\",\"interpretation\":\"1942-10-15\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Teuerungszulage\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'180.-\",\"interpretation\":\"2180\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1943\",\"interpretation\":\"1943-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'280.-\",\"interpretation\":\"2280\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1944\",\"interpretation\":\"1944-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"G\u00e4rtnerin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'300.-\",\"interpretation\":\"2300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. M\u00e4rz 1944\",\"interpretation\":\"1944-03-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'800.-\",\"interpretation\":\"2800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. August 1944\",\"interpretation\":\"1944-08-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\".\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'140.-\",\"interpretation\":\"4140\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Lagerleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juni 1945\",\"interpretation\":\"1945-06-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+. Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1770677396,\"model\":\"gpt-5.1-2025-11-13\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":1234,\"prompt_tokens\":3105,\"total_tokens\":4339,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":2176}}}"}, "scoring": {"f1_micro": 0.9075662283209454, "f1_macro": 0.8726229508196721, "micro_precision": 0.8937687687687688, "micro_recall": 0.9217963608207511, "total_instances": 61, "total_tp": 2381, "total_fp": 283, "total_fn": 202, "cost_summary": {"total_input_tokens": 189405, "total_output_tokens": 37330, "total_tokens": 226735, "input_cost_usd": 0.23675625000000014, "output_cost_usd": 0.37329999999999997, "total_cost_usd": 0.6100562500000003}}, "normalized_score": 90.75662283209454}, {"_id": {"$oid": "69d4eb12b877594bc5718c4d"}, "test_id": "T0586", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "genai", "model": "gemini-2.0-flash", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\u2713\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4800.+\",\"interpretation\":\"4800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"17. Dez.\",\"interpretation\":\"1945-12-17\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gemini-2.0-flash", "provider": "genai", "finish_reason": "STOP", "usage": {"input_tokens": 3626, "output_tokens": 297, "total_tokens": 3923, "input_cost_usd": 0.00036260000000000003, "output_cost_usd": 0.00011880000000000001, "estimated_cost_usd": 0.00048140000000000005}, "duration": 3.146131753921509, "timestamp": "2026-02-09T16:26:50.980615", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\u2713", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4800.+", "interpretation": "4800", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "17. Dez.", "interpretation": "1945-12-17", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "92ba08cc-793f-4f3f-9339-cebbeb146212", "score": {"f1_score": 0.8, "precision": 0.7692307692307693, "recall": 0.8333333333333334, "true_positives": 10, "false_positives": 3, "false_negatives": 2, "field_scores": {"rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4800", "ground_truth": "4800", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-12-17", "ground_truth": "1945-12-17", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "\u2713", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "17. Dez.", "ground_truth": "17. Dez. 45", "score": 0.8421052631578947}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4800.+", "ground_truth": "4800.-", "score": 0.8333333333333335}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 19}, "raw_response": "{\"sdk_http_response\":{\"headers\":{\"content-type\":\"application/json; charset=UTF-8\",\"vary\":\"Origin, X-Origin, Referer\",\"content-encoding\":\"gzip\",\"date\":\"Mon, 09 Feb 2026 15:26:44 GMT\",\"server\":\"scaffolding on HTTPServer2\",\"x-xss-protection\":\"0\",\"x-frame-options\":\"SAMEORIGIN\",\"x-content-type-options\":\"nosniff\",\"server-timing\":\"gfet4t7; dur=2990\",\"alt-svc\":\"h3=\\\":443\\\"; ma=2592000,h3-29=\\\":443\\\"; ma=2592000\",\"transfer-encoding\":\"chunked\"},\"body\":null},\"candidates\":[{\"content\":{\"parts\":[{\"video_metadata\":null,\"thought\":null,\"inline_data\":null,\"file_data\":null,\"thought_signature\":null,\"function_call\":null,\"code_execution_result\":null,\"executable_code\":null,\"function_response\":null,\"text\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiter\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\u2713\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4800.+\\\",\\n \\\"interpretation\\\": \\\"4800\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"17. Dez.\\\",\\n \\\"interpretation\\\": \\\"1945-12-17\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Zulagen\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\"}],\"role\":\"model\"},\"citation_metadata\":null,\"finish_message\":null,\"token_count\":null,\"finish_reason\":\"STOP\",\"url_context_metadata\":null,\"avg_logprobs\":-3.4397446804425935e-6,\"grounding_metadata\":null,\"index\":null,\"logprobs_result\":null,\"safety_ratings\":null}],\"create_time\":null,\"model_version\":\"gemini-2.0-flash\",\"prompt_feedback\":null,\"response_id\":\"svyJaZXWBIHi7M8PvNuscQ\",\"usage_metadata\":{\"cache_tokens_details\":null,\"cached_content_token_count\":null,\"candidates_token_count\":297,\"candidates_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":297}],\"prompt_token_count\":3626,\"prompt_tokens_details\":[{\"modality\":\"TEXT\",\"token_count\":1820},{\"modality\":\"IMAGE\",\"token_count\":1806}],\"thoughts_token_count\":null,\"tool_use_prompt_token_count\":null,\"tool_use_prompt_tokens_details\":null,\"total_token_count\":3923,\"traffic_type\":null},\"automatic_function_calling_history\":[],\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\u2713\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4800.+\",\"interpretation\":\"4800\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"17. Dez.\",\"interpretation\":\"1945-12-17\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}"}, "scoring": {"f1_micro": 0.9238152369526095, "f1_macro": 0.8657377049180328, "micro_precision": 0.9303262182843335, "micro_recall": 0.9173947577442415, "total_instances": 61, "total_tp": 2310, "total_fp": 173, "total_fn": 208, "cost_summary": {"total_input_tokens": 221186, "total_output_tokens": 60674, "total_tokens": 281860, "input_cost_usd": 0.02211860000000001, "output_cost_usd": 0.024269599999999992, "total_cost_usd": 0.046388200000000004}}, "normalized_score": 92.38152369526095}, {"_id": {"$oid": "69d4eb12b877594bc5718c4e"}, "test_id": "T0580", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "anthropic", "model": "claude-sonnet-4-20250514", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[]}", "model": "claude-sonnet-4-20250514", "provider": "anthropic", "finish_reason": "tool_use", "usage": {"input_tokens": 3739, "output_tokens": 33, "total_tokens": 3772, "input_cost_usd": 0.011217000000000001, "output_cost_usd": 0.000495, "estimated_cost_usd": 0.011712000000000002}, "duration": 1.8237690925598145, "timestamp": "2026-02-09T17:16:12.241793", "parsed": {"rows": []}, "conversation_id": "6600950e-76f0-4093-9056-7582bce2104c", "score": {"f1_score": 0.0, "precision": 0.0, "recall": 0.0, "true_positives": 0, "false_positives": 0, "false_negatives": 0, "field_scores": {}, "total_fields": 0}, "raw_response": "{\"id\":\"msg_01DNqt4MGrM59oU7EFJMWmX1\",\"content\":[{\"id\":\"toolu_01Bsbh2kkZ1QKa7HBWc6nPmy\",\"input\":{\"rows\":[]},\"name\":\"extract_structured_data\",\"type\":\"tool_use\"}],\"model\":\"claude-sonnet-4-20250514\",\"role\":\"assistant\",\"stop_reason\":\"tool_use\",\"stop_sequence\":null,\"type\":\"message\",\"usage\":{\"cache_creation\":{\"ephemeral_1h_input_tokens\":0,\"ephemeral_5m_input_tokens\":0},\"cache_creation_input_tokens\":0,\"cache_read_input_tokens\":0,\"input_tokens\":3739,\"output_tokens\":33,\"server_tool_use\":null,\"service_tier\":\"standard\",\"inference_geo\":\"not_available\"}}"}, "scoring": {"f1_micro": 0.9222818525144105, "f1_macro": 0.8678688524590163, "micro_precision": 0.9231993633107839, "micro_recall": 0.9213661636219221, "total_instances": 61, "total_tp": 2320, "total_fp": 193, "total_fn": 198, "cost_summary": {"total_input_tokens": 228973, "total_output_tokens": 60547, "total_tokens": 289520, "input_cost_usd": 0.6869189999999998, "output_cost_usd": 0.908205, "total_cost_usd": 1.5951239999999995}}, "normalized_score": 92.22818525144105}, {"_id": {"$oid": "69d4eb12b877594bc5718c4f"}, "test_id": "T0605", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-4.1", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"-\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2,940.-\",\"interpretation\":\"2940\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Mai 1944.\",\"interpretation\":\"1944-05-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3,210.-\",\"interpretation\":\"3210\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1944\",\"interpretation\":\"1944-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4,520.-\",\"interpretation\":\"4520\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gpt-4.1-2025-04-14", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 3301, "output_tokens": 519, "total_tokens": 3820, "cached_tokens": 1792, "input_cost_usd": 0.006602, "output_cost_usd": 0.004152, "estimated_cost_usd": 0.010754}, "duration": 21.14052677154541, "timestamp": "2026-02-09T23:40:11.287905", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiter", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "-", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2,940.-", "interpretation": "2940", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Mai 1944.", "interpretation": "1944-05-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3,210.-", "interpretation": "3210", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1944", "interpretation": "1944-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiter", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4,520.-", "interpretation": "4520", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Januar 1945", "interpretation": "1945-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "ab6fbed0-f0e9-4b9e-bfc6-d76f7f16de85", "score": {"f1_score": 0.95, "precision": 0.9459459459459459, "recall": 0.9459459459459459, "true_positives": 35, "false_positives": 2, "false_negatives": 2, "field_scores": {"rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1945-01-01", "ground_truth": "1945-01-01", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-05-01", "ground_truth": "1944-05-01", "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Mai 1944.", "ground_truth": "1. Mai 1944", "score": 0.9565217391304348}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2940", "ground_truth": "2940", "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3,210.-", "ground_truth": "3.210.-", "score": 0.8571428571428572}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4,520.-", "ground_truth": "4.520.-", "score": 0.8571428571428572}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1944", "ground_truth": "1. Juli 1944", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3210", "ground_truth": "3210", "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Hilfsleiter", "ground_truth": "Hilfsleiter", "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Januar 1945", "ground_truth": "1. Januar 1945", "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1944-07-01", "ground_truth": "1944-07-01", "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4520", "ground_truth": "4520", "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "-", "ground_truth": "-", "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2,940.-", "ground_truth": "2,940.-", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}}, "total_fields": 57}, "raw_response": "{\"id\":\"chatcmpl-D7UD259CfkniGfJ1LwBGT1hdyeBwS\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiter\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"-\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2,940.-\\\",\\\"interpretation\\\":\\\"2940\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Mai 1944.\\\",\\\"interpretation\\\":\\\"1944-05-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiter\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3,210.-\\\",\\\"interpretation\\\":\\\"3210\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Juli 1944\\\",\\\"interpretation\\\":\\\"1944-07-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":3,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\\\\\"\\\",\\\"interpretation\\\":\\\"Hilfsleiter\\\",\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"4,520.-\\\",\\\"interpretation\\\":\\\"4520\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Januar 1945\\\",\\\"interpretation\\\":\\\"1945-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiter\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"-\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2,940.-\",\"interpretation\":\"2940\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Mai 1944.\",\"interpretation\":\"1944-05-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3,210.-\",\"interpretation\":\"3210\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1944\",\"interpretation\":\"1944-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiter\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4,520.-\",\"interpretation\":\"4520\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Januar 1945\",\"interpretation\":\"1945-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1770676792,\"model\":\"gpt-4.1-2025-04-14\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":\"fp_8b22347a3e\",\"usage\":{\"completion_tokens\":519,\"prompt_tokens\":3301,\"total_tokens\":3820,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1792}}}"}, "scoring": {"f1_micro": 0.9003009781790821, "f1_macro": 0.8726229508196721, "micro_precision": 0.8755945847054519, "micro_recall": 0.9264421215640728, "total_instances": 61, "total_tp": 2393, "total_fp": 340, "total_fn": 190, "cost_summary": {"total_input_tokens": 201361, "total_output_tokens": 38315, "total_tokens": 239676, "input_cost_usd": 0.40272199999999986, "output_cost_usd": 0.30652, "total_cost_usd": 0.7092419999999999}}, "normalized_score": 90.0300978179082}, {"_id": {"$oid": "69d4eb12b877594bc5718c50"}, "test_id": "T0600", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "mistral", "model": "mistral-large-2512", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Basel\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2'700.-\",\"interpretation\":\"2700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1946\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Basel\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'000.-\",\"interpretation\":\"3000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1947\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Hilfsleiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Basel\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'300.-\",\"interpretation\":\"3300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1947\",\"interpretation\":\"1947-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Leiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Basel\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3'700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1948\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":6,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Leiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Basel\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'000.-\",\"interpretation\":\"4000\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1948\",\"interpretation\":\"1948-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":7,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Leiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Basel\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'300.-\",\"interpretation\":\"4300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1949\",\"interpretation\":\"1949-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":8,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Leiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Basel\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"4'600.-\",\"interpretation\":\"4600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 1949\",\"interpretation\":\"1949-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":9,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Leiterin\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Basel\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"5.094.-\",\"interpretation\":\"5094\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1950\",\"interpretation\":\"1950-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Teuerungszulage\",\"interpretation\":\"+ Cost-of-living allowance\",\"is_crossed_out\":false}}]}", "model": "mistral-large-2512", "provider": "mistral", "finish_reason": "stop", "usage": {"input_tokens": 1877, "output_tokens": 2514, "total_tokens": 4391, "input_cost_usd": 0.0009385, "output_cost_usd": 0.003771, "estimated_cost_usd": 0.0047095}, "duration": 25.788602113723755, "timestamp": "2026-02-09T23:45:21.265714", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'400.-", "interpretation": "2400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Basel", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2'700.-", "interpretation": "2700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1946", "interpretation": "1946-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Basel", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'000.-", "interpretation": "3000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1947", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Hilfsleiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Basel", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'300.-", "interpretation": "3300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1947", "interpretation": "1947-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "Leiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Basel", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3'700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1948", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 6, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Leiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Basel", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'000.-", "interpretation": "4000", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1948", "interpretation": "1948-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 7, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Leiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Basel", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'300.-", "interpretation": "4300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1949", "interpretation": "1949-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 8, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Leiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Basel", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "4'600.-", "interpretation": "4600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 1949", "interpretation": "1949-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 9, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Leiterin", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Basel", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "5.094.-", "interpretation": "5094", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1950", "interpretation": "1950-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Teuerungszulage", "interpretation": "+ Cost-of-living allowance", "is_crossed_out": false}}]}, "conversation_id": "ee3b8958-67e9-4de0-83ff-7b2d18aec995", "score": {"f1_score": 0.35, "precision": 0.26573426573426573, "recall": 0.5066666666666667, "true_positives": 38, "false_positives": 105, "false_negatives": 37, "field_scores": {"rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'400.-", "ground_truth": "3720.-", "score": 0.4705882352941176}, "rows[8].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[5].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1947", "ground_truth": "1. Januar 1945", "score": 0.7692307692307692}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'000.-", "ground_truth": "5120.--", "score": 0.4285714285714286}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[5].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "inkl. 600.-- techn. Z.", "score": 0.0}, "rows[1].dienstort.interpretation": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": "inklusive 600 (technische Zulage)", "score": 0.0}, "rows[8].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[8].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1950", "ground_truth": null, "score": 0.0}, "rows[7].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[6].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2400", "ground_truth": "3720", "score": 0.5}, "rows[8].bemerkungen.interpretation": {"response": "+ Cost-of-living allowance", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].dienstliche_stellung.interpretation": {"response": "Leiterin", "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4600", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": "1943-10-25", "score": 0.6}, "rows[6].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "rows[6].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[6].datum_gehalts\u00e4nderung.interpretation": {"response": "1949-01-01", "ground_truth": null, "score": 0.0}, "rows[7].dienstort.interpretation": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3300", "ground_truth": "5700", "score": 0.5}, "rows[5].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4000", "ground_truth": "6440", "score": 0.5}, "rows[8].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiter", "score": 0.9166666666666665}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1948", "ground_truth": "1. Jan. 47", "score": 0.5454545454545454}, "rows[8].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'300.-", "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1945-01-01", "score": 0.9}, "rows[5].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'000.-", "ground_truth": "6440.-", "score": 0.6153846153846154}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-07-01", "ground_truth": "1944-01-01", "score": 0.8}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'300.-", "ground_truth": "5700.-", "score": 0.6153846153846154}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-07-01", "ground_truth": "1947-01-01", "score": 0.8}, "rows[4].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[5].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.interpretation": {"response": "Leiterin", "ground_truth": null, "score": 0.0}, "rows[5].dienstliche_stellung.interpretation": {"response": "Leiterin", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "inkl. 600.-- techn. Z.", "score": 0.0}, "rows[3].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3'700.-", "ground_truth": "5920.-", "score": 0.4615384615384615}, "rows[1].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": "inklusive 600 (technische Zulage)", "score": 0.0}, "rows[8].bemerkungen.diplomatic_transcript": {"response": "+ Teuerungszulage", "ground_truth": null, "score": 0.0}, "rows[8].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[6].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": "25. Okt. 1943", "score": 0.56}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2'700.-", "ground_truth": "3750.-", "score": 0.6153846153846154}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1946", "ground_truth": "1. Jan. 1944", "score": 0.6666666666666667}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[8].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "Lagerleiter", "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1948", "ground_truth": "1. Jan. 46", "score": 0.8181818181818181}, "rows[6].dienstort.interpretation": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}, "rows[8].dienstort.interpretation": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiter", "score": 0.9166666666666665}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[8].dienstliche_stellung.interpretation": {"response": "Leiterin", "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[8].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": "1946-01-01", "score": 0.9}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiter", "score": 0.9166666666666665}, "rows[5].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[6].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "4300", "ground_truth": null, "score": 0.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": "-", "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "4'600.-", "ground_truth": null, "score": 0.0}, "rows[4].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[8].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": "Leiterin", "ground_truth": null, "score": 0.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": "\"", "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[5].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.interpretation": {"response": "1949-07-01", "ground_truth": null, "score": 0.0}, "rows[7].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[7].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.interpretation": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[8].datum_gehalts\u00e4nderung.interpretation": {"response": "1950-01-01", "ground_truth": null, "score": 0.0}, "rows[6].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[8].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[5].dienstort.interpretation": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-07-01", "ground_truth": "1945-12-01", "score": 0.7}, "rows[7].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5094", "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": "5920", "score": 0.25}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[6].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[7].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1949", "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[4].dienstort.interpretation": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2700", "ground_truth": "3750", "score": 0.5}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[5].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[8].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "5.094.-", "ground_truth": null, "score": 0.0}, "rows[5].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[7].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[6].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3000", "ground_truth": "5120", "score": 0.25}, "rows[6].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1949", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 1947", "ground_truth": "1. Dez. 45", "score": 0.4545454545454546}, "rows[5].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": "Hilfsleiterin", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": "+ Zulagen", "score": 0.0}}, "total_fields": 171}, "raw_response": "{\"id\":\"e68638b269104cd18e7273e90fac4d79\",\"object\":\"chat.completion\",\"model\":\"mistral-large-2512\",\"usage\":{\"prompt_tokens\":1877,\"completion_tokens\":2514,\"total_tokens\":4391,\"num_cached_tokens\":1904},\"created\":1770677095,\"choices\":[{\"index\":0,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Hilfsleiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'400.-\\\",\\n \\\"interpretation\\\": \\\"2400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Basel\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"2'700.-\\\",\\n \\\"interpretation\\\": \\\"2700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1946\\\",\\n \\\"interpretation\\\": \\\"1946-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Basel\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'000.-\\\",\\n \\\"interpretation\\\": \\\"3000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1947\\\",\\n \\\"interpretation\\\": \\\"1947-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Hilfsleiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Basel\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'300.-\\\",\\n \\\"interpretation\\\": \\\"3300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1947\\\",\\n \\\"interpretation\\\": \\\"1947-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Leiterin\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Basel\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"3'700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1948\\\",\\n \\\"interpretation\\\": \\\"1948-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 6,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Leiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Basel\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4'000.-\\\",\\n \\\"interpretation\\\": \\\"4000\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1948\\\",\\n \\\"interpretation\\\": \\\"1948-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 7,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Leiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Basel\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4'300.-\\\",\\n \\\"interpretation\\\": \\\"4300\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1949\\\",\\n \\\"interpretation\\\": \\\"1949-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 8,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Leiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Basel\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"4'600.-\\\",\\n \\\"interpretation\\\": \\\"4600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Juli 1949\\\",\\n \\\"interpretation\\\": \\\"1949-07-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 9,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Leiterin\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Basel\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"5.094.-\\\",\\n \\\"interpretation\\\": \\\"5094\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1950\\\",\\n \\\"interpretation\\\": \\\"1950-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"+ Teuerungszulage\\\",\\n \\\"interpretation\\\": \\\"+ Cost-of-living allowance\\\",\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"tool_calls\":null,\"prefix\":false,\"role\":\"assistant\"},\"finish_reason\":\"stop\"}]}"}, "scoring": {"f1_micro": 0.17371335944887212, "f1_macro": 0.17704918032786887, "micro_precision": 0.10521148654176553, "micro_recall": 0.4978706929926442, "total_instances": 61, "total_tp": 1286, "total_fp": 10937, "total_fn": 1297, "cost_summary": {"total_input_tokens": 114497, "total_output_tokens": 214505, "total_tokens": 329002, "input_cost_usd": 0.05724850000000002, "output_cost_usd": 0.32175750000000003, "total_cost_usd": 0.3790059999999999}}, "normalized_score": 17.37133594488721}, {"_id": {"$oid": "69d4eb12b877594bc5718c53"}, "test_id": "T0608", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "openai", "model": "gpt-4o", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2900.-\",\"interpretation\":\"2900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"7. Jan. 46\",\"interpretation\":\"1946-01-07\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3050.-\",\"interpretation\":\"3050\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 46\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3150.-\",\"interpretation\":\"3150\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 47\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3300.-\",\"interpretation\":\"3300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 48\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "gpt-4o-2024-08-06", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 3301, "output_tokens": 682, "total_tokens": 3983, "cached_tokens": 1792, "input_cost_usd": 0.0082525, "output_cost_usd": 0.00682, "estimated_cost_usd": 0.015072499999999999}, "duration": 18.652926683425903, "timestamp": "2026-02-10T00:01:46.852188", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Hilfsleiterin", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": "5", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "2900.-", "interpretation": "2900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "7. Jan. 46", "interpretation": "1946-01-07", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3050.-", "interpretation": "3050", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Juli 46", "interpretation": "1946-07-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3150.-", "interpretation": "3150", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 47", "interpretation": "1947-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "3300.-", "interpretation": "3300", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 48", "interpretation": "1948-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "+ Zulagen", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "86bde809-d7f0-40e8-be6a-a1a1d033e629", "score": {"f1_score": 0.96, "precision": 0.9574468085106383, "recall": 0.9574468085106383, "true_positives": 45, "false_positives": 2, "false_negatives": 2, "field_scores": {"rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3150", "ground_truth": "3150", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2900", "ground_truth": "2900", "score": 1.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].gehaltsklasse.interpretation": {"response": "5", "ground_truth": "5", "score": 1.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": "V", "score": 1.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-01-01", "ground_truth": "1947-01-01", "score": 1.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Juli 46", "ground_truth": "1. Juli 46", "score": 1.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3050.-", "ground_truth": "3050.-", "score": 1.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-07", "ground_truth": "1945-01-07", "score": 0.9}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "7. Jan. 46", "ground_truth": "7. Jan. 45", "score": 0.9}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 48", "ground_truth": "1. Jan. 48", "score": 1.0}, "rows[1].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3300", "ground_truth": "3300", "score": 1.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3300.-", "ground_truth": "3300.-", "score": 1.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "2900.-", "ground_truth": "2900.-", "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 47", "ground_truth": "1. Jan. 47", "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].gehaltsklasse.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3050", "ground_truth": "3050", "score": 1.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "3150.-", "ground_truth": "3150.-", "score": 1.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": "+ Zulagen", "ground_truth": "+ Zulagen", "score": 1.0}, "rows[0].dienstliche_stellung.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-07-01", "ground_truth": "1946-07-01", "score": 1.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-01-01", "ground_truth": "1948-01-01", "score": 1.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": false, "score": 1.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Hilfsleiterin", "ground_truth": "Hilfsleiterin", "score": 1.0}}, "total_fields": 76}, "raw_response": "{\"id\":\"chatcmpl-D7UXx4WabEDC0qY08jnH7mSMhrCCE\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"rows\\\":[{\\\"row_number\\\":1,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"Hilfsleiterin\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"V\\\",\\\"interpretation\\\":\\\"5\\\",\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"2900.-\\\",\\\"interpretation\\\":\\\"2900\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"7. Jan. 46\\\",\\\"interpretation\\\":\\\"1946-01-07\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":2,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3050.-\\\",\\\"interpretation\\\":\\\"3050\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Juli 46\\\",\\\"interpretation\\\":\\\"1946-07-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":3,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3150.-\\\",\\\"interpretation\\\":\\\"3150\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 47\\\",\\\"interpretation\\\":\\\"1947-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}},{\\\"row_number\\\":4,\\\"dienstliche_stellung\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"dienstort\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"gehaltsklasse\\\":{\\\"diplomatic_transcript\\\":\\\"\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false},\\\"jahresgehalt_monatsgehalt_taglohn\\\":{\\\"diplomatic_transcript\\\":\\\"3300.-\\\",\\\"interpretation\\\":\\\"3300\\\",\\\"is_crossed_out\\\":false},\\\"datum_gehalts\u00e4nderung\\\":{\\\"diplomatic_transcript\\\":\\\"1. Jan. 48\\\",\\\"interpretation\\\":\\\"1948-01-01\\\",\\\"is_crossed_out\\\":false},\\\"bemerkungen\\\":{\\\"diplomatic_transcript\\\":\\\"+ Zulagen\\\",\\\"interpretation\\\":null,\\\"is_crossed_out\\\":false}}]}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Hilfsleiterin\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"2900.-\",\"interpretation\":\"2900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"7. Jan. 46\",\"interpretation\":\"1946-01-07\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3050.-\",\"interpretation\":\"3050\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Juli 46\",\"interpretation\":\"1946-07-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3150.-\",\"interpretation\":\"3150\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 47\",\"interpretation\":\"1947-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"3300.-\",\"interpretation\":\"3300\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 48\",\"interpretation\":\"1948-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"+ Zulagen\",\"interpretation\":null,\"is_crossed_out\":false}}]}}}],\"created\":1770678089,\"model\":\"gpt-4o-2024-08-06\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":\"fp_ad98c18a04\",\"usage\":{\"completion_tokens\":682,\"prompt_tokens\":3301,\"total_tokens\":3983,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":1792}}}"}, "scoring": {"f1_micro": 0.8977035490605428, "f1_macro": 0.8719672131147541, "micro_precision": 0.8804914370811616, "micro_recall": 0.9156020131629887, "total_instances": 61, "total_tp": 2365, "total_fp": 321, "total_fn": 218, "cost_summary": {"total_input_tokens": 201361, "total_output_tokens": 36748, "total_tokens": 238109, "input_cost_usd": 0.5034024999999999, "output_cost_usd": 0.3674799999999999, "total_cost_usd": 0.8708825}}, "normalized_score": 89.77035490605428}, {"_id": {"$oid": "69d4eb12b877594bc5718c54"}, "test_id": "T0599", "benchmark": "personnel_cards", "date": "2026-02-09", "tags": {"document-type": ["index-card"], "writing": ["handwritten", "typed", "printed"], "century": [20], "layout": ["table", "form"], "task": ["transcription", "document-understanding", "data-correction"], "language": ["de", "fr"]}, "contributors": ["tabea_wullschleger", "maximilian_hindermann"], "hidden": false, "config": {"provider": "mistral", "model": "mistral-large-2411", "dataclass": "Table", "temperature": 0.0, "role_description": "You are a historian specializing in 20th century personnel records and administrative documents", "prompt_file": "prompt.txt", "legacy_test": false}, "prompt": "Extract all information from this personnel card table and return it as a structured JSON object. The card contains rows documenting employment history with positions, locations, salary information, dates, and remarks.\n\nREQUIRED JSON STRUCTURE:\n```json\n{\n \"rows\": [\n {\n \"row_number\": 1,\n \"dienstliche_stellung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"dienstort\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"gehaltsklasse\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n },\n \"jahresgehalt_monatsgehalt_taglohn\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"standardized numeric form or null\",\n \"is_crossed_out\": false\n },\n \"datum_gehalts\u00e4nderung\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"YYYY-MM-DD format or null\",\n \"is_crossed_out\": false\n },\n \"bemerkungen\": {\n \"diplomatic_transcript\": \"exact text from card\",\n \"interpretation\": \"expanded/standardized form or null\",\n \"is_crossed_out\": false\n }\n }\n ]\n}\n```\n\nCOLUMN DEFINITIONS:\n1. **dienstliche_stellung**: Official position or job title (e.g., \"Assistent\", \"Professor\", \"Sekret\u00e4r\")\n2. **dienstort**: Place of service or work location (e.g., \"Basel\", \"Z\u00fcrich\")\n3. **gehaltsklasse**: Salary class or grade (e.g., \"III\", \"IV\", roman numerals or numbers)\n4. **jahresgehalt_monatsgehalt_taglohn**: Salary amount (annual/monthly/daily wage)\n5. **datum_gehalts\u00e4nderung**: Date of salary change or effective date\n6. **bemerkungen**: Remarks, notes, or additional comments\n\nFIELD EXTRACTION RULES:\n\n**diplomatic_transcript** (REQUIRED for all fields):\n- Transcribe EXACTLY as written on the card\n- Include all abbreviations, punctuation, and formatting as they appear\n- Preserve original capitalization and spacing\n- Include currency symbols and separators (e.g., \"Fr. 2'400.-\", \"3.700.-\")\n- For dates, copy the exact format (e.g., \"1. Jan. 1946\", \"1.April 1945\")\n- Use empty string \"\" for empty cells\n- Be sure to escape ditto marks (repetition marks such as `\"` indicating \"same as above\")\n- DO NOT expand abbreviations or standardize formats\n- Do not transcribe checkmarks\n\n**interpretation** (OPTIONAL - use null if not applicable):\n- For ditto marks (repetition marks such as `\"`): Replace with the actual repeated value from the previous row in the same column\n - For example, if previous row's dienstliche_stellung is \"Hilfsleiterin\" and current row has `\"`, interpret as \"Hilfsleiterin\"\n - Do NOT add explanatory text like \"wie oben\" or similar - just provide the repeated value\n- Never expand abbreviations\n- For dates: Convert to ISO format YYYY-MM-DD\n - \"1. Jan. 1946\" \u2192 \"1946-01-01\"\n - \"1.April 1945\" \u2192 \"1945-04-01\"\n- For salary amounts: Extract numeric value only (remove currency symbols, separators)\n - \"Fr. 2'400.-\" \u2192 \"2400\"\n - \"3.700.-\" \u2192 \"3700\"\n - \"5.094.-\" \u2192 \"5094\"\n \"6,30.-\" \u2192 \"6.3\"\n- For salary class: Convert roman numerals to arabic if clear\n - \"III\" \u2192 \"3\"\n - \"IV\" \u2192 \"4\"\n- Do not convert roman numerals to arabic if not salary, date, or salary class\n- Use null if no interpretation/expansion is needed or if the field is empty\n- \"+ {word}\" where {word} is a word does not need interpretation\n\n**is_crossed_out** (REQUIRED for all fields):\n- Set to true if text in this field is crossed out, struck through, or deleted\n- Set to false if text is normal (not crossed out)\n- Empty cells should have is_crossed_out: false\n\nROW HANDLING:\n- Number rows sequentially starting from 1 (top to bottom)\n- Include ALL rows that have ANY content in ANY column\n- Empty rows (all cells empty) should be omitted\n- A row with only one filled cell should still be included\n\nIMPORTANT NOTES:\n- Return ONLY the JSON object, no additional text or explanation\n- Every field must have all three sub-fields: diplomatic_transcript, interpretation, is_crossed_out\n- diplomatic_transcript must never be null (use empty string \"\" for empty cells)\n- interpretation can be null when no expansion/standardization applies\n- Process the entire table from top to bottom\n- Maintain consistent row numbering throughout\n", "results": {"text": "{\"rows\":[{\"row_number\":1,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Sek.\",\"interpretation\":\"Sekret\u00e4r\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Basel\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"III\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'400.-\",\"interpretation\":\"2400\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1946\",\"interpretation\":\"1946-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":2,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Sekret\u00e4r\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Basel\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"3\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 2'600.-\",\"interpretation\":\"2600\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1.April 1947\",\"interpretation\":\"1947-04-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":3,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Assist.\",\"interpretation\":\"Assistent\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Z\u00fcrich\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"IV\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'700.-\",\"interpretation\":\"3700\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Okt. 1948\",\"interpretation\":\"1948-10-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Bef\u00f6rderung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":4,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Assistent\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"Z\u00fcrich\",\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"\\\"\",\"interpretation\":\"4\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 3'900.-\",\"interpretation\":\"3900\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Jan. 1950\",\"interpretation\":\"1950-01-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"Lohnanpassung\",\"interpretation\":null,\"is_crossed_out\":false}},{\"row_number\":5,\"dienstliche_stellung\":{\"diplomatic_transcript\":\"Prof.\",\"interpretation\":\"Professor\",\"is_crossed_out\":false},\"dienstort\":{\"diplomatic_transcript\":\"Genf\",\"interpretation\":null,\"is_crossed_out\":false},\"gehaltsklasse\":{\"diplomatic_transcript\":\"V\",\"interpretation\":\"5\",\"is_crossed_out\":false},\"jahresgehalt_monatsgehalt_taglohn\":{\"diplomatic_transcript\":\"Fr. 5'094.-\",\"interpretation\":\"5094\",\"is_crossed_out\":false},\"datum_gehalts\u00e4nderung\":{\"diplomatic_transcript\":\"1. Sept. 1952\",\"interpretation\":\"1952-09-01\",\"is_crossed_out\":false},\"bemerkungen\":{\"diplomatic_transcript\":\"\",\"interpretation\":null,\"is_crossed_out\":false}}]}", "model": "mistral-large-2411", "provider": "mistral", "finish_reason": "stop", "usage": {"input_tokens": 2081, "output_tokens": 1679, "total_tokens": 3760, "input_cost_usd": 0.004162, "output_cost_usd": 0.010074, "estimated_cost_usd": 0.014235999999999999}, "duration": 987.7170779705048, "timestamp": "2026-02-09T23:02:32.185592", "parsed": {"rows": [{"row_number": 1, "dienstliche_stellung": {"diplomatic_transcript": "Sek.", "interpretation": "Sekret\u00e4r", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Basel", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "III", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'400.-", "interpretation": "2400", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1946", "interpretation": "1946-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 2, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Sekret\u00e4r", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Basel", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "3", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 2'600.-", "interpretation": "2600", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1.April 1947", "interpretation": "1947-04-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}, {"row_number": 3, "dienstliche_stellung": {"diplomatic_transcript": "Assist.", "interpretation": "Assistent", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Z\u00fcrich", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "IV", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'700.-", "interpretation": "3700", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Okt. 1948", "interpretation": "1948-10-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Bef\u00f6rderung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 4, "dienstliche_stellung": {"diplomatic_transcript": "\"", "interpretation": "Assistent", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "\"", "interpretation": "Z\u00fcrich", "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "\"", "interpretation": "4", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 3'900.-", "interpretation": "3900", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Jan. 1950", "interpretation": "1950-01-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "Lohnanpassung", "interpretation": null, "is_crossed_out": false}}, {"row_number": 5, "dienstliche_stellung": {"diplomatic_transcript": "Prof.", "interpretation": "Professor", "is_crossed_out": false}, "dienstort": {"diplomatic_transcript": "Genf", "interpretation": null, "is_crossed_out": false}, "gehaltsklasse": {"diplomatic_transcript": "V", "interpretation": "5", "is_crossed_out": false}, "jahresgehalt_monatsgehalt_taglohn": {"diplomatic_transcript": "Fr. 5'094.-", "interpretation": "5094", "is_crossed_out": false}, "datum_gehalts\u00e4nderung": {"diplomatic_transcript": "1. Sept. 1952", "interpretation": "1952-09-01", "is_crossed_out": false}, "bemerkungen": {"diplomatic_transcript": "", "interpretation": null, "is_crossed_out": false}}]}, "conversation_id": "9a0667fe-97f5-4d5b-a58a-4b891cc28682", "score": {"f1_score": 0.0, "precision": 0.0, "recall": 0.0, "true_positives": 0, "false_positives": 79, "false_negatives": 0, "field_scores": {"rows[0].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'400.-", "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Okt. 1948", "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'700.-", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstort.interpretation": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2400", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.interpretation": {"response": "Professor", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.interpretation": {"response": "1946-01-01", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.diplomatic_transcript": {"response": "Lohnanpassung", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3900", "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.interpretation": {"response": "Assistent", "ground_truth": null, "score": 0.0}, "rows[3].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.interpretation": {"response": "1948-10-01", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.interpretation": {"response": "Sekret\u00e4r", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.interpretation": {"response": "1947-04-01", "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 3'900.-", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.interpretation": {"response": "5", "ground_truth": null, "score": 0.0}, "rows[2].dienstort.diplomatic_transcript": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 5'094.-", "ground_truth": null, "score": 0.0}, "rows[1].gehaltsklasse.interpretation": {"response": "3", "ground_truth": null, "score": 0.0}, "rows[0].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1946", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.diplomatic_transcript": {"response": "Fr. 2'600.-", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1.April 1947", "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[0].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Sept. 1952", "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[4].bemerkungen.diplomatic_transcript": {"response": null, "ground_truth": null, "score": 1.0}, "rows[1].dienstliche_stellung.interpretation": {"response": "Sekret\u00e4r", "ground_truth": null, "score": 0.0}, "rows[4].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.interpretation": {"response": "4", "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].datum_gehalts\u00e4nderung.interpretation": {"response": "1952-09-01", "ground_truth": null, "score": 0.0}, "rows[0].dienstliche_stellung.diplomatic_transcript": {"response": "Sek.", "ground_truth": null, "score": 0.0}, "rows[2].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[0].dienstort.diplomatic_transcript": {"response": "Basel", "ground_truth": null, "score": 0.0}, "rows[1].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].dienstort.diplomatic_transcript": {"response": "Genf", "ground_truth": null, "score": 0.0}, "rows[2].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].dienstliche_stellung.diplomatic_transcript": {"response": "Prof.", "ground_truth": null, "score": 0.0}, "rows[3].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].dienstliche_stellung.diplomatic_transcript": {"response": "Assist.", "ground_truth": null, "score": 0.0}, "rows[2].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[0].datum_gehalts\u00e4nderung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].dienstort.interpretation": {"response": "Z\u00fcrich", "ground_truth": null, "score": 0.0}, "rows[0].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[1].dienstort.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.interpretation": {"response": "1950-01-01", "ground_truth": null, "score": 0.0}, "rows[3].dienstort.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "5094", "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].jahresgehalt_monatsgehalt_taglohn.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[4].gehaltsklasse.diplomatic_transcript": {"response": "V", "ground_truth": null, "score": 0.0}, "rows[4].dienstort.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[3].gehaltsklasse.diplomatic_transcript": {"response": "\"", "ground_truth": null, "score": 0.0}, "rows[1].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "2600", "ground_truth": null, "score": 0.0}, "rows[0].gehaltsklasse.diplomatic_transcript": {"response": "III", "ground_truth": null, "score": 0.0}, "rows[4].bemerkungen.interpretation": {"response": null, "ground_truth": null, "score": 1.0}, "rows[2].gehaltsklasse.diplomatic_transcript": {"response": "IV", "ground_truth": null, "score": 0.0}, "rows[1].bemerkungen.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].jahresgehalt_monatsgehalt_taglohn.interpretation": {"response": "3700", "ground_truth": null, "score": 0.0}, "rows[3].datum_gehalts\u00e4nderung.diplomatic_transcript": {"response": "1. Jan. 1950", "ground_truth": null, "score": 0.0}, "rows[3].dienstliche_stellung.interpretation": {"response": "Assistent", "ground_truth": null, "score": 0.0}, "rows[1].dienstliche_stellung.is_crossed_out": {"response": false, "ground_truth": null, "score": 0.0}, "rows[2].bemerkungen.diplomatic_transcript": {"response": "Bef\u00f6rderung", "ground_truth": null, "score": 0.0}}, "total_fields": 95}, "raw_response": "{\"id\":\"d3d32716bd27435d9920cc6b7e85f5b7\",\"object\":\"chat.completion\",\"model\":\"mistral-large-2411\",\"usage\":{\"prompt_tokens\":2081,\"completion_tokens\":1679,\"total_tokens\":3760,\"num_cached_tokens\":2112},\"created\":1770674460,\"choices\":[{\"index\":0,\"message\":{\"content\":\"{\\n \\\"rows\\\": [\\n {\\n \\\"row_number\\\": 1,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Sek.\\\",\\n \\\"interpretation\\\": \\\"Sekret\u00e4r\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Basel\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"III\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'400.-\\\",\\n \\\"interpretation\\\": \\\"2400\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1946\\\",\\n \\\"interpretation\\\": \\\"1946-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 2,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Sekret\u00e4r\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Basel\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"3\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 2'600.-\\\",\\n \\\"interpretation\\\": \\\"2600\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1.April 1947\\\",\\n \\\"interpretation\\\": \\\"1947-04-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 3,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Assist.\\\",\\n \\\"interpretation\\\": \\\"Assistent\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Z\u00fcrich\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"IV\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'700.-\\\",\\n \\\"interpretation\\\": \\\"3700\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Okt. 1948\\\",\\n \\\"interpretation\\\": \\\"1948-10-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Bef\u00f6rderung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 4,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Assistent\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"Z\u00fcrich\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\\\\\"\\\",\\n \\\"interpretation\\\": \\\"4\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 3'900.-\\\",\\n \\\"interpretation\\\": \\\"3900\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Jan. 1950\\\",\\n \\\"interpretation\\\": \\\"1950-01-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Lohnanpassung\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n },\\n {\\n \\\"row_number\\\": 5,\\n \\\"dienstliche_stellung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Prof.\\\",\\n \\\"interpretation\\\": \\\"Professor\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"dienstort\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Genf\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"gehaltsklasse\\\": {\\n \\\"diplomatic_transcript\\\": \\\"V\\\",\\n \\\"interpretation\\\": \\\"5\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"jahresgehalt_monatsgehalt_taglohn\\\": {\\n \\\"diplomatic_transcript\\\": \\\"Fr. 5'094.-\\\",\\n \\\"interpretation\\\": \\\"5094\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"datum_gehalts\u00e4nderung\\\": {\\n \\\"diplomatic_transcript\\\": \\\"1. Sept. 1952\\\",\\n \\\"interpretation\\\": \\\"1952-09-01\\\",\\n \\\"is_crossed_out\\\": false\\n },\\n \\\"bemerkungen\\\": {\\n \\\"diplomatic_transcript\\\": \\\"\\\",\\n \\\"interpretation\\\": null,\\n \\\"is_crossed_out\\\": false\\n }\\n }\\n ]\\n}\",\"tool_calls\":null,\"prefix\":false,\"role\":\"assistant\"},\"finish_reason\":\"stop\"}]}"}, "scoring": {"f1_micro": 0.06327991385317032, "f1_macro": 0.10622950819672132, "micro_precision": 0.03445778145695364, "micro_recall": 0.38690937257939584, "total_instances": 61, "total_tp": 999, "total_fp": 27993, "total_fn": 1583, "cost_summary": {"total_input_tokens": 125483, "total_output_tokens": 717530, "total_tokens": 843013, "input_cost_usd": 0.250966, "output_cost_usd": 4.30518, "total_cost_usd": 4.556145999999999}}, "normalized_score": 6.3279913853170315}]