{"_id": {"$oid": "69d4eb12b877594bc5718896"}, "test_id": "T0118", "benchmark": "business_letters", "date": "2025-08-13", "tags": {"document-type": ["letter"], "writing": ["typed", "handwritten"], "century": [20], "language": ["de"], "layout": ["prose"], "entry-type": ["person", "location"], "task": ["information-extraction"]}, "contributors": ["eric_decker", "maximilian_hindermann", "lea_kasper", "anthea_alberto", "pema_frick", "jose_luis_losada_palenzuela", "sorin_marti", "elena_spadini"], "hidden": false, "config": {"provider": "anthropic", "model": "claude-opus-4-1-20250805", "dataclass": "Document", "temperature": 0.0, "role_description": "You are a historian with keyword knowledge and an expert in the field of 20th century Swiss history", "prompt_file": "prompt.txt", "rules": "{\"skip_signatures\": true, \"skip_non_signatures\": false}", "legacy_test": false}, "prompt": "            IDENTITY and PURPOSE:\n\n            You are presented with a series of images constituting a historical letter. Your task is to extract the\n            values of the following keys from the letter and return them in a JSON file where the values\n            corresponding to each key should be stored as a list, even if there is only a single value for a\n            key:\n\n            - letter_title: Title of the letter.\n            - sender_persons: Name(s) of the person(s) who wrote the letter.\n            - send_date: The exact or approximate date the letter was written.\n            - receiver_persons: Name(s) of the person(s) who received the letter.\n\n            Take a deep breath and think step by step about how to best accomplish this goal. Map out all the claims\n            and implications on a virtual whiteboard in your mind. Do not use OCR. Use the ISO format YYYY-MM-DD for\n            dates. If a piece of information is not included in the letter, set the value for the corresponding key\n            to \"null\". Do not return anything except the JSON file.\n\n            EXAMPLE:\n\n            {\n                \"letter_title\": [\"Petition for Environmental Protection\"],\n                \"send_date\": [\"1993-03-12\"],\n                \"sender_persons\": [\"Lisa Simpson\"],\n                \"receiver_persons\": [\"Mayor Joe Quimby\", \"Seymour Skinner\"],\n            }\n\n            OUTPUT:", "results": {"provider": "anthropic", "model": "claude-opus-4-1-20250805", "duration": 6.777966737747192, "timestamp": "2025-08-13T13:38:12.218475", "text": "Looking at this historical German letter, I can identify the following information:\n\n```json\n{\n    \"letter_title\": [null],\n    \"send_date\": [\"1932-12-21\"],\n    \"sender_persons\": [null],\n    \"receiver_persons\": [\"Basler Rheinsschiffahrt-Aktiengesellschaft\"]\n}\n```\n\nThe letter is dated \"Basel, den 21.Dezember 1932\" (Basel, December 21, 1932) and is addressed to \"Basler Rheinsschiffahrt-Aktiengesellschaft\" (Basel Rhine Shipping Corporation) in Basel at Marktgasse 5. The sender's name is not visible in this portion of the letter, and there is no formal title given to the letter itself.", "finish_reason": "stop"}, "scoring": {"f1_macro": 0.48, "f1_micro": 0.52}, "normalized_score": 48.0}