{"_id": {"$oid": "69d4eb12b877594bc5718cce"}, "test_id": "T0708", "benchmark": "general_meeting_minutes", "date": "2026-03-17", "tags": {"document-type": ["minutes"], "writing": ["typed", "handwritten"], "century": [20], "language": ["it", "fr", "de"], "layout": ["table"], "entry-type": ["person", "location"], "task": ["information-extraction"]}, "contributors": ["alexandra_binnenkade", "sven_lienhard", "sorin_marti"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5.3-codex", "dataclass": "MinutesPage", "temperature": 1.0, "role_description": "You are a historian with expertise in analyzing and summarizing historical meeting minutes", "prompt_file": "updated_prompt.txt", "rules": "{\"api_style\":\"responses\"}", "legacy_test": false}, "prompt": "Extract the table content from the page image and return it in the required JSON structure.\n\nThe page contains a table of shareholders with the following columns:\n\n1. N\u00b0 D'ORDRE (row number)\n2. NOM, PR\u00c9NOMS ET DOMICILE DES ACTIONNAIRES (name and address)\n3. ACTIONS O\n4. ACTIONS P\n5. NOMBRE DE VOIX\n6. SIGNATURE DES ACTIONNAIRES OU DES MANDATAIRES\n\nROW STRUCTURE\n-------------\nEach entry begins with the row number in the first column.\nAll lines belonging to that number form one entry.\n\nThe second column contains BOTH name and address in the same field.\nSplit this content into:\n\n- name\n- address\n\nThe name is always the first line.\nAll following lines belong to the address.\n\nPreserve the line breaks inside the address exactly as in the source.\n\nDo NOT modify spelling or add accents. Transcribe the text exactly as shown.\n\nDashes inside addresses must be preserved.\nOnly remove a dash if it clearly separates the name from the address on the same line.\n\nNUMERIC COLUMNS\n---------------\nExtract the values from the table columns:\n\n- actions_o\n- actions_p\n- no_de_voix\n\nLeave fields empty if no value is present.\n\nSIGNATURE COLUMN\n----------------\nIf the signature column contains handwriting or text:\n\nsignature_present = true\nsignature = transcription of the visible text\n\nIf the column is empty:\n\nsignature_present = false\nsignature = \"\"\n\nTOTALS\n------\nTotals may appear below the table near the text \"A REPORTER\".\nOnly extract totals if explicit numbers are present.\nOtherwise return empty strings for:\n\ntotal_o\ntotal_p\ntotal_voix\n\nDOCUMENT METADATA\n-----------------\nfilename = {filename}\npage_number = {page_number}", "results": {"text": "{\"document\":\"Se_19_Assembl\u00e9e Mine d. Costano_1_Assemblee 28.12.1967_1_page_4\",\"page_number\":4,\"entries\":[{\"number\":\"1\",\"name\":\"Monsieur BREHAM Alain\",\"address\":\"45, bd du Commandant Charcot\\nNEUILLY S/SEINE\",\"actions_o\":\"179\",\"actions_p\":\"520\",\"no_de_voix\":\"699\",\"signature_present\":false,\"signature\":\"\"},{\"number\":\"2\",\"name\":\"Monsieur BREHAM Marc\",\"address\":\"La Tuillerie\\nSAINT NOM LA BRETECHE\",\"actions_o\":\"179\",\"actions_p\":\"520\",\"no_de_voix\":\"699\",\"signature_present\":false,\"signature\":\"\"},{\"number\":\"3\",\"name\":\"Monsieur MASSON Daniel\",\"address\":\"Villa La Cava Avenue de La Cava\\n06 / CANNES\",\"actions_o\":\"10\",\"actions_p\":\"\",\"no_de_voix\":\"10\",\"signature_present\":false,\"signature\":\"\"},{\"number\":\"4\",\"name\":\"Compagnie Centrale SICLI\",\"address\":\"II bis, rue Balzac\\nPARIS 8e\",\"actions_o\":\"168\",\"actions_p\":\"822\",\"no_de_voix\":\"990\",\"signature_present\":false,\"signature\":\"\"},{\"number\":\"5\",\"name\":\"Soci\u00e9t\u00e9 des Mines de l'Aurieras\",\"address\":\"II bis, rue Balzac\\nPARIS 8e\",\"actions_o\":\"45\",\"actions_p\":\"355\",\"no_de_voix\":\"400\",\"signature_present\":false,\"signature\":\"\"},{\"number\":\"6\",\"name\":\"Soci\u00e9t\u00e9 des Recherches-Mini\u00e8res\",\"address\":\"Fran\u00e7aises - II bis, rue Balzac\\nPARIS 8e\",\"actions_o\":\"10\",\"actions_p\":\"\",\"no_de_voix\":\"10\",\"signature_present\":false,\"signature\":\"\"},{\"number\":\"7\",\"name\":\"Monsieur PANI Antonio\",\"address\":\"SESSA   -   TESSIN\\nSUISSE\",\"actions_o\":\"10\",\"actions_p\":\"\",\"no_de_voix\":\"10\",\"signature_present\":false,\"signature\":\"\"}],\"total_actions\":{\"total_o\":\"\",\"total_p\":\"\",\"total_voix\":\"\"}}", "model": "gpt-5.3-codex", "provider": "openai", "finish_reason": "completed", "usage": {"input_tokens": 2651, "output_tokens": 445, "total_tokens": 3096, "input_cost_usd": 0.00463925, "output_cost_usd": 0.006229999999999999, "estimated_cost_usd": 0.01086925}, "duration": 5.810231447219849, "timestamp": "2026-03-17T22:54:30.664651", "parsed": {"document": "Se_19_Assembl\u00e9e Mine d. Costano_1_Assemblee 28.12.1967_1_page_4", "page_number": 4, "entries": [{"number": "1", "name": "Monsieur BREHAM Alain", "address": "45, bd du Commandant Charcot\nNEUILLY S/SEINE", "actions_o": "179", "actions_p": "520", "no_de_voix": "699", "signature_present": false, "signature": ""}, {"number": "2", "name": "Monsieur BREHAM Marc", "address": "La Tuillerie\nSAINT NOM LA BRETECHE", "actions_o": "179", "actions_p": "520", "no_de_voix": "699", "signature_present": false, "signature": ""}, {"number": "3", "name": "Monsieur MASSON Daniel", "address": "Villa La Cava Avenue de La Cava\n06 / CANNES", "actions_o": "10", "actions_p": "", "no_de_voix": "10", "signature_present": false, "signature": ""}, {"number": "4", "name": "Compagnie Centrale SICLI", "address": "II bis, rue Balzac\nPARIS 8e", "actions_o": "168", "actions_p": "822", "no_de_voix": "990", "signature_present": false, "signature": ""}, {"number": "5", "name": "Soci\u00e9t\u00e9 des Mines de l'Aurieras", "address": "II bis, rue Balzac\nPARIS 8e", "actions_o": "45", "actions_p": "355", "no_de_voix": "400", "signature_present": false, "signature": ""}, {"number": "6", "name": "Soci\u00e9t\u00e9 des Recherches-Mini\u00e8res", "address": "Fran\u00e7aises - II bis, rue Balzac\nPARIS 8e", "actions_o": "10", "actions_p": "", "no_de_voix": "10", "signature_present": false, "signature": ""}, {"number": "7", "name": "Monsieur PANI Antonio", "address": "SESSA   -   TESSIN\nSUISSE", "actions_o": "10", "actions_p": "", "no_de_voix": "10", "signature_present": false, "signature": ""}], "total_actions": {"total_o": "", "total_p": "", "total_voix": ""}}, "conversation_id": "b47cb205-cf26-48fa-a596-0677c6055bad", "score": {"fuzzy": 0.992292203906974}, "raw_response": "{\"id\":\"resp_0b883b64539df0da0069b9cd8fc9a08196be780ae213dee872\",\"created_at\":1773784463.0,\"error\":null,\"incomplete_details\":null,\"instructions\":\"You are a historian with expertise in analyzing and summarizing historical meeting minutes\",\"metadata\":{},\"model\":\"gpt-5.3-codex\",\"object\":\"response\",\"output\":[{\"id\":\"msg_0b883b64539df0da0069b9cd904130819682e2d70f9d8eec45\",\"content\":[{\"annotations\":[],\"text\":\"{\\\"document\\\":\\\"Se_19_Assembl\u00e9e Mine d. Costano_1_Assemblee 28.12.1967_1_page_4\\\",\\\"page_number\\\":4,\\\"entries\\\":[{\\\"number\\\":\\\"1\\\",\\\"name\\\":\\\"Monsieur BREHAM Alain\\\",\\\"address\\\":\\\"45, bd du Commandant Charcot\\\\nNEUILLY S/SEINE\\\",\\\"actions_o\\\":\\\"179\\\",\\\"actions_p\\\":\\\"520\\\",\\\"no_de_voix\\\":\\\"699\\\",\\\"signature_present\\\":false,\\\"signature\\\":\\\"\\\"},{\\\"number\\\":\\\"2\\\",\\\"name\\\":\\\"Monsieur BREHAM Marc\\\",\\\"address\\\":\\\"La Tuillerie\\\\nSAINT NOM LA BRETECHE\\\",\\\"actions_o\\\":\\\"179\\\",\\\"actions_p\\\":\\\"520\\\",\\\"no_de_voix\\\":\\\"699\\\",\\\"signature_present\\\":false,\\\"signature\\\":\\\"\\\"},{\\\"number\\\":\\\"3\\\",\\\"name\\\":\\\"Monsieur MASSON Daniel\\\",\\\"address\\\":\\\"Villa La Cava Avenue de La Cava\\\\n06 / CANNES\\\",\\\"actions_o\\\":\\\"10\\\",\\\"actions_p\\\":\\\"\\\",\\\"no_de_voix\\\":\\\"10\\\",\\\"signature_present\\\":false,\\\"signature\\\":\\\"\\\"},{\\\"number\\\":\\\"4\\\",\\\"name\\\":\\\"Compagnie Centrale SICLI\\\",\\\"address\\\":\\\"II bis, rue Balzac\\\\nPARIS 8e\\\",\\\"actions_o\\\":\\\"168\\\",\\\"actions_p\\\":\\\"822\\\",\\\"no_de_voix\\\":\\\"990\\\",\\\"signature_present\\\":false,\\\"signature\\\":\\\"\\\"},{\\\"number\\\":\\\"5\\\",\\\"name\\\":\\\"Soci\u00e9t\u00e9 des Mines de l'Aurieras\\\",\\\"address\\\":\\\"II bis, rue Balzac\\\\nPARIS 8e\\\",\\\"actions_o\\\":\\\"45\\\",\\\"actions_p\\\":\\\"355\\\",\\\"no_de_voix\\\":\\\"400\\\",\\\"signature_present\\\":false,\\\"signature\\\":\\\"\\\"},{\\\"number\\\":\\\"6\\\",\\\"name\\\":\\\"Soci\u00e9t\u00e9 des Recherches-Mini\u00e8res\\\",\\\"address\\\":\\\"Fran\u00e7aises - II bis, rue Balzac\\\\nPARIS 8e\\\",\\\"actions_o\\\":\\\"10\\\",\\\"actions_p\\\":\\\"\\\",\\\"no_de_voix\\\":\\\"10\\\",\\\"signature_present\\\":false,\\\"signature\\\":\\\"\\\"},{\\\"number\\\":\\\"7\\\",\\\"name\\\":\\\"Monsieur PANI Antonio\\\",\\\"address\\\":\\\"SESSA   -   TESSIN\\\\nSUISSE\\\",\\\"actions_o\\\":\\\"10\\\",\\\"actions_p\\\":\\\"\\\",\\\"no_de_voix\\\":\\\"10\\\",\\\"signature_present\\\":false,\\\"signature\\\":\\\"\\\"}],\\\"total_actions\\\":{\\\"total_o\\\":\\\"\\\",\\\"total_p\\\":\\\"\\\",\\\"total_voix\\\":\\\"\\\"}}\",\"type\":\"output_text\",\"logprobs\":[]}],\"role\":\"assistant\",\"status\":\"completed\",\"type\":\"message\",\"phase\":\"final_answer\"}],\"parallel_tool_calls\":true,\"temperature\":1.0,\"tool_choice\":\"auto\",\"tools\":[],\"top_p\":0.98,\"background\":false,\"completed_at\":1773784468.0,\"conversation\":null,\"max_output_tokens\":null,\"max_tool_calls\":null,\"previous_response_id\":null,\"prompt\":null,\"prompt_cache_key\":null,\"prompt_cache_retention\":null,\"reasoning\":{\"effort\":\"none\",\"generate_summary\":null,\"summary\":null},\"safety_identifier\":null,\"service_tier\":\"default\",\"status\":\"completed\",\"text\":{\"format\":{\"type\":\"text\"},\"verbosity\":\"medium\"},\"top_logprobs\":0,\"truncation\":\"disabled\",\"usage\":{\"input_tokens\":2651,\"input_tokens_details\":{\"cached_tokens\":0},\"output_tokens\":445,\"output_tokens_details\":{\"reasoning_tokens\":0},\"total_tokens\":3096},\"user\":null,\"billing\":{\"payer\":\"developer\"},\"frequency_penalty\":0.0,\"presence_penalty\":0.0,\"store\":true}"}, "scoring": {"fuzzy": 0.8296000958379444, "cost_summary": {"total_input_tokens": 23738, "total_output_tokens": 6323, "total_tokens": 30061, "input_cost_usd": 0.0415415, "output_cost_usd": 0.088522, "total_cost_usd": 0.1300635}}, "normalized_score": 82.96000958379443}