{"_id": {"$oid": "69d4eb12b877594bc5718c81"}, "test_id": "T0626", "benchmark": "general_meeting_minutes", "date": "2026-03-12", "tags": {"document-type": ["minutes"], "writing": ["typed", "handwritten"], "century": [20], "language": ["it", "fr", "de"], "layout": ["table"], "entry-type": ["person", "location"], "task": ["information-extraction"]}, "contributors": ["alexandra_binnenkade", "sven_lienhard", "sorin_marti"], "hidden": false, "config": {"provider": "openai", "model": "gpt-5.2-2025-12-11", "dataclass": "MinutesPage", "temperature": 1.0, "role_description": "You are a historian with expertise in analyzing and summarizing historical meeting minutes", "prompt_file": "updated_prompt.txt", "legacy_test": false}, "prompt": "Extract the table content from the page image and return it in the required JSON structure.\n\nThe page contains a table of shareholders with the following columns:\n\n1. N\u00b0 D'ORDRE (row number)\n2. NOM, PR\u00c9NOMS ET DOMICILE DES ACTIONNAIRES (name and address)\n3. ACTIONS O\n4. ACTIONS P\n5. NOMBRE DE VOIX\n6. SIGNATURE DES ACTIONNAIRES OU DES MANDATAIRES\n\nROW STRUCTURE\n-------------\nEach entry begins with the row number in the first column.\nAll lines belonging to that number form one entry.\n\nThe second column contains BOTH name and address in the same field.\nSplit this content into:\n\n- name\n- address\n\nThe name is always the first line.\nAll following lines belong to the address.\n\nPreserve the line breaks inside the address exactly as in the source.\n\nDo NOT modify spelling or add accents. Transcribe the text exactly as shown.\n\nDashes inside addresses must be preserved.\nOnly remove a dash if it clearly separates the name from the address on the same line.\n\nNUMERIC COLUMNS\n---------------\nExtract the values from the table columns:\n\n- actions_o\n- actions_p\n- no_de_voix\n\nLeave fields empty if no value is present.\n\nSIGNATURE COLUMN\n----------------\nIf the signature column contains handwriting or text:\n\nsignature_present = true\nsignature = transcription of the visible text\n\nIf the column is empty:\n\nsignature_present = false\nsignature = \"\"\n\nTOTALS\n------\nTotals may appear below the table near the text \"A REPORTER\".\nOnly extract totals if explicit numbers are present.\nOtherwise return empty strings for:\n\ntotal_o\ntotal_p\ntotal_voix\n\nDOCUMENT METADATA\n-----------------\nfilename = {filename}\npage_number = {page_number}", "results": {"text": "{\"document\":\"Se_23_Assembl\u00e9e_1951_Generalversammlung5_page_20\",\"page_number\":20,\"entries\":[{\"number\":\"31\",\"name\":\"M. SIRCQUION Jacques\",\"address\":\"Meslieres (Doubs)\",\"actions_o\":\"\",\"actions_p\":\"\",\"no_de_voix\":\"\",\"signature_present\":false,\"signature\":\"\"},{\"number\":\"32\",\"name\":\"St\u00e9 Anonyme des Mines d'OR\",\"address\":\"du CHATELET 11bis rue Balzac\\nPARIS (8o)\",\"actions_o\":\"315\",\"actions_p\":\"15\",\"no_de_voix\":\"\",\"signature_present\":true,\"signature\":\"J. Jullien\"},{\"number\":\"33\",\"name\":\"M. STRAP Gaston\",\"address\":\"112 Bd Exelmans PARIS (16o)\",\"actions_o\":\"80\",\"actions_p\":\"64\",\"no_de_voix\":\"\",\"signature_present\":true,\"signature\":\"J. Jullien\"},{\"number\":\"34\",\"name\":\"M. STRAP Pierre\",\"address\":\"73,rue des Vignes PARIS (16o)\",\"actions_o\":\"\",\"actions_p\":\"1\",\"no_de_voix\":\"\",\"signature_present\":true,\"signature\":\"Hen. Pau\"},{\"number\":\"35\",\"name\":\"Mme WARNANT Pierre\",\"address\":\"148 Av.Franklin Roosevelt\\nBRUXELLES (Belgique)\",\"actions_o\":\"40\",\"actions_p\":\"\",\"no_de_voix\":\"\",\"signature_present\":false,\"signature\":\"\"},{\"number\":\"36\",\"name\":\"de ZANNA Arcangelo\",\"address\":\"\",\"actions_o\":\"\",\"actions_p\":\"1\",\"no_de_voix\":\"\",\"signature_present\":false,\"signature\":\"\"}],\"total_actions\":{\"total_o\":\"\",\"total_p\":\"\",\"total_voix\":\"\"}}", "model": "gpt-5.2-2025-12-11", "provider": "openai", "finish_reason": "stop", "usage": {"input_tokens": 10296, "output_tokens": 352, "total_tokens": 10648, "input_cost_usd": 0.018018, "output_cost_usd": 0.004928, "estimated_cost_usd": 0.022946}, "duration": 5.795086145401001, "timestamp": "2026-03-12T22:22:14.024980", "parsed": {"document": "Se_23_Assembl\u00e9e_1951_Generalversammlung5_page_20", "page_number": 20, "entries": [{"number": "31", "name": "M. SIRCQUION Jacques", "address": "Meslieres (Doubs)", "actions_o": "", "actions_p": "", "no_de_voix": "", "signature_present": false, "signature": ""}, {"number": "32", "name": "St\u00e9 Anonyme des Mines d'OR", "address": "du CHATELET 11bis rue Balzac\nPARIS (8o)", "actions_o": "315", "actions_p": "15", "no_de_voix": "", "signature_present": true, "signature": "J. Jullien"}, {"number": "33", "name": "M. STRAP Gaston", "address": "112 Bd Exelmans PARIS (16o)", "actions_o": "80", "actions_p": "64", "no_de_voix": "", "signature_present": true, "signature": "J. Jullien"}, {"number": "34", "name": "M. STRAP Pierre", "address": "73,rue des Vignes PARIS (16o)", "actions_o": "", "actions_p": "1", "no_de_voix": "", "signature_present": true, "signature": "Hen. Pau"}, {"number": "35", "name": "Mme WARNANT Pierre", "address": "148 Av.Franklin Roosevelt\nBRUXELLES (Belgique)", "actions_o": "40", "actions_p": "", "no_de_voix": "", "signature_present": false, "signature": ""}, {"number": "36", "name": "de ZANNA Arcangelo", "address": "", "actions_o": "", "actions_p": "1", "no_de_voix": "", "signature_present": false, "signature": ""}], "total_actions": {"total_o": "", "total_p": "", "total_voix": ""}}, "conversation_id": "c3c2246d-b36d-4753-99f0-b6f43e59c4e8", "score": {"fuzzy": 0.8309527327545633}, "raw_response": "{\"id\":\"chatcmpl-DIhlpOCj4C5lJGKTMsjHMbfjLFVCO\",\"choices\":[{\"finish_reason\":\"stop\",\"index\":0,\"logprobs\":null,\"message\":{\"content\":\"{\\\"document\\\":\\\"Se_23_Assembl\u00e9e_1951_Generalversammlung5_page_20\\\",\\\"page_number\\\":20,\\\"entries\\\":[{\\\"number\\\":\\\"31\\\",\\\"name\\\":\\\"M. SIRCQUION Jacques\\\",\\\"address\\\":\\\"Meslieres (Doubs)\\\",\\\"actions_o\\\":\\\"\\\",\\\"actions_p\\\":\\\"\\\",\\\"no_de_voix\\\":\\\"\\\",\\\"signature_present\\\":false,\\\"signature\\\":\\\"\\\"},{\\\"number\\\":\\\"32\\\",\\\"name\\\":\\\"St\u00e9 Anonyme des Mines d'OR\\\",\\\"address\\\":\\\"du CHATELET 11bis rue Balzac\\\\nPARIS (8o)\\\",\\\"actions_o\\\":\\\"315\\\",\\\"actions_p\\\":\\\"15\\\",\\\"no_de_voix\\\":\\\"\\\",\\\"signature_present\\\":true,\\\"signature\\\":\\\"J. Jullien\\\"},{\\\"number\\\":\\\"33\\\",\\\"name\\\":\\\"M. STRAP Gaston\\\",\\\"address\\\":\\\"112 Bd Exelmans PARIS (16o)\\\",\\\"actions_o\\\":\\\"80\\\",\\\"actions_p\\\":\\\"64\\\",\\\"no_de_voix\\\":\\\"\\\",\\\"signature_present\\\":true,\\\"signature\\\":\\\"J. Jullien\\\"},{\\\"number\\\":\\\"34\\\",\\\"name\\\":\\\"M. STRAP Pierre\\\",\\\"address\\\":\\\"73,rue des Vignes PARIS (16o)\\\",\\\"actions_o\\\":\\\"\\\",\\\"actions_p\\\":\\\"1\\\",\\\"no_de_voix\\\":\\\"\\\",\\\"signature_present\\\":true,\\\"signature\\\":\\\"Hen. Pau\\\"},{\\\"number\\\":\\\"35\\\",\\\"name\\\":\\\"Mme WARNANT Pierre\\\",\\\"address\\\":\\\"148 Av.Franklin Roosevelt\\\\nBRUXELLES (Belgique)\\\",\\\"actions_o\\\":\\\"40\\\",\\\"actions_p\\\":\\\"\\\",\\\"no_de_voix\\\":\\\"\\\",\\\"signature_present\\\":false,\\\"signature\\\":\\\"\\\"},{\\\"number\\\":\\\"36\\\",\\\"name\\\":\\\"de ZANNA Arcangelo\\\",\\\"address\\\":\\\"\\\",\\\"actions_o\\\":\\\"\\\",\\\"actions_p\\\":\\\"1\\\",\\\"no_de_voix\\\":\\\"\\\",\\\"signature_present\\\":false,\\\"signature\\\":\\\"\\\"}],\\\"total_actions\\\":{\\\"total_o\\\":\\\"\\\",\\\"total_p\\\":\\\"\\\",\\\"total_voix\\\":\\\"\\\"}}\",\"refusal\":null,\"role\":\"assistant\",\"annotations\":[],\"audio\":null,\"function_call\":null,\"tool_calls\":null,\"parsed\":{\"document\":\"Se_23_Assembl\u00e9e_1951_Generalversammlung5_page_20\",\"page_number\":20,\"entries\":[{\"number\":\"31\",\"name\":\"M. SIRCQUION Jacques\",\"address\":\"Meslieres (Doubs)\",\"actions_o\":\"\",\"actions_p\":\"\",\"no_de_voix\":\"\",\"signature_present\":false,\"signature\":\"\"},{\"number\":\"32\",\"name\":\"St\u00e9 Anonyme des Mines d'OR\",\"address\":\"du CHATELET 11bis rue Balzac\\nPARIS (8o)\",\"actions_o\":\"315\",\"actions_p\":\"15\",\"no_de_voix\":\"\",\"signature_present\":true,\"signature\":\"J. Jullien\"},{\"number\":\"33\",\"name\":\"M. STRAP Gaston\",\"address\":\"112 Bd Exelmans PARIS (16o)\",\"actions_o\":\"80\",\"actions_p\":\"64\",\"no_de_voix\":\"\",\"signature_present\":true,\"signature\":\"J. Jullien\"},{\"number\":\"34\",\"name\":\"M. STRAP Pierre\",\"address\":\"73,rue des Vignes PARIS (16o)\",\"actions_o\":\"\",\"actions_p\":\"1\",\"no_de_voix\":\"\",\"signature_present\":true,\"signature\":\"Hen. Pau\"},{\"number\":\"35\",\"name\":\"Mme WARNANT Pierre\",\"address\":\"148 Av.Franklin Roosevelt\\nBRUXELLES (Belgique)\",\"actions_o\":\"40\",\"actions_p\":\"\",\"no_de_voix\":\"\",\"signature_present\":false,\"signature\":\"\"},{\"number\":\"36\",\"name\":\"de ZANNA Arcangelo\",\"address\":\"\",\"actions_o\":\"\",\"actions_p\":\"1\",\"no_de_voix\":\"\",\"signature_present\":false,\"signature\":\"\"}],\"total_actions\":{\"total_o\":\"\",\"total_p\":\"\",\"total_voix\":\"\"}}}}],\"created\":1773350529,\"model\":\"gpt-5.2-2025-12-11\",\"object\":\"chat.completion\",\"service_tier\":\"default\",\"system_fingerprint\":null,\"usage\":{\"completion_tokens\":352,\"prompt_tokens\":10296,\"total_tokens\":10648,\"completion_tokens_details\":{\"accepted_prediction_tokens\":0,\"audio_tokens\":0,\"reasoning_tokens\":0,\"rejected_prediction_tokens\":0},\"prompt_tokens_details\":{\"audio_tokens\":0,\"cached_tokens\":0}}}"}, "scoring": {"fuzzy": 0.8100201654389452, "cost_summary": {"total_input_tokens": 56247, "total_output_tokens": 4941, "total_tokens": 61188, "input_cost_usd": 0.09843225, "output_cost_usd": 0.069174, "total_cost_usd": 0.16760624999999998}}, "normalized_score": 81.00201654389451}