RISE Humanities Data Benchmark, 0.6.1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Search Results
Show compact results Refine Search New Search
Download JSON Download CSV

Your search for Benchmark 'general_meeting_minutes__true' with Search Hidden 'False' returned 190 results, showing page 1 of 19.
Result 1 of 190

Test T1823 at 2026-09-29

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

anthropic claude-opus-5-5 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score100.0%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 -
FRANCE CANNES","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRAN-
CAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"","total_p":"","total_voix":""}}

Scoring

Fuzzy score95.1%

Speed

Model time, all inputs138.9 s
Mean per input15.43 s
Slowest input26.33 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens47.4K
Output tokens14.9K
Total tokens62.4K
Input cost$0.1897
Output cost$0.2987
Total cost$0.4884

Priced from 2026-09-27 · Input $/M $4.00 · Output $/M $20.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 2 of 190

Test T1688 at 2026-09-29

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

anthropic claude-fable-5-1 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score100.0%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 -
FRANCE CANNES","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRAN-
CAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"","total_p":"","total_voix":""}}

Scoring

Fuzzy score93.9%

Speed

Model time, all inputs249.9 s
Mean per input27.77 s
Slowest input87.19 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens47.4K
Output tokens20.6K
Total tokens68K
Input cost$0.4742
Output cost$1.03
Total cost$1.51

Priced from 2026-09-08 · Input $/M $10.00 · Output $/M $50.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 3 of 190

Test T1883 at 2026-09-29

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

anthropic claude-sonnet-5-5 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score99.8%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 - CANNES
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRANCAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"","total_p":"","total_voix":""}}

Scoring

Fuzzy score92.0%

Speed

Model time, all inputs59.8 s
Mean per input6.65 s
Slowest input10.43 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens47.4K
Output tokens8.9K
Total tokens56.4K
Input cost$0.0949
Output cost$0.0893
Total cost$0.1842

Priced from 2026-09-28 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 4 of 190

Test T1808 at 2026-09-29

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

scicore Qwen3.8-Flash-Next-FP8 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score8.2%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"}","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"}","actions_p":"}","no_de_voix":"}","signature_present":false,"signature":"}"}],"total_actions":{"total_o":"}","total_p":"}","total_voix":"}"}}

Scoring

Fuzzy score65.3%

Speed

Model time, all inputs627.8 s
Mean per input69.75 s
Slowest input107.70 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens29.3K
Output tokens78.3K
Total tokens107.6K
Input cost$0.00
Output cost$0.00
Total cost$0.00

Priced from 2026-09-27 · Input $/M $0.00 · Output $/M $0.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 5 of 190

Test T1883 at 2026-09-28

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

anthropic claude-sonnet-5-5 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score34.4%

```json
{
  "filename": "Se_18_Assemblées_3_Bilanz1968_2_page_9",
  "page": 9,
  "entries": [
    {
      "order_number": 1,
      "name": "Monsieur BREHAM Alain",
      "address": "45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE",
      "actions_O": "179",
      "actions_P": "520",
      "number_of_votes": "699",
      "signature": ""
    },
    {
      "order_number": 2,
      "name": "Monsieur BREHAM Marc",
      "address": "la Tuilerie - ST NOM LA BRETECHE
FRANCE",
      "actions_O": "179",
      "actions_P": "520",
      "number_of_votes": "699",
      "signature": ""
    },
    {
      "order_number": 3,
      "name": "Monsieur MASSON Daniel",
      "address": "Villa la Cava, av. de la Cava 06 -
FRANCE CANNES",
      "actions_O": "10",
      "actions_P": "",
      "number_of_votes": "10",
      "signature": ""
    },
    {
      "order_number": 4,
      "name": "COMPAGNIE CENTRALE SICLI",
      "address": "2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL FRANCE",
      "actions_O": "168",
      "actions_P": "822",
      "number_of_votes": "990",
      "signature": ""
    },
    {
      "order_number": 5,
      "name": "SOCIETE DES MINES DE L'AURIERAS",
      "address": "11 bis rue Balzac PARIS 8e
FRANCE",
      "actions_O": "45",
      "actions_P": "355",
      "number_of_votes": "400",
      "signature": ""
    },
    {
      "order_number": 6,
      "name": "SOCIETE DE RECHERCHES MINIERES FRAN-
CAISES",
      "address": "11 bis rue Balzac PARIS 8e
FRANCE",
      "actions_O": "10",
      "actions_P": "",
      "number_of_votes": "10",
      "signature": ""
    },
    {
      "order_number": 7,
      "name": "Monsieur PANI Antonio",
      "address": "SESSA (Tessin)
SUISSE",
      "actions_O": "10",
      "actions_P": "",
      "number_of_votes": "10",
      "signature": ""
    }
  ],
  "footer": "A REPORTER"
}
```

You did not supply an output format, so I chose JSON. If you have a specific schema, I can restructure the data to match it.

Scoring

Fuzzy score25.4%

Speed

Model time, all inputs117.7 s
Mean per input13.07 s
Slowest input17.41 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens38.7K
Output tokens18.5K
Total tokens57.2K
Input cost$0.0775
Output cost$0.1846
Total cost$0.262

Priced from 2026-09-28 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 6 of 190

Test T1838 at 2026-09-27

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

openai gpt-6-sol · temp 1.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score99.7%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 -
FRANCE          CANNES","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL          FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRAN
CAISES","address":"11 bis rue Balzac  PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"","total_p":"","total_voix":""}}

Scoring

Fuzzy score85.8%

Speed

Model time, all inputs137.2 s
Mean per input15.25 s
Slowest input32.27 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens37.5K
Output tokens11.1K
Total tokens48.6K
Input cost$0.075
Output cost$0.1112
Total cost$0.1862

Priced from 2026-09-27 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 7 of 190

Test T1868 at 2026-09-27

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

x-ai grok-4.7 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score100.0%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 -
FRANCE CANNES","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRANCAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"","total_p":"","total_voix":""}}

Scoring

Fuzzy score87.2%

Speed

Model time, all inputs2203.2 s
Mean per input244.80 s
Slowest input461.40 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens37.8K
Output tokens6.2K
Total tokens44K
Input cost$0.0757
Output cost$0.037
Total cost$1.08
Reasoning cost usd$0.9675
Total reasoning tokens161.2K

Priced from 2026-09-27 · Input $/M $2.00 · Output $/M $6.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 8 of 190

Test T1853 at 2026-09-27

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

openai gpt-6-luna · temp 1.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score99.7%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"1a Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 - CANNES
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRAN-
CAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"","total_p":"","total_voix":""}}

Scoring

Fuzzy score87.4%

Speed

Model time, all inputs140.7 s
Mean per input15.63 s
Slowest input23.18 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens37.5K
Output tokens17.9K
Total tokens55.4K
Input cost$0.0038
Output cost$0.0089
Total cost$0.0127

Priced from 2026-09-27 · Input $/M $0.10 · Output $/M $0.50

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 9 of 190

Test T1823 at 2026-09-27

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

anthropic claude-opus-5-5 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score23.0%

No output format was included in your request, so I've used a structured JSON layout. I can convert it to CSV, XML or another schema if you tell me which one you need.

```json
{
  "filename": "Se_18_Assemblées_3_Bilanz1968_2_page_9",
  "page": 9,
  "document_type": "Feuille de présence – Assemblée Générale (liste des actionnaires)",
  "entries": [
    {
      "no_ordre": 1,
      "name": "Monsieur BREHAM Alain",
      "address": "45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE",
      "actions_O": 179,
      "actions_P": 520,
      "nombre_de_voix": 699,
      "signature": null
    },
    {
      "no_ordre": 2,
      "name": "Monsieur BREHAM Marc",
      "address": "la Tuilerie - ST NOM LA BRETECHE
FRANCE",
      "actions_O": 179,
      "actions_P": 520,
      "nombre_de_voix": 699,
      "signature": null
    },
    {
      "no_ordre": 3,
      "name": "Monsieur MASSON Daniel",
      "address": "Villa la Cava, av. de la Cava 06 -
FRANCE CANNES",
      "actions_O": 10,
      "actions_P": null,
      "nombre_de_voix": 10,
      "signature": null
    },
    {
      "no_ordre": 4,
      "name": "COMPAGNIE CENTRALE SICLI",
      "address": "2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL FRANCE",
      "actions_O": 168,
      "actions_P": 822,
      "nombre_de_voix": 990,
      "signature": null
    },
    {
      "no_ordre": 5,
      "name": "SOCIETE DES MINES DE L'AURIERAS",
      "address": "11 bis rue Balzac PARIS 8e
FRANCE",
      "actions_O": 45,
      "actions_P": 355,
      "nombre_de_voix": 400,
      "signature": null
    },
    {
      "no_ordre": 6,
      "name": "SOCIETE DE RECHERCHES MINIERES FRANCAISES",
      "address": "11 bis rue Balzac PARIS 8e
FRANCE",
      "actions_O": 10,
      "actions_P": null,
      "nombre_de_voix": 10,
      "signature": null
    },
    {
      "no_ordre": 7,
      "name": "Monsieur PANI Antonio",
      "address": "SESSA (Tessin)
SUISSE",
      "actions_O": 10,
      "actions_P": null,
      "nombre_de_voix": 10,
      "signature": null
    }
  ],
  "a_reporter": null
}
```

**Notes on extraction:**
- **Entry 3:** The dash after "06" belongs to the address ("06 - CANNES", i.e. département - town). It was kept, along with the original line layout.
- **Entry 4:** The dashes in "93 - LE BLANC-MESNIL" are part of the address and were kept.
- **Entry 6:** "FRAN-/CAISES" is a hyphenation across lines, not a separator. It was rejoined as "FRANCAISES" in the name field, and the address starts at "11 bis rue Balzac".
- **Empty fields:**
  - The "P" column is empty for entries 3, 6 and 7, so it is recorded as `null`.
  - All signature fields are blank.
  - The "A REPORTER" (carry-forward) total is not filled in.
- **Faint stamp:** A faint show-through stamp is visible in the background ("ASSEMBLÉE GÉNÉRALE … du 20 XII 68 … FEUILLE DE PRÉSENCE"). This suggests the meeting date was 20 December 1968, but this is not part of the table data.

Scoring

Fuzzy score23.1%

Speed

Model time, all inputs192.3 s
Mean per input21.37 s
Slowest input36.42 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens38.7K
Output tokens22K
Total tokens60.7K
Input cost$0.1549
Output cost$0.4392
Total cost$0.5942

Priced from 2026-09-27 · Input $/M $4.00 · Output $/M $20.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 10 of 190

Test T1261 at 2026-09-18

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

openrouter qwen/qwen3-vl-8b-thinking · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score94.5%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 - CANNES
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 – LE BLANC-MESNIL FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRAN-","address":"CAISES 11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"601","total_p":"2217","total_voix":"2818"}}

Scoring

Fuzzy score75.5%

Speed

Model time, all inputs1069.5 s
Mean per input118.83 s
Slowest input177.38 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens28.1K
Output tokens94.7K
Total tokens122.8K
Input cost$0.0051
Output cost$0.199
Total cost$0.204

Priced from 2026-09-16 · Input $/M $0.18 · Output $/M $2.10

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827