RISE Humanities Data Benchmark, 0.5.5

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Search Results
Show compact results Refine Search New Search
Download JSON Download CSV

Your search for Benchmark 'general_meeting_minutes__true' with Search Hidden 'False' returned 99 results, showing page 6 of 10.
Result 51 of 99

Test T1230 at 2026-07-03

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

genai gemini-2.5-pro · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score85.1%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 -
FRANCE
CANNES","actions_o":"","actions_p":"10","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL
FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRAN-
CAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"","actions_p":"10","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"","actions_p":"10","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"571","total_p":"2247","total_voix":"2818"}}

Scoring

Fuzzy score84.1%

Speed

Model time, all inputs275.7 s
Mean per input30.63 s
Slowest input56.82 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens3.4K
Output tokens9.2K
Total tokens12.5K
Input cost$0.0042
Output cost$0.0917
Total cost$0.096

Priced from 2026-03-02 · Input $/M $1.25 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 52 of 99

Test T1209 at 2026-07-03

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

anthropic claude-fable-5 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score99.7%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 -
CANNES
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL
FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRANCAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"","total_p":"","total_voix":""}}

Scoring

Fuzzy score92.5%

Speed

Model time, all inputs130.9 s
Mean per input14.55 s
Slowest input23.02 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens48.3K
Output tokens9.5K
Total tokens57.8K
Input cost$0.4832
Output cost$0.4762
Total cost$0.9594

Priced from 2026-07-02 · Input $/M $10.00 · Output $/M $50.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 53 of 99

Test T1252 at 2026-07-03

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

openai gpt-5.1-2025-11-13 · temp 1.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score99.7%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06
FRANCE
CANNES","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 LE BLANC-MESNIL
FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIEAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRAN-
CAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"","total_p":"","total_voix":""}}

Scoring

Fuzzy score80.0%

Speed

Model time, all inputs65.7 s
Mean per input7.30 s
Slowest input14.45 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens10.2K
Output tokens5.1K
Total tokens15.4K
Input cost$0.0128
Output cost$0.0514
Total cost$0.0642

Priced from 2026-03-02 · Input $/M $1.25 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 54 of 99

Test T1214 at 2026-07-03

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

anthropic claude-opus-4-7 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score99.7%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 - CANNES
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL   FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRANCAISES","address":"11 bis rue Balzac   PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"","total_p":"","total_voix":""}}

Scoring

Fuzzy score86.0%

Speed

Model time, all inputs133.2 s
Mean per input14.80 s
Slowest input26.14 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens51.9K
Output tokens9.2K
Total tokens61.1K
Input cost$0.2596
Output cost$0.2298
Total cost$0.4894

Priced from 2026-04-21 · Input $/M $5.00 · Output $/M $25.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 55 of 99

Test T1267 at 2026-07-03

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

openrouter qwen/qwen3.5-flash-20260224 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score94.3%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot NEUILLY-S/SEINE (92) FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie ST NOM LA BRETECHE FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 CANNES FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal 93 LE BLANC-MESNIL FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIÈRES FRANÇAISES","address":"11 bis rue Balzac PARIS 8e FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin) SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"591","total_p":"2217","total_voix":"2808"}}

Scoring

Fuzzy score86.2%

Speed

Model time, all inputs266.1 s
Mean per input29.57 s
Slowest input56.52 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens28K
Output tokens17.3K
Total tokens45.3K
Input cost$0.0018
Output cost$0.0045
Total cost$0.0063

Priced from 2026-04-21 · Input $/M $0.065 · Output $/M $0.26

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 56 of 99

Test T1238 at 2026-07-03

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

mistral ministral-8b-2512 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score94.6%

{"document":"Se_18_Assemblées_3_Bilanz1968_2","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 - CANNES
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL
FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRANCAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"541","total_p":"1697","total_voix":"2238"}}

Scoring

Fuzzy score78.3%

Speed

Model time, all inputs109.1 s
Mean per input12.12 s
Slowest input22.48 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens26.4K
Output tokens8K
Total tokens34.3K
Input cost$0.004
Output cost$0.0012
Total cost$0.0052

Priced from 2026-03-02 · Input $/M $0.15 · Output $/M $0.15

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 57 of 99

Test T1212 at 2026-07-03

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

anthropic claude-opus-4-5-20251101 · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score99.6%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 -
FRANCE                CANNES","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL        FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRANCAISES","address":"11 bis rue Balzac    PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"","total_p":"","total_voix":""}}

Scoring

Fuzzy score85.1%

Speed

Model time, all inputs129.3 s
Mean per input14.36 s
Slowest input24.85 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens25.1K
Output tokens7.8K
Total tokens32.9K
Input cost$0.1254
Output cost$0.1953
Total cost$0.3208

Priced from 2026-03-02 · Input $/M $5.00 · Output $/M $25.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 58 of 99

Test T1254 at 2026-07-03

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

openai o3-2025-04-16 · temp 1.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score94.8%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 -
CANNES
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL
FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRANCAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"601","total_p":"2217","total_voix":"2818"}}

Scoring

Fuzzy score75.2%

Speed

Model time, all inputs370.2 s
Mean per input41.13 s
Slowest input67.76 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens10.7K
Output tokens31.4K
Total tokens42.1K
Input cost$0.0214
Output cost$0.2512
Total cost$0.2726

Priced from 2026-03-02 · Input $/M $2.00 · Output $/M $8.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 59 of 99

Test T1260 at 2026-07-03

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

openrouter qwen/qwen3-vl-8b-instruct · temp 0.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score94.7%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92) FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 - FRANCE CANNES","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal 93 - LE BLANC-MESNIL FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRAN-CAISES","address":"11 bis rue Balzac PARIS 8e FRANCE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin) SUISSE","actions_o":"10","actions_p":"","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"500","total_p":"1700","total_voix":"2000"}}

Scoring

Fuzzy score77.9%

Speed

Model time, all inputs100.9 s
Mean per input11.21 s
Slowest input22.29 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens25K
Output tokens9.5K
Total tokens34.5K
Input cost$0.002
Output cost$0.0047
Total cost$0.0067

Priced from 2026-03-02 · Input $/M $0.08 · Output $/M $0.50

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 60 of 99

Test T1249 at 2026-07-03

minutes information-extraction typed, handwritten 20 it, fr, de table person, location

openai gpt-5-2025-08-07 · temp 1.0 · dataclass MinutesPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score88.3%

{"document":"Se_18_Assemblées_3_Bilanz1968_2_page_9","page_number":9,"entries":[{"number":"1","name":"Monsieur BREHAM Alain","address":"45 bd Charcot - NEUILLY-S/SEINE (92)
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"2","name":"Monsieur BREHAM Marc","address":"la Tuilerie - ST NOM LA BRETECHE
FRANCE","actions_o":"179","actions_p":"520","no_de_voix":"699","signature_present":false,"signature":""},{"number":"3","name":"Monsieur MASSON Daniel","address":"Villa la Cava, av. de la Cava 06 -
CANNES
FRANCE","actions_o":"0","actions_p":"10","no_de_voix":"10","signature_present":false,"signature":""},{"number":"4","name":"COMPAGNIE CENTRALE SICLI","address":"2/4 rue Blaise Pascal
93 - LE BLANC-MESNIL
FRANCE","actions_o":"168","actions_p":"822","no_de_voix":"990","signature_present":false,"signature":""},{"number":"5","name":"SOCIETE DES MINES DE L'AURIERAS","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"45","actions_p":"355","no_de_voix":"400","signature_present":false,"signature":""},{"number":"6","name":"SOCIETE DE RECHERCHES MINIERES FRANCAISES","address":"11 bis rue Balzac PARIS 8e
FRANCE","actions_o":"0","actions_p":"10","no_de_voix":"10","signature_present":false,"signature":""},{"number":"7","name":"Monsieur PANI Antonio","address":"SESSA (Tessin)
SUISSE","actions_o":"0","actions_p":"10","no_de_voix":"10","signature_present":false,"signature":""}],"total_actions":{"total_o":"571","total_p":"2247","total_voix":"2818"}}

Scoring

Fuzzy score76.9%

Speed

Model time, all inputs705.5 s
Mean per input78.39 s
Slowest input125.80 s
Inputs timed9

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens10.2K
Output tokens51.1K
Total tokens61.3K
Input cost$0.0128
Output cost$0.5109
Total cost$0.5237

Priced from 2026-03-02 · Input $/M $1.25 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827