RISE Humanities Data Benchmark, 0.6.1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Search Results
Show compact results Refine Search New Search
Download JSON Download CSV (Downloads are limited to 250 results.)

Your search for Benchmark 'company_lists__true' with Search Hidden 'False' returned 358 results, showing page 1 of 36.
Result 1 of 358

Test T1818 at 2026-09-29

book-page information-extraction printed 20 en, de list company

anthropic claude-opus-5-5 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision1.6%
Recall1.5%
True positives1
False positives61
False negatives64
F1 score2.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"24-1","company_name":"A. Boreux","location":null},{"entry_id":"24-2","company_name":"Brunnenverwaltung Eptingen Singer & Buchenhorner A.-G.","location":null},{"entry_id":"24-3","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":null},{"entry_id":"24-4","company_name":"Ausstattungsmagazine Ed. Senft","location":null},{"entry_id":"24-5","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":null},{"entry_id":"24-6","company_name":"Adolf Bürgin","location":null},{"entry_id":"24-7","company_name":"Bussinger & Cie.","location":null},{"entry_id":"24-8","company_name":"Fränkel & Voellmy","location":null},{"entry_id":"24-9","company_name":"H. Hartmann","location":null},{"entry_id":"24-10","company_name":"Kunsthandlung Rath","location":null},{"entry_id":"24-11","company_name":"M. Russ","location":null},{"entry_id":"24-12","company_name":"Alf. Schray","location":null},{"entry_id":"24-13","company_name":"Wolf & Glatz","location":null},{"entry_id":"24-14","company_name":"Gebr. Antonietti","location":null},{"entry_id":"24-15","company_name":"A.-G. Bächtold & Cie.","location":null},{"entry_id":"24-16","company_name":"Maschinenfabrik Burckhardt A.-G.","location":null},{"entry_id":"24-17","company_name":"G. Meidinger & Cie.","location":null},{"entry_id":"24-18","company_name":"A.-G. für Motorlastwagen Soller","location":null},{"entry_id":"24-19","company_name":"Hug & Co.","location":null},{"entry_id":"24-20","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":null},{"entry_id":"24-21","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":null},{"entry_id":"24-22","company_name":"Henri Grunauer","location":null},{"entry_id":"24-23","company_name":"Hans Ritter-Soder","location":null},{"entry_id":"24-24","company_name":"Alb. Singeisen-Halder","location":null},{"entry_id":"24-25","company_name":"Ch. H. Pfister & Co.","location":null},{"entry_id":"24-26","company_name":"E. Müry & Cie.","location":null},{"entry_id":"24-27","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"24-28","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":null},{"entry_id":"24-29","company_name":"G. P. Richter","location":null},{"entry_id":"24-30","company_name":"E. H. Schacke","location":null}]}

Scoring

F1 micro46.3%
F1 macro45.3%
Micro precision46.4%
Micro recall46.1%
Instances15
True positives457
False positives527
False negatives535

Speed

Model time, all inputs174.8 s
Mean per input11.66 s
Slowest input17.15 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens71.8K
Output tokens19.6K
Total tokens91.4K
Input cost$0.2872
Output cost$0.3912
Total cost$0.6784

Priced from 2026-09-27 · Input $/M $4.00 · Output $/M $20.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 2 of 358

Test T1878 at 2026-09-29

book-page information-extraction printed 20 en, de list company

anthropic claude-sonnet-5-5 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision50.0%
Recall49.2%
True positives32
False positives32
False negatives33
F1 score50.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"24-1","company_name":"A. Boreux","location":null},{"entry_id":"24-2","company_name":"Brunnenverwaltung Eptingen","location":null},{"entry_id":"24-3","company_name":"Singer & Buchenhorner A.-G.","location":null},{"entry_id":"24-4","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":null},{"entry_id":"24-5","company_name":"Ausstattungsmagazine Ed. Senft","location":null},{"entry_id":"24-6","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":null},{"entry_id":"24-7","company_name":"Adolf Bürgin","location":null},{"entry_id":"24-8","company_name":"Bussinger & Cie.","location":null},{"entry_id":"24-9","company_name":"Fränkel & Voellmy","location":null},{"entry_id":"24-10","company_name":"H. Hartmann","location":null},{"entry_id":"24-11","company_name":"Kunsthandlung Rath","location":null},{"entry_id":"24-12","company_name":"M. Russ","location":null},{"entry_id":"24-13","company_name":"Alf. Schray","location":null},{"entry_id":"24-14","company_name":"Wolf & Glatz","location":null},{"entry_id":"24-15","company_name":"Gebr. Antonietti","location":null},{"entry_id":"24-16","company_name":"A.-G. Bächtold & Cie.","location":null},{"entry_id":"24-17","company_name":"Maschinenfabrik Burckhardt A.-G.","location":null},{"entry_id":"24-18","company_name":"G. Meidinger & Cie.","location":null},{"entry_id":"24-19","company_name":"A.-G. für Motorlastwagen Soller","location":null},{"entry_id":"24-20","company_name":"Hug & Co.","location":null},{"entry_id":"24-21","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":null},{"entry_id":"24-22","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":null},{"entry_id":"24-23","company_name":"Henri Grunauer","location":null},{"entry_id":"24-24","company_name":"Hans Ritter-Soder","location":null},{"entry_id":"24-25","company_name":"Alb. Singeisen-Halder","location":null},{"entry_id":"24-26","company_name":"Ch. H. Pfister & Co.","location":null},{"entry_id":"24-27","company_name":"E. Müry & Cie.","location":null},{"entry_id":"24-28","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"24-29","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":null},{"entry_id":"24-30","company_name":"G. P. Richter","location":null},{"entry_id":"24-31","company_name":"E. H. Schacke","location":null}]}

Scoring

F1 micro50.8%
F1 macro51.9%
Micro precision50.9%
Micro recall50.6%
Instances15
True positives502
False positives484
False negatives490

Speed

Model time, all inputs99.2 s
Mean per input6.62 s
Slowest input10.40 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens71.8K
Output tokens16.7K
Total tokens88.5K
Input cost$0.1436
Output cost$0.1668
Total cost$0.3104

Priced from 2026-09-28 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 3 of 358

Test T1803 at 2026-09-29

book-page information-extraction printed 20 en, de list company

scicore Qwen3.8-Flash-Next-FP8 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision48.5%
Recall49.2%
True positives32
False positives34
False negatives33
F1 score49.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"24-1","company_name":"A. Boreux","location":null},{"entry_id":"24-2","company_name":"Brunnenverwaltung Eptingen","location":"Eptingen"},{"entry_id":"24-3","company_name":"Singer & Buchenhorner A.-G.","location":null},{"entry_id":"24-4","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":null},{"entry_id":"24-5","company_name":"Ausstattungsmagazine Ed. Senft","location":null},{"entry_id":"24-6","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":null},{"entry_id":"24-7","company_name":"Adolf Bürgin","location":null},{"entry_id":"24-8","company_name":"Bussinger & Cie.","location":null},{"entry_id":"24-9","company_name":"Fränkel & Voellmy","location":null},{"entry_id":"24-10","company_name":"H. Hartmann","location":null},{"entry_id":"24-11","company_name":"Kunsthandlung Rath","location":null},{"entry_id":"24-12","company_name":"M. Russ","location":null},{"entry_id":"24-13","company_name":"Alf. Schray","location":null},{"entry_id":"24-14","company_name":"Wolf & Glatz","location":null},{"entry_id":"24-15","company_name":"Gebr. Antonietti","location":null},{"entry_id":"24-16","company_name":"A.-G. Bächtold & Cie.","location":null},{"entry_id":"24-17","company_name":"Maschinenfabrik Burckhardt A.-G.","location":null},{"entry_id":"24-18","company_name":"G. Meidinger & Cie.","location":null},{"entry_id":"24-19","company_name":"A.-G. für Motorlastwagen Soller","location":null},{"entry_id":"24-20","company_name":"Hug & Co.","location":null},{"entry_id":"24-21","company_name":"Schweiz. Geigenbaugesellschaft","location":"Liestal"},{"entry_id":"24-22","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":null},{"entry_id":"24-23","company_name":"Henri Grunauer","location":null},{"entry_id":"24-24","company_name":"Hans Ritter-Soder","location":null},{"entry_id":"24-25","company_name":"Alb. Singeisen-Halder","location":null},{"entry_id":"24-26","company_name":"Ch. H. Pfister & Co.","location":null},{"entry_id":"24-27","company_name":"E. Müry & Cie.","location":null},{"entry_id":"24-28","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"24-29","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":null},{"entry_id":"24-30","company_name":"G. P. Richter","location":null},{"entry_id":"24-31","company_name":"E. H. Schacke","location":null}]}

Scoring

F1 micro55.9%
F1 macro55.0%
Micro precision56.0%
Micro recall55.8%
Instances15
True positives554
False positives436
False negatives438

Speed

Model time, all inputs338.8 s
Mean per input22.58 s
Slowest input41.77 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens47.9K
Output tokens41.4K
Total tokens89.2K
Input cost$0.00
Output cost$0.00
Total cost$0.00

Priced from 2026-09-27 · Input $/M $0.00 · Output $/M $0.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 4 of 358

Test T1804 at 2026-09-29

book-page information-extraction printed 20 en, de list company

scicore Qwen3.8-Flash-Next-FP8 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision47.6%
Recall46.2%
True positives30
False positives33
False negatives35
F1 score47.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"24-1","company_name":"A. Boreux","location":null},{"entry_id":"24-2","company_name":"Brunnenverwaltung Eptingen","location":null},{"entry_id":"24-3","company_name":"Singer & Buchenhorner A.-G.","location":null},{"entry_id":"24-4","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":null},{"entry_id":"24-5","company_name":"Ausstattungsmagazine Ed. Senft.","location":null},{"entry_id":"24-6","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":null},{"entry_id":"24-7","company_name":"Adolf Bürgin.","location":null},{"entry_id":"24-8","company_name":"Bussinger & Cie.","location":null},{"entry_id":"24-9","company_name":"Fränkel & Voellmy.","location":null},{"entry_id":"24-10","company_name":"H. Hartmann.","location":null},{"entry_id":"24-11","company_name":"Kunsthandlung Rath.","location":null},{"entry_id":"24-12","company_name":"M. Russ.","location":null},{"entry_id":"24-13","company_name":"Alf. Schray","location":null},{"entry_id":"24-14","company_name":"Wolf & Glatz.","location":null},{"entry_id":"24-15","company_name":"Gebr. Antonietti.","location":null},{"entry_id":"24-16","company_name":"A.-G. Bächtold & Cie.","location":null},{"entry_id":"24-17","company_name":"Maschinenfabrik Burckhardt A.-G.","location":null},{"entry_id":"24-18","company_name":"G. Meidinger & Cie.","location":null},{"entry_id":"24-19","company_name":"A.-G. für Motorlastwagen Soller","location":null},{"entry_id":"24-20","company_name":"Hug & Co.","location":null},{"entry_id":"24-21","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":null},{"entry_id":"24-22","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":null},{"entry_id":"24-23","company_name":"Henri Grunauer.","location":null},{"entry_id":"24-24","company_name":"Hans Ritter-Soder.","location":null},{"entry_id":"24-25","company_name":"Alb. Singeisen-Halder.","location":null},{"entry_id":"24-26","company_name":"Ch. H. Pfister & Co.","location":null},{"entry_id":"24-27","company_name":"E. Müry & Cie.","location":null},{"entry_id":"24-28","company_name":"Affentranger, Haas & Plattner, Niederdorf","location":null},{"entry_id":"24-29","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":null},{"entry_id":"24-30","company_name":"G. P. Richter","location":null},{"entry_id":"24-31","company_name":"E. H. Schacke","location":null}]}

Scoring

F1 micro43.9%
F1 macro42.7%
Micro precision44.2%
Micro recall43.8%
Instances15
True positives434
False positives549
False negatives558

Speed

Model time, all inputs142.6 s
Mean per input9.50 s
Slowest input14.98 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens42.3K
Output tokens16.1K
Total tokens58.4K
Input cost$0.00
Output cost$0.00
Total cost$0.00

Priced from 2026-09-27 · Input $/M $0.00 · Output $/M $0.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 5 of 358

Test T1683 at 2026-09-29

book-page information-extraction printed 20 en, de list company

anthropic claude-fable-5-1 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision1.6%
Recall1.5%
True positives1
False positives63
False negatives64
F1 score2.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"24-1","company_name":"A. Boreux","location":null},{"entry_id":"24-2","company_name":"Brunnenverwaltung Eptingen Singer & Buchenhorner A.-G.","location":"Eptingen"},{"entry_id":"24-3","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":null},{"entry_id":"24-4","company_name":"Ausstattungsmagazine Ed. Senft","location":null},{"entry_id":"24-5","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":null},{"entry_id":"24-6","company_name":"Adolf Bürgin","location":null},{"entry_id":"24-7","company_name":"Bussinger & Cie.","location":null},{"entry_id":"24-8","company_name":"Fränkel & Voellmy","location":null},{"entry_id":"24-9","company_name":"H. Hartmann","location":null},{"entry_id":"24-10","company_name":"Kunsthandlung Rath","location":null},{"entry_id":"24-11","company_name":"M. Russ","location":null},{"entry_id":"24-12","company_name":"Alf. Schray","location":null},{"entry_id":"24-13","company_name":"Wolf & Glatz","location":null},{"entry_id":"24-14","company_name":"Gebr. Antonietti","location":null},{"entry_id":"24-15","company_name":"A.-G. Bächtold & Cie.","location":null},{"entry_id":"24-16","company_name":"Maschinenfabrik Burckhardt A.-G.","location":null},{"entry_id":"24-17","company_name":"G. Meidinger & Cie.","location":null},{"entry_id":"24-18","company_name":"A.-G. für Motorlastwagen Soller","location":null},{"entry_id":"24-19","company_name":"Hug & Co.","location":null},{"entry_id":"24-20","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":"Liestal"},{"entry_id":"24-21","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":null},{"entry_id":"24-22","company_name":"Henri Grunauer","location":null},{"entry_id":"24-23","company_name":"Hans Ritter-Soder","location":null},{"entry_id":"24-24","company_name":"Alb. Singeisen-Halder","location":null},{"entry_id":"24-25","company_name":"Ch. H. Pfister & Co.","location":null},{"entry_id":"24-26","company_name":"E. Müry & Cie.","location":null},{"entry_id":"24-27","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"24-28","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":null},{"entry_id":"24-29","company_name":"G. P. Richter","location":null},{"entry_id":"24-30","company_name":"E. H. Schacke","location":null}]}

Scoring

F1 micro54.8%
F1 macro53.8%
Micro precision54.9%
Micro recall54.6%
Instances15
True positives542
False positives445
False negatives450

Speed

Model time, all inputs267.3 s
Mean per input17.82 s
Slowest input26.12 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens71.8K
Output tokens22.7K
Total tokens94.5K
Input cost$0.718
Output cost$1.14
Total cost$1.86

Priced from 2026-09-08 · Input $/M $10.00 · Output $/M $50.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 6 of 358

Test T1819 at 2026-09-29

book-page information-extraction printed 20 en, de list company

anthropic claude-opus-5-5 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision1.6%
Recall1.5%
True positives1
False positives63
False negatives64
F1 score2.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"1","company_name":"A. Boreux","location":null},{"entry_id":"2","company_name":"Brunnenverwaltung Eptingen Singer & Buchenhorner A.-G.","location":"Eptingen"},{"entry_id":"3","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":null},{"entry_id":"4","company_name":"Ausstattungsmagazine Ed. Senft","location":null},{"entry_id":"5","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":null},{"entry_id":"6","company_name":"Adolf Bürgin","location":null},{"entry_id":"7","company_name":"Bussinger & Cie.","location":null},{"entry_id":"8","company_name":"Fränkel & Voellmy","location":null},{"entry_id":"9","company_name":"H. Hartmann","location":null},{"entry_id":"10","company_name":"Kunsthandlung Rath","location":null},{"entry_id":"11","company_name":"M. Russ","location":null},{"entry_id":"12","company_name":"Alf. Schray","location":null},{"entry_id":"13","company_name":"Wolf & Glatz","location":null},{"entry_id":"14","company_name":"Gebr. Antonietti","location":null},{"entry_id":"15","company_name":"A.-G. Bächtold & Cie.","location":null},{"entry_id":"16","company_name":"Maschinenfabrik Burckhardt A.-G.","location":null},{"entry_id":"17","company_name":"G. Meidinger & Cie.","location":null},{"entry_id":"18","company_name":"A.-G. für Motorlastwagen Soller","location":null},{"entry_id":"19","company_name":"Hug & Co.","location":null},{"entry_id":"20","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":"Liestal"},{"entry_id":"21","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":null},{"entry_id":"22","company_name":"Henri Grunauer","location":null},{"entry_id":"23","company_name":"Hans Ritter-Soder","location":null},{"entry_id":"24","company_name":"Alb. Singeisen-Halder","location":null},{"entry_id":"25","company_name":"Ch. H. Pfister & Co.","location":null},{"entry_id":"26","company_name":"E. Müry & Cie.","location":null},{"entry_id":"27","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"28","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":null},{"entry_id":"29","company_name":"G. P. Richter","location":null},{"entry_id":"30","company_name":"E. H. Schacke","location":null}]}

Scoring

F1 micro45.1%
F1 macro44.0%
Micro precision45.2%
Micro recall45.0%
Instances15
True positives446
False positives541
False negatives546

Speed

Model time, all inputs181.0 s
Mean per input12.07 s
Slowest input17.57 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens64.7K
Output tokens20.1K
Total tokens84.7K
Input cost$0.2586
Output cost$0.4017
Total cost$0.6604

Priced from 2026-09-27 · Input $/M $4.00 · Output $/M $20.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 7 of 358

Test T1879 at 2026-09-29

book-page information-extraction printed 20 en, de list company

anthropic claude-sonnet-5-5 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision50.0%
Recall49.2%
True positives32
False positives32
False negatives33
F1 score50.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"1","company_name":"A. Boreux","location":null},{"entry_id":"2","company_name":"Brunnenverwaltung Eptingen","location":null},{"entry_id":"3","company_name":"Singer & Buchenhorner A.-G.","location":null},{"entry_id":"4","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":null},{"entry_id":"5","company_name":"Ausstattungsmagazine Ed. Senft","location":null},{"entry_id":"6","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":null},{"entry_id":"7","company_name":"Adolf Bürgin","location":null},{"entry_id":"8","company_name":"Bussinger & Cie.","location":null},{"entry_id":"9","company_name":"Fränkel & Voellmy","location":null},{"entry_id":"10","company_name":"H. Hartmann","location":null},{"entry_id":"11","company_name":"Kunsthandlung Rath","location":null},{"entry_id":"12","company_name":"M. Russ","location":null},{"entry_id":"13","company_name":"Alf. Schray","location":null},{"entry_id":"14","company_name":"Wolf & Glatz","location":null},{"entry_id":"15","company_name":"Gebr. Antonietti","location":null},{"entry_id":"16","company_name":"A.-G. Bächtold & Cie.","location":null},{"entry_id":"17","company_name":"Maschinenfabrik Burckhardt A.-G.","location":null},{"entry_id":"18","company_name":"G. Meidinger & Cie.","location":null},{"entry_id":"19","company_name":"A.-G. für Motorlastwagen Soller","location":null},{"entry_id":"20","company_name":"Hug & Co.","location":null},{"entry_id":"21","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":null},{"entry_id":"22","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":null},{"entry_id":"23","company_name":"Henri Grunauer","location":null},{"entry_id":"24","company_name":"Hans Ritter-Soder","location":null},{"entry_id":"25","company_name":"Alb. Singeisen-Halder","location":null},{"entry_id":"26","company_name":"Ch. H. Pfister & Co.","location":null},{"entry_id":"27","company_name":"E. Müry & Cie.","location":null},{"entry_id":"28","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"29","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":null},{"entry_id":"30","company_name":"G. P. Richter","location":null},{"entry_id":"31","company_name":"E. H. Schacke","location":null}]}

Scoring

F1 micro50.7%
F1 macro50.7%
Micro precision50.8%
Micro recall50.7%
Instances15
True positives503
False positives488
False negatives489

Speed

Model time, all inputs99.4 s
Mean per input6.62 s
Slowest input13.09 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens64.7K
Output tokens15.8K
Total tokens80.5K
Input cost$0.1293
Output cost$0.158
Total cost$0.2873

Priced from 2026-09-28 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 8 of 358

Test T1684 at 2026-09-29

book-page information-extraction printed 20 en, de list company

anthropic claude-fable-5-1 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision1.6%
Recall1.5%
True positives1
False positives63
False negatives64
F1 score2.0%
Total fields94

{"page_id":"{page_id}","entries":[{"entry_id":"24-01","company_name":"A. Boreux","location":null},{"entry_id":"24-02","company_name":"Brunnenverwaltung Eptingen Singer & Buchenhorner A.-G.","location":"Eptingen"},{"entry_id":"24-03","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":null},{"entry_id":"24-04","company_name":"Ausstattungsmagazine Ed. Senft","location":null},{"entry_id":"24-05","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":null},{"entry_id":"24-06","company_name":"Adolf Bürgin","location":null},{"entry_id":"24-07","company_name":"Bussinger & Cie.","location":null},{"entry_id":"24-08","company_name":"Fränkel & Voellmy","location":null},{"entry_id":"24-09","company_name":"H. Hartmann","location":null},{"entry_id":"24-10","company_name":"Kunsthandlung Rath","location":null},{"entry_id":"24-11","company_name":"M. Russ","location":null},{"entry_id":"24-12","company_name":"Alf. Schray","location":null},{"entry_id":"24-13","company_name":"Wolf & Glatz","location":null},{"entry_id":"24-14","company_name":"Gebr. Antonietti","location":null},{"entry_id":"24-15","company_name":"A.-G. Bächtold & Cie.","location":null},{"entry_id":"24-16","company_name":"Maschinenfabrik Burckhardt A.-G.","location":null},{"entry_id":"24-17","company_name":"G. Meidinger & Cie.","location":null},{"entry_id":"24-18","company_name":"A.-G. für Motorlastwagen Soller","location":null},{"entry_id":"24-19","company_name":"Hug & Co.","location":null},{"entry_id":"24-20","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":"Liestal"},{"entry_id":"24-21","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":null},{"entry_id":"24-22","company_name":"Henri Grunauer","location":null},{"entry_id":"24-23","company_name":"Hans Ritter-Soder","location":null},{"entry_id":"24-24","company_name":"Alb. Singeisen-Halder","location":null},{"entry_id":"24-25","company_name":"Ch. H. Pfister & Co.","location":null},{"entry_id":"24-26","company_name":"E. Müry & Cie.","location":null},{"entry_id":"24-27","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"24-28","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":null},{"entry_id":"24-29","company_name":"G. P. Richter","location":null},{"entry_id":"24-30","company_name":"E. H. Schacke","location":null}]}

Scoring

F1 micro44.3%
F1 macro43.6%
Micro precision44.3%
Micro recall44.3%
Instances15
True positives439
False positives551
False negatives553

Speed

Model time, all inputs335.2 s
Mean per input22.35 s
Slowest input32.80 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens64.7K
Output tokens29.1K
Total tokens93.7K
Input cost$0.6466
Output cost$1.45
Total cost$2.10

Priced from 2026-09-08 · Input $/M $10.00 · Output $/M $50.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 9 of 358

Test T1879 at 2026-09-28

book-page information-extraction printed 20 en, de list company

anthropic claude-sonnet-5-5 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision0.0%
Recall0.0%
True positives0
False positives19
False negatives65
F1 score0.0%
Total fields112

```json
{
  "page_id": "{page_id}",
  "error": "The page ID was given as the unfilled placeholder '{page_id}', so no actual ID value was supplied.",
  "page_number": 24,
  "language": "German",
  "document_type": "Directory of Swiss (Basel) manufacturers and suppliers, arranged by product category",
  "headings": [
    "Mikroskopie",
    "Mineralwasser",
    "Möbel, hölzerne",
    "Mosaik- und Terrazzo-Böden",
    "Motoren",
    "Motorlastwagen",
    "Musikinstrumente",
    "Musterkarten",
    "Magnesiacement",
    "Nähfaden",
    "Nähmaschinen",
    "Nähseide",
    "Nährsalzpräparate"
  ],
  "summary": "Page 24 of an early 20th-century trade directory. It lists firms by product category, including microscopy supplies, mineral water, wooden furniture, mosaic floors, motors, motor trucks, musical instruments, sample cards, magnesia cement, sewing thread, sewing machines, and nutrient salt preparations."
}
```

Scoring

F1 micro1.6%
F1 macro1.6%
Micro precision1.8%
Micro recall1.4%
Instances15
True positives14
False positives784
False negatives978

Speed

Model time, all inputs152.5 s
Mean per input10.17 s
Slowest input13.20 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens55.6K
Output tokens22.8K
Total tokens78.3K
Input cost$0.1111
Output cost$0.2276
Total cost$0.3387

Priced from 2026-09-28 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 10 of 358

Test T1878 at 2026-09-28

book-page information-extraction printed 20 en, de list company

anthropic claude-sonnet-5-5 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision50.8%
Recall49.2%
True positives32
False positives31
False negatives33
F1 score50.0%
Total fields94

```json
[
{"entry_id":"24-1","company_name":"A. Boreux","location":null},
{"entry_id":"24-2","company_name":"Brunnenverwaltung Eptingen","location":null},
{"entry_id":"24-3","company_name":"Singer & Buchenhorner A.-G.","location":null},
{"entry_id":"24-4","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":null},
{"entry_id":"24-5","company_name":"Ausstattungsmagazine Ed. Senft","location":null},
{"entry_id":"24-6","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":null},
{"entry_id":"24-7","company_name":"Adolf Bürgin","location":null},
{"entry_id":"24-8","company_name":"Bussinger & Cie.","location":null},
{"entry_id":"24-9","company_name":"Fränkel & Voellmy","location":null},
{"entry_id":"24-10","company_name":"H. Hartmann","location":null},
{"entry_id":"24-11","company_name":"Kunsthandlung Rath","location":null},
{"entry_id":"24-12","company_name":"M. Russ","location":null},
{"entry_id":"24-13","company_name":"Alf. Schray","location":null},
{"entry_id":"24-14","company_name":"Wolf & Glatz","location":null},
{"entry_id":"24-15","company_name":"Gebr. Antonietti","location":null},
{"entry_id":"24-16","company_name":"A.-G. Bächtold & Cie.","location":null},
{"entry_id":"24-17","company_name":"Maschinenfabrik Burckhardt A.-G.","location":null},
{"entry_id":"24-18","company_name":"G. Meidinger & Cie.","location":null},
{"entry_id":"24-19","company_name":"A.-G. für Motorlastwagen Soller","location":null},
{"entry_id":"24-20","company_name":"Hug & Co.","location":null},
{"entry_id":"24-21","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":null},
{"entry_id":"24-22","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":null},
{"entry_id":"24-23","company_name":"Henri Grunauer","location":null},
{"entry_id":"24-24","company_name":"Hans Ritter-Soder","location":null},
{"entry_id":"24-25","company_name":"Alb. Singeisen-Halder","location":null},
{"entry_id":"24-26","company_name":"Ch. H. Pfister & Co.","location":null},
{"entry_id":"24-27","company_name":"E. Müry & Cie.","location":null},
{"entry_id":"24-28","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},
{"entry_id":"24-29","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":null},
{"entry_id":"24-30","company_name":"G. P. Richter","location":null},
{"entry_id":"24-31","company_name":"E. H. Schacke","location":null}
]
```

Scoring

F1 micro51.4%
F1 macro53.1%
Micro precision51.8%
Micro recall50.9%
Instances15
True positives505
False positives469
False negatives487

Speed

Model time, all inputs96.8 s
Mean per input6.45 s
Slowest input10.40 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens62.7K
Output tokens16.1K
Total tokens78.8K
Input cost$0.1254
Output cost$0.1607
Total cost$0.2861

Priced from 2026-09-28 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827