RISE Humanities Data Benchmark, 0.5.5

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Search Results
Show compact results Refine Search New Search
Download JSON Download CSV

Your search for Benchmark 'company_lists__true' with Search Hidden 'False' returned 226 results, showing page 19 of 23.
Result 181 of 226

Test T0529 at 2026-01-24

book-page information-extraction printed 20 en, de list company

anthropic claude-haiku-4-5-20251001 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision42.4%
Recall43.1%
True positives28
False positives38
False negatives37
F1 score43.0%
Total fields94

{"page_id": "24", "entries": [{"entry_id": "24-1", "company_name": "A. Boreux", "location": null}, {"entry_id": "24-2", "company_name": "Brunnenverwaltung Eptingen", "location": null}, {"entry_id": "24-3", "company_name": "Singer & Buchehorner A.-G.", "location": null}, {"entry_id": "24-4", "company_name": "Alf. D\u00fcrr, J. H. Neukomm's Nachf. (k\u00fcnstliches)", "location": null}, {"entry_id": "24-5", "company_name": "Ausstattungsmagazine Ed. Senft", "location": null}, {"entry_id": "24-6", "company_name": "Basler M\u00f6belfabrik A.-G. vorm. Hermann Wagner & Cie.", "location": null}, {"entry_id": "24-7", "company_name": "Adolf B\u00fcrgin", "location": null}, {"entry_id": "24-8", "company_name": "Bussinger & Cie.", "location": null}, {"entry_id": "24-9", "company_name": "Fr\u00e4nkel & Voellmy", "location": null}, {"entry_id": "24-10", "company_name": "H. Hartmann", "location": null}, {"entry_id": "24-11", "company_name": "Kunsthandlung Rath", "location": null}, {"entry_id": "24-12", "company_name": "M. Russ", "location": null}, {"entry_id": "24-13", "company_name": "Alf. Schray (Kleinm\u00f6bel)", "location": null}, {"entry_id": "24-14", "company_name": "Wolf & Glatz", "location": null}, {"entry_id": "24-15", "company_name": "Gebr. Antonietti", "location": null}, {"entry_id": "24-16", "company_name": "A.-G. B\u00e4chtold & Cie.", "location": null}, {"entry_id": "24-17", "company_name": "Maschinenfabrik Burckhardt A.-G.", "location": null}, {"entry_id": "24-18", "company_name": "G. Meidinger & Cie.", "location": null}, {"entry_id": "24-19", "company_name": "A.-G. f\u00fcr Motorlastwagen Soller", "location": null}, {"entry_id": "24-20", "company_name": "Hug & Co. (Blechblasinstrumente)", "location": "Schweiz"}, {"entry_id": "24-21", "company_name": "Geigenbaugesellschaft Liestal", "location": "Geigen, Celli, B\u00e4sse, B\u00f6gen, Gitarren, Zithern"}, {"entry_id": "24-22", "company_name": "Schweizerisches Musikhaus Bannwart & Cie.", "location": null}, {"entry_id": "24-23", "company_name": "Henri Grunauer", "location": null}, {"entry_id": "24-24", "company_name": "Hans Ritter-Soder", "location": null}, {"entry_id": "24-25", "company_name": "Alb. Singeisen-Halder", "location": null}, {"entry_id": "24-26", "company_name": "Ch. H. Pfsler & Co.", "location": null}, {"entry_id": "24-27", "company_name": "E. M\u00fcry & Cie.", "location": null}, {"entry_id": "24-28", "company_name": "Affentranger, Haas & Plattner", "location": "Niederdorf"}, {"entry_id": "24-29", "company_name": "Schweizerische N\u00e4hmaschinenfabrik A.-G.", "location": null}, {"entry_id": "24-30", "company_name": "G. P. Richter", "location": null}, {"entry_id": "24-31", "company_name": "E. H. Schacke", "location": null}]}

Scoring

F1 micro48.7%
F1 macro49.1%
Micro precision48.7%
Micro recall48.7%
Instances15
True positives483
False positives509
False negatives509

Speed

Model time, all inputs119.1 s
Mean per input7.94 s
Slowest input13.90 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens41.6K
Output tokens17.3K
Total tokens58.9K
Input cost$0.0416
Output cost$0.0865
Total cost$0.1281

Priced from 2026-01-23 · Input $/M $1.00 · Output $/M $5.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 182 of 226

Test T0378 at 2026-01-24

book-page information-extraction printed 20 en, de list company

anthropic claude-opus-4-1-20250805 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision1.1%
Recall1.5%
True positives1
False positives90
False negatives64
F1 score1.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"1","company_name":"A. Boreux","location":"<UNKNOWN>"},{"entry_id":"2","company_name":"Brunnenverwaltung Eptingen Singer & Buchenhorner A.-G.","location":"Eptingen"},{"entry_id":"3","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":"<UNKNOWN>"},{"entry_id":"4","company_name":"Ausstattungsmagazine Ed. Senft","location":"<UNKNOWN>"},{"entry_id":"5","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":"Basel"},{"entry_id":"6","company_name":"Adolf Bürgin","location":"<UNKNOWN>"},{"entry_id":"7","company_name":"Bussinger & Cie.","location":"<UNKNOWN>"},{"entry_id":"8","company_name":"Fränkel & Voellmy","location":"<UNKNOWN>"},{"entry_id":"9","company_name":"H. Hartmann","location":"<UNKNOWN>"},{"entry_id":"10","company_name":"Kunsthandlung Rath","location":"<UNKNOWN>"},{"entry_id":"11","company_name":"M. Russ","location":"<UNKNOWN>"},{"entry_id":"12","company_name":"Alf. Schray","location":"<UNKNOWN>"},{"entry_id":"13","company_name":"Wolf & Glatz","location":"<UNKNOWN>"},{"entry_id":"14","company_name":"Gebr. Antonietti","location":"<UNKNOWN>"},{"entry_id":"15","company_name":"A.-G. Bächtold & Cie.","location":"<UNKNOWN>"},{"entry_id":"16","company_name":"Maschinenfabrik Burckhardt A.-G.","location":"<UNKNOWN>"},{"entry_id":"17","company_name":"G. Meidinger & Cie.","location":"<UNKNOWN>"},{"entry_id":"18","company_name":"A.-G. für Motorlastwagen Soller","location":"<UNKNOWN>"},{"entry_id":"19","company_name":"Hug & Co.","location":"<UNKNOWN>"},{"entry_id":"20","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":"Liestal"},{"entry_id":"21","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":"<UNKNOWN>"},{"entry_id":"22","company_name":"Henri Grunauer","location":"<UNKNOWN>"},{"entry_id":"23","company_name":"Hans Ritter-Soder","location":"<UNKNOWN>"},{"entry_id":"24","company_name":"Alb. Singeisen-Halder","location":"<UNKNOWN>"},{"entry_id":"25","company_name":"Ch. H. Pfister & Co.","location":"<UNKNOWN>"},{"entry_id":"26","company_name":"E. Müry & Cie.","location":"<UNKNOWN>"},{"entry_id":"27","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"28","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":"<UNKNOWN>"},{"entry_id":"29","company_name":"G. P. Richter","location":"<UNKNOWN>"},{"entry_id":"30","company_name":"E. H. Schacke","location":"<UNKNOWN>"}]}

Scoring

F1 micro46.0%
F1 macro45.9%
Micro precision45.0%
Micro recall47.2%
Instances15
True positives468
False positives573
False negatives524

Speed

Model time, all inputs346.9 s
Mean per input23.13 s
Slowest input38.86 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens31.7K
Output tokens15.9K
Total tokens47.6K
Input cost$0.4758
Output cost$1.19
Total cost$1.67

Priced from 2026-01-23 · Input $/M $15.00 · Output $/M $75.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 183 of 226

Test T0518 at 2026-01-24

book-page information-extraction printed 20 en, de list company

anthropic claude-opus-4-5-20251101 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision1.6%
Recall1.5%
True positives1
False positives62
False negatives64
F1 score2.0%
Total fields94

{"page_id": "24", "entries": [{"entry_id": "24-1", "company_name": "A. Boreux", "location": null}, {"entry_id": "24-2", "company_name": "Brunnenverwaltung Eptingen Singer & Buchenhorner A.-G.", "location": null}, {"entry_id": "24-3", "company_name": "Alf. D\u00fcrr, J. H. Neukomm's Nachf.", "location": null}, {"entry_id": "24-4", "company_name": "Ausstattungsmagazine Ed. Senft.", "location": null}, {"entry_id": "24-5", "company_name": "Basler M\u00f6belfabrik A.-G. vorm. Hermann Wagner & Cie.", "location": null}, {"entry_id": "24-6", "company_name": "Adolf B\u00fcrgin", "location": null}, {"entry_id": "24-7", "company_name": "Bussinger & Cie.", "location": null}, {"entry_id": "24-8", "company_name": "Fr\u00e4nkel & Voellmy", "location": null}, {"entry_id": "24-9", "company_name": "H. Hartmann", "location": null}, {"entry_id": "24-10", "company_name": "Kunsthandlung Rath", "location": null}, {"entry_id": "24-11", "company_name": "M. Russ", "location": null}, {"entry_id": "24-12", "company_name": "Alf. Schray (Kleinm\u00f6bel)", "location": null}, {"entry_id": "24-13", "company_name": "Wolf & Glatz", "location": null}, {"entry_id": "24-14", "company_name": "Gebr. Antonietti", "location": null}, {"entry_id": "24-15", "company_name": "A.-G. B\u00e4chtold & Cie.", "location": null}, {"entry_id": "24-16", "company_name": "Maschinenfabrik Burckhardt A.-G.", "location": null}, {"entry_id": "24-17", "company_name": "G. Meidinger & Cie.", "location": null}, {"entry_id": "24-18", "company_name": "A.-G. f\u00fcr Motorlastwagen Soller", "location": null}, {"entry_id": "24-19", "company_name": "Hug & Co.", "location": null}, {"entry_id": "24-20", "company_name": "Schweiz. Geigenbaugesellschaft", "location": "Liestal"}, {"entry_id": "24-21", "company_name": "Schweizerisches Musikhaus Bannwart & Cie.", "location": null}, {"entry_id": "24-22", "company_name": "Henri Grunauer", "location": null}, {"entry_id": "24-23", "company_name": "Hans Ritter-Soder", "location": null}, {"entry_id": "24-24", "company_name": "Alb. Singeisen-Halder", "location": null}, {"entry_id": "24-25", "company_name": "Ch. H. Pfister & Co.", "location": null}, {"entry_id": "24-26", "company_name": "E. M\u00fcry & Cie.", "location": null}, {"entry_id": "24-27", "company_name": "Affentranger, Haas & Plattner", "location": "Niederdorf"}, {"entry_id": "24-28", "company_name": "Schweizerische N\u00e4hmaschinenfabrik A.-G.", "location": null}, {"entry_id": "24-29", "company_name": "G. P. Richter", "location": null}, {"entry_id": "24-30", "company_name": "E. H. Schacke", "location": null}]}

Scoring

F1 micro54.0%
F1 macro53.8%
Micro precision54.2%
Micro recall53.8%
Instances15
True positives534
False positives451
False negatives458

Speed

Model time, all inputs201.9 s
Mean per input13.46 s
Slowest input22.78 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens41.6K
Output tokens13.3K
Total tokens54.9K
Input cost$0.208
Output cost$0.3316
Total cost$0.5396

Priced from 2026-01-23 · Input $/M $5.00 · Output $/M $25.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 184 of 226

Test T0363 at 2026-01-24

book-page information-extraction printed 20 en, de list company

genai gemini-2.5-flash-lite · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision1.4%
Recall1.5%
True positives1
False positives68
False negatives64
F1 score1.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"24-1","company_name":"Mikroskopie und Zubehör (Deckgläser, Objektträger, Cartonnage).","location":"A. Boreux."},{"entry_id":"24-2","company_name":"Mineralwasser.","location":"Brunnenverwaltung Eptingen"},{"entry_id":"24-3","company_name":"Singer & Buchenhorner A.-G.","location":"Alf. Dürr, J. H. Neukomm's Nachf. (künstliches)."},{"entry_id":"24-4","company_name":"Möbel, hölzerne.","location":"Ausstattungsmagazine Ed. Senft."},{"entry_id":"24-5","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":"Adolf Bürgin."},{"entry_id":"24-6","company_name":"Bussinger & Cie.","location":"Fränkel & Voellmy."},{"entry_id":"24-7","company_name":"H. Hartmann.","location":"Kunsthandlung Rath."},{"entry_id":"24-8","company_name":"M. Russ.","location":"Alf. Schray (Kleinmöbel)."},{"entry_id":"24-9","company_name":"Wolf & Glatz.","location":"Mosaik- und Terrazzo-Böden."},{"entry_id":"24-10","company_name":"Gebr. Antonietti.","location":"Motoren."},{"entry_id":"24-11","company_name":"A.-G. Bächtold & Cie. (Benzinmotoren, Dieselmotoren, Gasmotoren, Rohölmotoren, Sauggasmotoren, Schiffsmotoren).","location":"Maschinenfabrik Burckhardt A.-G. (Druckluftmotoren für Laboratorien)."},{"entry_id":"24-12","company_name":"G. Meidinger & Cie. (für Webstuhlantrieb, Centrifugenantrieb, fahrbare Motoren mit Zahnradbetrieb, Automobilmotoren).","location":"s. Elektromotoren."},{"entry_id":"24-13","company_name":"Motorlastwagen.","location":"A.-G. für Motorlastwagen Soller (auch Reparaturstücke)."},{"entry_id":"24-14","company_name":"Musikinstrumente.","location":"Hug & Co. (Blechblasinstrumente)."},{"entry_id":"24-15","company_name":"Schweiz. Geigenbaugesellschaft Liestal (Geigen, Celli, Bässe, Bögen, Gitarren, Zithern).","location":"Schweizerisches Musikhaus Bannwart & Cie. (Mundharmonikas, Ziehharmonikas, Zungenmusikinstrumente, Blechblasinstrumente)."},{"entry_id":"24-16","company_name":"Musterkarten für chemische Fabriken, Färbereien etc.","location":"Henri Grunauer."},{"entry_id":"24-17","company_name":"Hans Ritter-Soder.","location":"Alb. Singeisen-Halder."},{"entry_id":"24-18","company_name":"Magnesiacement.","location":"Ch. H. Pfister & Co."},{"entry_id":"24-19","company_name":"Nähfaden.","location":"E. Müry & Cie."},{"entry_id":"24-20","company_name":"Nähmaschinen.","location":"Affenträger, Haas & Plattner, Nieder- dorf (Schrauben und kleine Bestandteile für Nähmaschinen)."},{"entry_id":"24-21","company_name":"Schweizerische Nähmaschinenfabrik A.-G. (für Hand-, Fuss- und elektrischen Betrieb, Fabriktische für Kraftbetrieb).","location":"Nähseide, s. Flortseide."},{"entry_id":"24-22","company_name":"Nährsalzpräparate.","location":"G. P. Richter (Nährsalze «Gerstyl», Nährsalz - Bananencacao, Nährsalz - Hafercacao, Nährsalz - Kaffee)."},{"entry_id":"24-23","company_name":"E. H. Schacke (Nährsalz-Cacao, Nährsalz-Kaffee).","location":"null"}]}

Scoring

F1 micro32.7%
F1 macro33.6%
Micro precision33.7%
Micro recall31.8%
Instances15
True positives315
False positives620
False negatives677

Speed

Model time, all inputs60.7 s
Mean per input4.05 s
Slowest input7.94 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens9.9K
Output tokens17.3K
Total tokens27.2K
Input cost$0.001
Output cost$0.0069
Total cost$0.0079

Priced from 2026-01-23 · Input $/M $0.10 · Output $/M $0.40

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 185 of 226

Test T0362 at 2026-01-24

book-page information-extraction printed 20 en, de list company

genai gemini-2.5-pro · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision34.0%
Recall49.2%
True positives32
False positives62
False negatives33
F1 score40.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"24_1","company_name":"A. Boreux","location":"Basel"},{"entry_id":"24_2","company_name":"Brunnenverwaltung Eptingen","location":"Eptingen"},{"entry_id":"24_3","company_name":"Singer & Buchenhorner A.-G.","location":"Basel"},{"entry_id":"24_4","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":"Basel"},{"entry_id":"24_5","company_name":"Ausstattungsmagazine Ed. Senft","location":"Basel"},{"entry_id":"24_6","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":"Basel"},{"entry_id":"24_7","company_name":"Adolf Bürgin","location":"Basel"},{"entry_id":"24_8","company_name":"Bussinger & Cie.","location":"Basel"},{"entry_id":"24_9","company_name":"Fränkel & Voellmy","location":"Basel"},{"entry_id":"24_10","company_name":"H. Hartmann","location":"Basel"},{"entry_id":"24_11","company_name":"Kunsthandlung Rath","location":"Basel"},{"entry_id":"24_12","company_name":"M. Russ","location":"Basel"},{"entry_id":"24_13","company_name":"Alf. Schray","location":"Basel"},{"entry_id":"24_14","company_name":"Wolf & Glatz","location":"Basel"},{"entry_id":"24_15","company_name":"Gebr. Antonietti","location":"Basel"},{"entry_id":"24_16","company_name":"A.-G. Bächtold & Cie.","location":"Basel"},{"entry_id":"24_17","company_name":"Maschinenfabrik Burckhardt A.-G.","location":"Basel"},{"entry_id":"24_18","company_name":"G. Meidinger & Cie.","location":"Basel"},{"entry_id":"24_19","company_name":"A.-G. für Motorlastwagen Soller","location":"Basel"},{"entry_id":"24_20","company_name":"Hug & Co.","location":"Basel"},{"entry_id":"24_21","company_name":"Schweiz. Geigenbaugesellschaft","location":"Liestal"},{"entry_id":"24_22","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":"Basel"},{"entry_id":"24_23","company_name":"Henri Grunauer","location":"Basel"},{"entry_id":"24_24","company_name":"Hans Ritter-Soder","location":"Basel"},{"entry_id":"24_25","company_name":"Alb. Singeisen-Halder","location":"Basel"},{"entry_id":"24_26","company_name":"Ch. H. Pfister & Co.","location":"Basel"},{"entry_id":"24_27","company_name":"E. Müry & Cie.","location":"Basel"},{"entry_id":"24_28","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"24_29","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":"Basel"},{"entry_id":"24_30","company_name":"G. P. Richter","location":"Basel"},{"entry_id":"24_31","company_name":"E. H. Schacke","location":"Basel"}]}

Scoring

F1 micro45.5%
F1 macro46.4%
Micro precision45.7%
Micro recall45.3%
Instances15
True positives449
False positives533
False negatives543

Speed

Model time, all inputs341.7 s
Mean per input22.78 s
Slowest input49.65 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens4.3K
Output tokens14.9K
Total tokens19.1K
Input cost$0.0053
Output cost$0.1487
Total cost$0.154

Priced from 2026-01-23 · Input $/M $1.25 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 186 of 226

Test T0519 at 2026-01-24

book-page information-extraction printed 20 en, de list company

anthropic claude-opus-4-5-20251101 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision1.1%
Recall1.5%
True positives1
False positives90
False negatives64
F1 score1.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"1","company_name":"A. Boreux","location":"<UNKNOWN>"},{"entry_id":"2","company_name":"Brunnenverwaltung Eptingen Singer & Buchenhorner A.-G.","location":"<UNKNOWN>"},{"entry_id":"3","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":"<UNKNOWN>"},{"entry_id":"4","company_name":"Ausstattungsmagazine Ed. Senft.","location":"<UNKNOWN>"},{"entry_id":"5","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":"Basel"},{"entry_id":"6","company_name":"Adolf Bürgin","location":"<UNKNOWN>"},{"entry_id":"7","company_name":"Bussinger & Cie.","location":"<UNKNOWN>"},{"entry_id":"8","company_name":"Fränkel & Voellmy","location":"<UNKNOWN>"},{"entry_id":"9","company_name":"H. Hartmann","location":"<UNKNOWN>"},{"entry_id":"10","company_name":"Kunsthandlung Rath","location":"<UNKNOWN>"},{"entry_id":"11","company_name":"M. Russ","location":"<UNKNOWN>"},{"entry_id":"12","company_name":"Alf. Schray (Kleinmöbel)","location":"<UNKNOWN>"},{"entry_id":"13","company_name":"Wolf & Glatz","location":"<UNKNOWN>"},{"entry_id":"14","company_name":"Gebr. Antonietti","location":"<UNKNOWN>"},{"entry_id":"15","company_name":"A.-G. Bächtold & Cie.","location":"<UNKNOWN>"},{"entry_id":"16","company_name":"Maschinenfabrik Burckhardt A.-G.","location":"<UNKNOWN>"},{"entry_id":"17","company_name":"G. Meidinger & Cie.","location":"<UNKNOWN>"},{"entry_id":"18","company_name":"A.-G. für Motorlastwagen Soller","location":"<UNKNOWN>"},{"entry_id":"19","company_name":"Hug & Co.","location":"<UNKNOWN>"},{"entry_id":"20","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":"Liestal"},{"entry_id":"21","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":"<UNKNOWN>"},{"entry_id":"22","company_name":"Henri Grunauer","location":"<UNKNOWN>"},{"entry_id":"23","company_name":"Hans Ritter-Soder","location":"<UNKNOWN>"},{"entry_id":"24","company_name":"Alb. Singeisen-Halder","location":"<UNKNOWN>"},{"entry_id":"25","company_name":"Ch. H. Pfister & Co.","location":"<UNKNOWN>"},{"entry_id":"26","company_name":"E. Müry & Cie.","location":"<UNKNOWN>"},{"entry_id":"27","company_name":"Affentranger, Haas & Plattner, Niederdorf","location":"Niederdorf"},{"entry_id":"28","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":"<UNKNOWN>"},{"entry_id":"29","company_name":"G. P. Richter","location":"<UNKNOWN>"},{"entry_id":"30","company_name":"E. H. Schacke","location":"<UNKNOWN>"}]}

Scoring

F1 micro45.0%
F1 macro45.7%
Micro precision43.3%
Micro recall46.8%
Instances15
True positives464
False positives607
False negatives528

Speed

Model time, all inputs225.6 s
Mean per input15.04 s
Slowest input23.85 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens35.8K
Output tokens13.8K
Total tokens49.6K
Input cost$0.1791
Output cost$0.3444
Total cost$0.5235

Priced from 2026-01-23 · Input $/M $5.00 · Output $/M $25.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 187 of 226

Test T0411 at 2025-11-25

book-page information-extraction printed 20 en, de list company

openai gpt-5.1-2025-11-13 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision49.2%
Recall49.2%
True positives32
False positives33
False negatives33
F1 score49.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"24-1","company_name":"A. Boreux","location":""},{"entry_id":"24-2","company_name":"Brunnenverwaltung Eptingen","location":""},{"entry_id":"24-3","company_name":"Singer & Buchenhorner A.-G.","location":""},{"entry_id":"24-4","company_name":"Alf. Dürr, J. H. Neukomm’s Nachf.","location":""},{"entry_id":"24-5","company_name":"Ausstattungsmagazine Ed. Senft","location":""},{"entry_id":"24-6","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":""},{"entry_id":"24-7","company_name":"Adolf Bürgin","location":""},{"entry_id":"24-8","company_name":"Bussinger & Cie.","location":""},{"entry_id":"24-9","company_name":"Fränkel & Voellmy","location":""},{"entry_id":"24-10","company_name":"H. Hartmann","location":""},{"entry_id":"24-11","company_name":"Kunsthandlung Rath","location":""},{"entry_id":"24-12","company_name":"M. Russ","location":""},{"entry_id":"24-13","company_name":"Alf. Schray","location":""},{"entry_id":"24-14","company_name":"Wolf & Glatz","location":""},{"entry_id":"24-15","company_name":"Gebr. Antonietti","location":""},{"entry_id":"24-16","company_name":"A.-G. Bächtold & Cie.","location":""},{"entry_id":"24-17","company_name":"Maschinenfabrik Burckhardt A.-G.","location":""},{"entry_id":"24-18","company_name":"G. Meidinger & Cie.","location":""},{"entry_id":"24-19","company_name":"A.-G. für Motorlastwagen Soller","location":""},{"entry_id":"24-20","company_name":"Hug & Co.","location":""},{"entry_id":"24-21","company_name":"Schweiz. Geigenbaugesellschaft","location":"Liestal"},{"entry_id":"24-22","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":""},{"entry_id":"24-23","company_name":"Henri Grunauer","location":""},{"entry_id":"24-24","company_name":"Hans Ritter-Soder","location":""},{"entry_id":"24-25","company_name":"Alb. Singeisen-Halder","location":""},{"entry_id":"24-26","company_name":"Ch. H. Pfister & Co.","location":""},{"entry_id":"24-27","company_name":"E. Müry & Cie.","location":""},{"entry_id":"24-28","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"24-29","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":""},{"entry_id":"24-30","company_name":"G. P. Richter","location":""},{"entry_id":"24-31","company_name":"E. H. Schacke","location":""}]}

Scoring

F1 micro51.5%
F1 macro50.3%
Micro precision52.1%
Micro recall50.9%
Instances15
True positives505
False positives464
False negatives487

Speed

Model time, all inputs109.5 s
Mean per input7.30 s
Slowest input11.41 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens20.9K
Output tokens8.8K
Total tokens29.7K
Input cost$0.0262
Output cost$0.0879
Total cost$0.114

Priced from 2025-11-24 · Input $/M $1.25 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 188 of 226

Test T0412 at 2025-11-25

book-page information-extraction printed 20 en, de list company

openai gpt-5.1-2025-11-13 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision17.9%
Recall18.5%
True positives12
False positives55
False negatives53
F1 score18.0%
Total fields97

{"page_id":"{page_id}","entries":[{"entry_id":"1","company_name":"A. Boreux","location":""},{"entry_id":"2","company_name":"Brunnenverwaltung Eptingen Singer & Buchenhorner A.-G.","location":""},{"entry_id":"3","company_name":"Alf. Dürr, J. H. Neukomm’s Nachf.","location":""},{"entry_id":"4","company_name":"Ausstattungsmagazine Ed. Senft","location":""},{"entry_id":"5","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":""},{"entry_id":"6","company_name":"Adolf Bürgin","location":""},{"entry_id":"7","company_name":"Bussinger & Cie.","location":""},{"entry_id":"8","company_name":"Fränkel & Voellmy","location":""},{"entry_id":"9","company_name":"H. Hartmann","location":""},{"entry_id":"10","company_name":"Kunsthandlung Rath","location":""},{"entry_id":"11","company_name":"M. Russ","location":""},{"entry_id":"12","company_name":"Alf. Schray","location":""},{"entry_id":"13","company_name":"Wolf & Glatz","location":""},{"entry_id":"14","company_name":"Gebr. Antonietti","location":""},{"entry_id":"15","company_name":"A.-G. Bächtold & Cie.","location":""},{"entry_id":"16","company_name":"Maschinenfabrik Burckhardt A.-G.","location":""},{"entry_id":"17","company_name":"G. Meidinger & Cie.","location":""},{"entry_id":"18","company_name":"S. Elektromotoren","location":""},{"entry_id":"19","company_name":"A.-G. für Motorlastwagen Soller","location":""},{"entry_id":"20","company_name":"Hug & Co.","location":""},{"entry_id":"21","company_name":"Schweiz. Geigenbaugesellschaft","location":"Liestal"},{"entry_id":"22","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":""},{"entry_id":"23","company_name":"Henri Grunauer","location":""},{"entry_id":"24","company_name":"Hans Ritter-Soder","location":""},{"entry_id":"25","company_name":"Alb. Singeisen-Halder","location":""},{"entry_id":"26","company_name":"Ch. H. Pfister & Co.","location":""},{"entry_id":"27","company_name":"E. Mury & Cie.","location":""},{"entry_id":"28","company_name":"Affentranger, Haas & Plattner, Niederdorf","location":"Niederdorf"},{"entry_id":"29","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":""},{"entry_id":"30","company_name":"s. Floretseide","location":""},{"entry_id":"31","company_name":"G. P. Richter","location":""},{"entry_id":"32","company_name":"E. H. Schacke","location":""}]}

Scoring

F1 micro43.3%
F1 macro41.9%
Micro precision43.4%
Micro recall43.1%
Instances15
True positives428
False positives559
False negatives564

Speed

Model time, all inputs127.2 s
Mean per input8.48 s
Slowest input13.20 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens15.8K
Output tokens10.2K
Total tokens26K
Input cost$0.0198
Output cost$0.1019
Total cost$0.1217

Priced from 2025-11-24 · Input $/M $1.25 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 189 of 226

Test T0360 at 2025-11-24

book-page information-extraction printed 20 en, de list company

genai gemini-2.5-flash · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision7.2%
Recall7.7%
True positives5
False positives64
False negatives60
F1 score7.0%
Total fields97

{"page_id":"{page_id}","entries":[{"entry_id":"0","company_name":"A. Boreux","location":""},{"entry_id":"1","company_name":"Brunnenverwaltung Eptingen","location":"Eptingen"},{"entry_id":"2","company_name":"Singer & Buchenhorner A.-G.","location":""},{"entry_id":"3","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":""},{"entry_id":"4","company_name":"Ausstattungsrnagazine Ed. Senft.","location":""},{"entry_id":"5","company_name":"Basler Möbelfabrik A.-G. vorm.","location":"Basel"},{"entry_id":"6","company_name":"Hermann Wagner & Cie.","location":""},{"entry_id":"7","company_name":"Adolf Bürgin","location":""},{"entry_id":"8","company_name":"Bussinger & Cie.","location":""},{"entry_id":"9","company_name":"Fränkel & Voellmy","location":""},{"entry_id":"10","company_name":"H. Hartmann","location":""},{"entry_id":"11","company_name":"Kunsthandlung Rath","location":""},{"entry_id":"12","company_name":"M. Russ","location":""},{"entry_id":"13","company_name":"Alf. Schray (Kleinmöbel)","location":""},{"entry_id":"14","company_name":"Wolf & Glatz","location":""},{"entry_id":"15","company_name":"Gebr. Antonietti","location":""},{"entry_id":"16","company_name":"A.-G. Bächtold & Cie.","location":""},{"entry_id":"17","company_name":"Maschinenfabrik Burckhardt A.-G.","location":""},{"entry_id":"18","company_name":"G. Meidinger & Cie.","location":""},{"entry_id":"19","company_name":"A.-G. für Motorlastwagen Soller","location":""},{"entry_id":"20","company_name":"Hug & Co.","location":""},{"entry_id":"21","company_name":"Schweiz. Geigenbaugesellschaft Liestal","location":"Liestal"},{"entry_id":"22","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":""},{"entry_id":"23","company_name":"Henri Grunauer","location":""},{"entry_id":"24","company_name":"Hans Ritter-Soder","location":""},{"entry_id":"25","company_name":"Alb. Singeisen-Halder","location":""},{"entry_id":"26","company_name":"Ch. H. Pfister & Co.","location":""},{"entry_id":"27","company_name":"E. Müry & Cie.","location":""},{"entry_id":"28","company_name":"Affentranger, Haas & Plattner, Niederdorf","location":"Niederdorf"},{"entry_id":"29","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":""},{"entry_id":"30","company_name":"G. P. Richter","location":""},{"entry_id":"31","company_name":"E. H. Schacke","location":""}]}

Scoring

F1 micro44.4%
F1 macro43.2%
Micro precision43.7%
Micro recall45.2%
Instances15
True positives448
False positives578
False negatives544

Speed

Model time, all inputs143.6 s
Mean per input9.57 s
Slowest input16.06 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens4.3K
Output tokens12.8K
Total tokens17.1K
Input cost$0.0013
Output cost$0.0321
Total cost$0.0334

Priced from 2025-11-24 · Input $/M $0.30 · Output $/M $2.50

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 190 of 226

Test T0359 at 2025-11-24

book-page information-extraction printed 20 en, de list company

genai gemini-2.5-flash · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision49.2%
Recall49.2%
True positives32
False positives33
False negatives33
F1 score49.0%
Total fields94

{"page_id":"24","entries":[{"entry_id":"24-1","company_name":"A. Boreux","location":""},{"entry_id":"24-2","company_name":"Brunnenverwaltung Eptingen","location":""},{"entry_id":"24-3","company_name":"Singer & Buchenhorner A.-G.","location":""},{"entry_id":"24-4","company_name":"Alf. Dürr, J. H. Neukomm's Nachf.","location":""},{"entry_id":"24-5","company_name":"Ausstattungsmagazine Ed. Senft.","location":""},{"entry_id":"24-6","company_name":"Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.","location":""},{"entry_id":"24-7","company_name":"Adolf Bürgin.","location":""},{"entry_id":"24-8","company_name":"Bussinger & Cie.","location":""},{"entry_id":"24-9","company_name":"Fränkel & Voellmy.","location":""},{"entry_id":"24-10","company_name":"H. Hartmann.","location":""},{"entry_id":"24-11","company_name":"Kunsthandlung Rath.","location":""},{"entry_id":"24-12","company_name":"M. Russ.","location":""},{"entry_id":"24-13","company_name":"Alf. Schray","location":""},{"entry_id":"24-14","company_name":"Wolf & Glatz.","location":""},{"entry_id":"24-15","company_name":"Gebr. Antonietti.","location":""},{"entry_id":"24-16","company_name":"A.-G. Bächtold & Cie.","location":""},{"entry_id":"24-17","company_name":"Maschinenfabrik Burckhardt A.-G.","location":""},{"entry_id":"24-18","company_name":"G. Meidinger & Cie.","location":""},{"entry_id":"24-19","company_name":"A.-G. für Motorlastwagen Soller","location":""},{"entry_id":"24-20","company_name":"Hug & Co.","location":""},{"entry_id":"24-21","company_name":"Schweiz. Geigenbaugesellschaft","location":"Liestal"},{"entry_id":"24-22","company_name":"Schweizerisches Musikhaus Bannwart & Cie.","location":""},{"entry_id":"24-23","company_name":"Henri Grunauer.","location":""},{"entry_id":"24-24","company_name":"Hans Ritter-Soder.","location":""},{"entry_id":"24-25","company_name":"Alb. Singeisen-Halder.","location":""},{"entry_id":"24-26","company_name":"Ch. H. Pfister & Co.","location":""},{"entry_id":"24-27","company_name":"E. Müry & Cie.","location":""},{"entry_id":"24-28","company_name":"Affentranger, Haas & Plattner","location":"Niederdorf"},{"entry_id":"24-29","company_name":"Schweizerische Nähmaschinenfabrik A.-G.","location":""},{"entry_id":"24-30","company_name":"G. P. Richter","location":""},{"entry_id":"24-31","company_name":"E. H. Schacke","location":""}]}

Scoring

F1 micro51.5%
F1 macro51.5%
Micro precision51.4%
Micro recall51.5%
Instances15
True positives511
False positives483
False negatives481

Speed

Model time, all inputs161.0 s
Mean per input10.73 s
Slowest input21.77 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens9.9K
Output tokens13.2K
Total tokens23K
Input cost$0.003
Output cost$0.0329
Total cost$0.0359

Priced from 2025-11-24 · Input $/M $0.30 · Output $/M $2.50

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827