RISE Humanities Data Benchmark, 0.5.5-pre1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Search Results
Show compact results Refine Search New Search
Download JSON Download CSV

Your search for Benchmark 'company_lists__true' with Search Hidden 'False' returned 226 results, showing page 20 of 23.
Result 191 of 226

Test T0347 at 2025-10-28

book-page information-extraction printed 20 en, de list company

openai gpt-5 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Scoring

F1 micro58.7%
F1 macro58.4%
Micro precision58.9%
Micro recall58.6%
Instances15
True positives581
False positives406
False negatives411

Speed

Model time, all inputs1853.8 s
Mean per input123.58 s
Slowest input235.49 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens16.7K
Output tokens69.5K
Total tokens86.3K
Input cost$0.0209
Output cost$0.6954
Total cost$0.7163

Priced from 2025-10-28 · Input $/M $1.25 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 192 of 226

Test T0393 at 2025-10-28

book-page information-extraction printed 20 en, de list company

openrouter qwen/qwen3-vl-8b-thinking · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Scoring

F1 micro5.1%
F1 macro3.5%
Micro precision40.9%
Micro recall2.7%
Instances15
True positives27
False positives39
False negatives965

Speed

Model time, all inputs754.6 s
Mean per input50.31 s
Slowest input215.31 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens27.7K
Output tokens21.8K
Total tokens49.5K
Input cost$0.005
Output cost$0.0459
Total cost$0.0508

Priced from 2025-10-28 · Input $/M $0.18 · Output $/M $2.10

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 193 of 226

Test T0362 at 2025-10-28

book-page information-extraction printed 20 en, de list company

genai gemini-2.5-pro · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

{
  "page_id": "{page_id}",
  "entries": [
    {
      "entry_id": "1",
      "company_name": "A. Boreux",
      "location": ""
    },
    {
      "entry_id": "2",
      "company_name": "Brunnenverwaltung Eptingen",
      "location": "Eptingen"
    },
    {
      "entry_id": "3",
      "company_name": "Singer & Buchenhorner A.-G.",
      "location": ""
    },
    {
      "entry_id": "4",
      "company_name": "Alf. Dürr, J. H. Neukomm's Nachf.",
      "location": ""
    },
    {
      "entry_id": "5",
      "company_name": "Ausstattungsmagazine Ed. Senft",
      "location": ""
    },
    {
      "entry_id": "6",
      "company_name": "Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.",
      "location": "Basel"
    },
    {
      "entry_id": "7",
      "company_name": "Adolf Bürgin",
      "location": ""
    },
    {
      "entry_id": "8",
      "company_name": "Bussinger & Cie.",
      "location": ""
    },
    {
      "entry_id": "9",
      "company_name": "Fränkel & Voellmy",
      "location": ""
    },
    {
      "entry_id": "10",
      "company_name": "H. Hartmann",
      "location": ""
    },
    {
      "entry_id": "11",
      "company_name": "Kunsthandlung Rath",
      "location": ""
    },
    {
      "entry_id": "12",
      "company_name": "M. Russ",
      "location": ""
    },
    {
      "entry_id": "13",
      "company_name": "Alf. Schray",
      "location": ""
    },
    {
      "entry_id": "14",
      "company_name": "Wolf & Glatz",
      "location": ""
    },
    {
      "entry_id": "15",
      "company_name": "Gebr. Antonietti",
      "location": ""
    },
    {
      "entry_id": "16",
      "company_name": "A.-G. Bächtold & Cie.",
      "location": ""
    },
    {
      "entry_id": "17",
      "company_name": "Maschinenfabrik Burckhardt A.-G.",
      "location": ""
    },
    {
      "entry_id": "18",
      "company_name": "G. Meidinger & Cie.",
      "location": ""
    },
    {
      "entry_id": "19",
      "company_name": "A.-G. für Motorlastwagen Soller",
      "location": "Soller"
    },
    {
      "entry_id": "20",
      "company_name": "Hug & Co.",
      "location": ""
    },
    {
      "entry_id": "21",
      "company_name": "Schweiz. Geigenbaugesellschaft",
      "location": "Liestal"
    },
    {
      "entry_id": "22",
      "company_name": "Schweizerisches Musikhaus Bannwart & Cie.",
      "location": ""
    },
    {
      "entry_id": "23",
      "company_name": "Henri Grunauer",
      "location": ""
    },
    {
      "entry_id": "24",
      "company_name": "Hans Ritter-Soder",
      "location": ""
    },
    {
      "entry_id": "25",
      "company_name": "Alb. Singeisen-Halder",
      "location": ""
    },
    {
      "entry_id": "26",
      "company_name": "Ch. H. Pfister & Co.",
      "location": ""
    },
    {
      "entry_id": "27",
      "company_name": "E. Müry & Cie.",
      "location": ""
    },
    {
      "entry_id": "28",
      "company_name": "Affentranger, Haas & Plattner",
      "location": "Niederdorf"
    },
    {
      "entry_id": "29",
      "company_name": "Schweizerische Nähmaschinenfabrik A.-G.",
      "location": ""
    },
    {
      "entry_id": "30",
      "company_name": "G. P. Richter",
      "location": ""
    },
    {
      "entry_id": "31",
      "company_name": "E. H. Schacke",
      "location": ""
    }
  ]
}

Scoring

F1 micro47.9%
F1 macro47.9%
Micro precision47.1%
Micro recall48.8%
Instances15
True positives484
False positives543
False negatives508

Speed

Model time, all inputs329.0 s
Mean per input21.93 s
Slowest input39.39 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens4.2K
Output tokens13.9K
Total tokens18.1K
Input cost$0.0052
Output cost$0.1387
Total cost$0.1439

Priced from 2025-10-28 · Input $/M $1.25 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 194 of 226

Test T0337 at 2025-10-28

book-page information-extraction printed 20 en, de list company

openai gpt-4o · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Scoring

F1 micro42.6%
F1 macro41.2%
Micro precision43.6%
Micro recall41.6%
Instances15
True positives413
False positives534
False negatives579

Speed

Model time, all inputs463.5 s
Mean per input30.90 s
Slowest input62.41 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens18.8K
Output tokens8.6K
Total tokens27.5K
Input cost$0.0471
Output cost$0.0865
Total cost$0.1335

Priced from 2025-10-28 · Input $/M $2.50 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 195 of 226

Test T0359 at 2025-10-28

book-page information-extraction printed 20 en, de list company

genai gemini-2.5-flash · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

{
  "page_id": "{page_id}",
  "entries": [
    {
      "entry_id": "{page_id}-1",
      "company_name": "A. Boreux",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-2",
      "company_name": "Brunnenverwaltung Eptingen",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-3",
      "company_name": "Singer & Buchenhorner A.-G.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-4",
      "company_name": "Alf. Dürr, J. H. Neukomm's Nachf.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-5",
      "company_name": "Ausstattungsmagazine Ed. Senft.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-6",
      "company_name": "Basler Möbelfabrik A.-G. vorm. Hermann Wagner & Cie.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-7",
      "company_name": "Adolf Bürgin",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-8",
      "company_name": "Bussinger & Cie.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-9",
      "company_name": "Fränkel & Voellmy.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-10",
      "company_name": "H. Hartmann",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-11",
      "company_name": "Kunsthandlung Rath",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-12",
      "company_name": "M. Russ",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-13",
      "company_name": "Alf. Schray",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-14",
      "company_name": "Wolf & Glatz",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-15",
      "company_name": "Gebr. Antonietti",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-16",
      "company_name": "A.-G. Bächtold & Cie.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-17",
      "company_name": "Maschinenfabrik Burckhardt A.-G.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-18",
      "company_name": "G. Meidinger & Cie.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-19",
      "company_name": "A.-G. für Motorlastwagen Soller",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-20",
      "company_name": "Hug & Co.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-21",
      "company_name": "Schweiz. Geigenbaugesellschaft",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-22",
      "company_name": "Liestal",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-23",
      "company_name": "Schweizerisches Musikhaus Bannwart & Cie.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-24",
      "company_name": "Henri Grunauer",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-25",
      "company_name": "Hans Ritter-Soder",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-26",
      "company_name": "Alb. Singeisen-Halder",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-27",
      "company_name": "Ch. H. Pfister & Co.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-28",
      "company_name": "E. Müry & Cie.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-29",
      "company_name": "Affentranger, Haas & Plattner",
      "location": "Nieder-dorf"
    },
    {
      "entry_id": "{page_id}-30",
      "company_name": "Schweizerische Nähmaschinenfabrik A.-G.",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-31",
      "company_name": "G. P. Richter",
      "location": "null"
    },
    {
      "entry_id": "{page_id}-32",
      "company_name": "E. H. Schacke",
      "location": "null"
    }
  ]
}

Scoring

F1 micro47.7%
F1 macro50.1%
Micro precision47.6%
Micro recall47.7%
Instances15
True positives473
False positives520
False negatives519

Speed

Model time, all inputs291.7 s
Mean per input19.45 s
Slowest input55.14 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens9.8K
Output tokens16.1K
Total tokens25.9K
Input cost$0.0029
Output cost$0.0403
Total cost$0.0432

Priced from 2025-10-28 · Input $/M $0.30 · Output $/M $2.50

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 196 of 226

Test T0380 at 2025-10-28

book-page information-extraction printed 20 en, de list company

anthropic claude-sonnet-4-5-20250929 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Scoring

F1 micro38.7%
F1 macro39.0%
Micro precision38.2%
Micro recall39.1%
Instances15
True positives388
False positives627
False negatives604

Speed

Model time, all inputs281.7 s
Mean per input18.78 s
Slowest input30.02 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens26.3K
Output tokens16.7K
Total tokens43K
Input cost$0.079
Output cost$0.2499
Total cost$0.3289

Priced from 2025-10-28 · Input $/M $3.00 · Output $/M $15.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 197 of 226

Test T0348 at 2025-10-28

book-page information-extraction printed 20 en, de list company

openai gpt-5 · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Scoring

F1 micro36.5%
F1 macro41.1%
Micro precision36.9%
Micro recall36.1%
Instances15
True positives358
False positives612
False negatives634

Speed

Model time, all inputs1434.1 s
Mean per input95.61 s
Slowest input137.81 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens11.6K
Output tokens51.1K
Total tokens62.7K
Input cost$0.0145
Output cost$0.5111
Total cost$0.5257

Priced from 2025-10-28 · Input $/M $1.25 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 198 of 226

Test T0344 at 2025-10-28

book-page information-extraction printed 20 en, de list company

openai gpt-4.1-mini · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Scoring

F1 micro38.8%
F1 macro36.9%
Micro precision39.0%
Micro recall38.6%
Instances15
True positives383
False positives599
False negatives609

Speed

Model time, all inputs141.4 s
Mean per input9.43 s
Slowest input18.30 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens19.4K
Output tokens8.6K
Total tokens28K
Input cost$0.0078
Output cost$0.0137
Total cost$0.0215

Priced from 2025-10-28 · Input $/M $0.40 · Output $/M $1.60

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 199 of 226

Test T0398 at 2025-10-28

book-page information-extraction printed 20 en, de list company

openrouter qwen/qwen3-vl-30b-a3b-instruct · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Scoring

F1 micro24.3%
F1 macro25.6%
Micro precision24.3%
Micro recall24.4%
Instances15
True positives242
False positives754
False negatives750

Speed

Model time, all inputs284.8 s
Mean per input18.99 s
Slowest input71.62 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens11.6K
Output tokens13.5K
Total tokens25.1K
Input cost$0.0023
Output cost$0.0094
Total cost$0.0118

Priced from 2025-10-28 · Input $/M $0.20 · Output $/M $0.70

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 200 of 226

Test T0350 at 2025-10-28

book-page information-extraction printed 20 en, de list company

openai gpt-5-mini · temp 0.5 · dataclass ListPage

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Scoring

F1 micro44.5%
F1 macro43.1%
Micro precision44.0%
Micro recall45.0%
Instances15
True positives446
False positives568
False negatives546

Speed

Model time, all inputs778.5 s
Mean per input51.90 s
Slowest input123.66 s
Inputs timed15

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens14.9K
Output tokens35.2K
Total tokens50K
Input cost$0.0037
Output cost$0.0703
Total cost$0.074

Priced from 2025-10-28 · Input $/M $0.25 · Output $/M $2.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827