RISE Humanities Data Benchmark, 0.6.1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Search Results
Show compact results Refine Search New Search
Download JSON Download CSV

Your search for Benchmark 'blacklist_cards__true' with Search Hidden 'False' returned 180 results, showing page 9 of 18.
Result 81 of 180

Test T1607 at 2026-08-18

index-card information-extraction typed, handwritten 20 de company

x-ai grok-4.6 · temp 0.5 · dataclass Card

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score76.5%

{"company":{"transcription":"A b e g g & Cie."},"location":{"transcription":"Zürich"},"b_id":{"transcription":"B.51.322.GB.26"},"date":"","information":[]}

Scoring

Fuzzy score95.8%

Speed

Model time, all inputs589.6 s
Mean per input17.87 s
Slowest input39.11 s
Inputs timed33

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens103.7K
Output tokens3.7K
Total tokens107.5K
Input cost$0.2075
Output cost$0.0224
Total cost$0.4134
Reasoning cost usd$0.1836
Total reasoning tokens30.6K

Priced from 2026-08-18 · Input $/M $2.00 · Output $/M $6.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 82 of 180

Test T1622 at 2026-08-18

index-card information-extraction typed, handwritten 20 de company

openrouter meta/muse-spark-1.2 · temp 0.5 · dataclass Card

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score76.7%

{"company":{"transcription":"Abegg & Cie."},"location":{"transcription":"Z\u0000rich"},"b_id":{"transcription":"B.51.322.GB.266"},"date":"","information":[]}

Scoring

Fuzzy score93.7%

Speed

Model time, all inputs569.0 s
Mean per input17.24 s
Slowest input31.26 s
Inputs timed33

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens108.1K
Output tokens37.5K
Total tokens145.6K
Input cost$0.1351
Output cost$0.1596
Total cost$0.2946

Priced from 2026-08-18 · Input $/M $1.25 · Output $/M $4.25

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 83 of 180

Test T1577 at 2026-08-16

index-card information-extraction typed, handwritten 20 de company

huggingface meta-models/Muse-Glimmer-30B · temp 0.5 · dataclass Card

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score80.0%

{"company":{"transcription":"Abegg & Cie."},"location":{"transcription":"Zürich"},"b_id":{"transcription":"B.51.322.GB.266"},"date":"","information":[]}

Scoring

Fuzzy score94.1%

Speed

Model time, all inputs358.7 s
Mean per input10.87 s
Slowest input15.83 s
Inputs timed33

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens108.6K
Output tokens30.6K
Total tokens139.2K
Input cost$0.038
Output cost$0.0459
Total cost$0.0839

Priced from 2026-08-15 · Input $/M $0.35 · Output $/M $1.50

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 84 of 180

Test T1547 at 2026-08-16

index-card information-extraction typed, handwritten 20 de company

huggingface thinkingmachines/Inkling-Small · temp 0.5 · dataclass Card

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score80.0%

{"company":{"transcription":"Abegg & Cie."},"location":{"transcription":"Zürich"},"b_id":{"transcription":"B.51.322.GB.266"},"date":"","information":[]}

Scoring

Fuzzy score92.3%

Speed

Model time, all inputs250.4 s
Mean per input7.59 s
Slowest input24.27 s
Inputs timed33

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens72.8K
Output tokens19.5K
Total tokens92.3K
Input cost$0.0328
Output cost$0.0235
Total cost$0.0562

Priced from 2026-08-15 · Input $/M $0.45 · Output $/M $1.20

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 85 of 180

Test T1487 at 2026-08-15

index-card information-extraction typed, handwritten 20 de company

huggingface swiss-ai/apertus-v1.5-70b · temp 0.5 · dataclass Card

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score78.7%

{"company":{"transcription":"Abegg & Cie."},"location":{"transcription":"Zürich"},"b_id":{"transcription":"B.51.322.GB.206"},"date":"","information":[{"transcription":""}]}

Scoring

Fuzzy score83.3%

Speed

Model time, all inputs160.0 s
Mean per input4.85 s
Slowest input6.12 s
Inputs timed33

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens264K
Output tokens4.3K
Total tokens268.3K
Input cost$0.2165
Output cost$0.0124
Total cost$0.2289

Priced from 2026-08-10 · Input $/M $0.82 · Output $/M $2.92

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 86 of 180

Test T1532 at 2026-08-15

index-card information-extraction typed, handwritten 20 de company

huggingface MiniMaxAI/MiniMax-M3 · temp 0.5 · dataclass Card

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score80.0%

{"company":{"transcription":"Abegg & Cie."},"location":{"transcription":"Zürich"},"b_id":{"transcription":"B.51.322.GB.266"},"date":"","information":[{"transcription":""}]}

Scoring

Fuzzy score87.7%

Speed

Model time, all inputs309.3 s
Mean per input9.37 s
Slowest input17.32 s
Inputs timed33

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens32.3K
Output tokens3.9K
Total tokens36.2K
Input cost$0.009
Output cost$0.0043
Total cost$0.0133

Priced from 2026-08-15 · Input $/M $0.28 · Output $/M $1.10

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 87 of 180

Test T1517 at 2026-08-15

index-card information-extraction typed, handwritten 20 de company

huggingface Qwen/Qwen3-VL-235B-A22B-Instruct · temp 0.5 · dataclass Card

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score80.0%

{"company":{"transcription":"Abegg & Cie."},"location":{"transcription":"Zürich"},"b_id":{"transcription":"B.51.322.GB.266"},"date":"","information":[{"transcription":""}]}

Scoring

Fuzzy score83.3%

Speed

Model time, all inputs178.4 s
Mean per input5.41 s
Slowest input6.70 s
Inputs timed33

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens84.7K
Output tokens4.6K
Total tokens89.3K
Input cost$0.0169
Output cost$0.004
Total cost$0.021

Priced from 2026-08-15 · Input $/M $0.20 · Output $/M $0.88

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 88 of 180

Test T1562 at 2026-08-15

index-card information-extraction typed, handwritten 20 de company

huggingface thinkingmachines/Inkling · temp 0.5 · dataclass Card

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score80.0%

{"company":{"transcription":"Abegg & Cie."},"location":{"transcription":"Zürich"},"b_id":{"transcription":"B.51.322.GB.266"},"date":"","information":[]}

Scoring

Fuzzy score88.6%

Speed

Model time, all inputs378.0 s
Mean per input11.45 s
Slowest input39.68 s
Inputs timed33

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens73.1K
Output tokens24K
Total tokens97.1K
Input cost$0.0731
Output cost$0.0971
Total cost$0.1702

Priced from 2026-08-15 · Input $/M $1.00 · Output $/M $4.05

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 89 of 180

Test T1502 at 2026-08-14

index-card information-extraction typed, handwritten 20 de company

huggingface swiss-ai/apertus-v1.5-8b · temp 0.5 · dataclass Card

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score80.0%

{"company":{"transcription":"Abegg & Cie."},"location":{"transcription":"Zürich"},"b_id":{"transcription":"B.51.322.GB.266"},"date":"","information":[{"transcription":"Zürich"}]}

Scoring

Fuzzy score78.9%

Speed

Model time, all inputs555.2 s
Mean per input16.82 s
Slowest input28.61 s
Inputs timed33

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens264K
Output tokens4.4K
Total tokens268.4K
Input cost$0.0264
Output cost$0.0009
Total cost$0.0273

Priced from 2026-08-10 · Input $/M $0.10 · Output $/M $0.20

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 90 of 180

Test T1457 at 2026-08-04

index-card information-extraction typed, handwritten 20 de company

x-ai grok-4.5 · temp 0.5 · dataclass Card

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score100.0%

{"company":{"transcription":"Abegg & Cie."},"location":{"transcription":"Zürich"},"b_id":{"transcription":"B.51.322.GB.266"},"date":"","information":null}

Scoring

Fuzzy score95.7%

Speed

Model time, all inputs184.4 s
Mean per input5.59 s
Slowest input23.75 s
Inputs timed33

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens103.7K
Output tokens3.8K
Total tokens107.5K
Input cost$0.2075
Output cost$0.0225
Total cost$0.2631
Reasoning cost usd$0.0331
Total reasoning tokens5.5K

Priced from 2026-08-04 · Input $/M $2.00 · Output $/M $6.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827