RISE Humanities Data Benchmark, 0.6.1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Loading module...

Search Results

Your search for Benchmark 'medieval_manuscripts__true' with Search Hidden 'False' returned 177 results, showing page 6 of 18.
Result 51 of 177

Test T0658 at 2026-09-16

manuscript transcription handwritten 15 de prose

openai gpt-5.4-2026-03-05 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score93.1%
CER ↓7.1%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir mit
minen knechten vber hulffend
bay do was meinen kẽy weg
Sünne. den wir machtenß
vnd irslend die knecht dick
vnd vil in vntz an den aͧb
vnd die pferit vntz an die
petel vnd was ze mol ein grosser
nebel dz wir kaum geꝑaͤchend
vnd alß mit groffer arbeit kam
wir ze mittentag zů sant
krisoffel vff den berg do
do hub ich die bücher do gar
vil hering wapen zu stont
Die ir für dꝛhin gelien hand
So sind mines vatters flügen
wappen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score77.7%
CER ↓24.0%

Speed

Model time, all inputs75.0 s
Mean per input6.25 s
Slowest input10.37 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens42.5K
Output tokens2.5K
Total tokens45K
Input cost$0.1062
Output cost$0.0378
Total cost$0.144

Priced from 2026-09-16 · Input $/M $2.50 · Output $/M $15.00

Result 52 of 177

Test T0505 at 2026-09-16

manuscript transcription handwritten 15 de prose

genai gemini-3-flash-preview · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score95.9%
CER ↓3.5%

{"folios":[{"folio":"3","text":"Und ein pferit die mir und
minen knechten vber hulfend
den do was nenen kein weg
denne den wir machend
und vichend die knecht dik
und vil in vntz an den ars
und die pferit vntz an die
settel und was ze mol ein grosseꝛ
nebel dz wir kum gepassend
und als mit grosseꝛ arbeit kōme
wir ze mittem tag zu sant
kristoffel vff den berg do
do sach ich die bücher do gar
vil herren wopen in stund
die ir stür darzu geben hand
do stund mines vatteꝛs seligen
wopen ouch in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score76.0%
CER ↓24.0%

Speed

Model time, all inputs1142.3 s
Mean per input95.19 s
Slowest input111.57 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens19.1K
Output tokens2.8K
Total tokens22K
Input cost$0.0096
Output cost$0.0085
Total cost$0.9934
Reasoning cost usd$0.9753
Total reasoning tokens325.1K

Priced from 2026-09-16 · Input $/M $0.50 · Output $/M $3.00

Result 53 of 177

Test T0527 at 2026-09-16

manuscript transcription handwritten 15 de prose

anthropic claude-haiku-4-5-20251001 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score89.8%
CER ↓10.5%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vder gulfand
den so was menig lang weg
Jmme der wir machten
vnd vielent die knecht dut
vnt vil in vmtz ay dey aro
vnd die pferit vmz ay die
stral vnd wag ze mol ein groſſa
nebel dz wir kunig gefaſſend
vnd alz mir groſſer arbeit bame
wir ze mittem tag ze fart
kinfaſſel vff dey berg do
do fach ich die brieder do gar
vil barney wopey zu ſtone
die in ſtir ed ſhy gelieg hand
do fand mineß vatters Rhigen
wopey och in dem zineig","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score65.2%
CER ↓37.5%

Speed

Model time, all inputs77.1 s
Mean per input6.43 s
Slowest input9.74 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens35.9K
Output tokens3.7K
Total tokens39.6K
Input cost$0.0359
Output cost$0.0183
Total cost$0.0542

Priced from 2026-09-16 · Input $/M $1.00 · Output $/M $5.00

Result 54 of 177

Test T1095 at 2026-09-16

manuscript transcription handwritten 15 de prose

mistral mistral-medium-3.5 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score91.5%
CER ↓9.0%

{"folios":[{"folio":"3","text":"Vnd ein pferd die wir vnd
miner knechten werben gulden
So was menig lang weg
Semlich das wir machen vnd
vielend die knecht dut
vnd vil in vntz an den arb
vnd die pferd vntz an die
pettel vnd was ze mol ein grosser
nebel das wir kum gevaren
vnd als mit grosser arbeit kome
wir ze mitten tag zu sant
kristoffel off den berg So
So fach ich die bürger So gar
vil gerren wapen in stein
Die ir stür dolgen geben hand
So stund min watter vnd plegen
wapen sat in dem snee","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score64.0%
CER ↓38.6%

Speed

Model time, all inputs67.2 s
Mean per input5.60 s
Slowest input8.14 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens34.1K
Output tokens3K
Total tokens37.1K
Input cost$0.0512
Output cost$0.0223
Total cost$0.0735

Priced from 2026-09-16 · Input $/M $1.50 · Output $/M $7.50

Result 55 of 177

Test T1082 at 2026-09-16

manuscript transcription handwritten 15 de prose

anthropic claude-opus-4-8 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score98.2%
CER ↓1.8%

{"folios":[{"folio":"3","text":"vnd ein pferit die mir vnd
 minen knechten iber hulffend
 den do was menen kein weg
 denne den wir machtend
 vnd ziehend die knecht dick
 vnd vil in vntz an den ars
 vnd die pferit vntz an die
 settel vnd was ze mol ein grosser
 nebel dz wir kum gesahend
 vnd als mit grosser arbeit kome
 wir ze mittem tag zu sant
 kristoffel vff den berg do
 do sach ich die bücher do gar
 vil herren wopen zu stone
 die ir stür do hin geben hand
 do stund mines vatters seligen
 wopen och in dem einen","addition1":null,"addition2":null,"addition3":null}]}

Scoring

Fuzzy score81.0%
CER ↓19.3%

Speed

Model time, all inputs119.4 s
Mean per input9.95 s
Slowest input17.13 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens61.9K
Output tokens3.9K
Total tokens65.8K
Input cost$0.3093
Output cost$0.0978
Total cost$0.4072

Priced from 2026-09-16 · Input $/M $5.00 · Output $/M $25.00

Result 56 of 177

Test T1441 at 2026-09-16

manuscript transcription handwritten 15 de prose

genai gemini-3.5-flash-lite · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score94.9%
CER ↓4.5%

{"folios":[{"folio":"3","text":"Und ein pferit die mir vnd
minen knechten vber hulfend
Jen Do was menen kein weg
denne den wir machtend
und vihend die knechte dut
vnd vil in vns an den arb
vnd die pferit vns an die
petel vnd was ze mol ein grösse
nebel daz wir kum gejagtend
und als mit grosser arbeit kome
wir ze mittem tag zu sant
Kristoffel off den berg Do
do sach ich die bücher do gar
vil herren wopen in stoue
die in stur dolin geben hand
Do stund mines vatters sligen
wopen ast in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score76.2%
CER ↓26.1%

Speed

Model time, all inputs30.1 s
Mean per input2.50 s
Slowest input3.70 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens19.1K
Output tokens2.9K
Total tokens22K
Input cost$0.0057
Output cost$0.0072
Total cost$0.013

Priced from 2026-09-16 · Input $/M $0.30 · Output $/M $2.50

Result 57 of 177

Test T0634 at 2026-09-16

manuscript transcription handwritten 15 de prose

anthropic claude-opus-4-6 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score97.4%
CER ↓1.5%

{"folios":[{"folio":"3","text":"vnd ein pferit die mir vnd
minen knechten vber hulffend
den do was menen kein weg
denne den wir machtend
vnd viehend die knecht dick
vnd vil in vntz an den arß
vnd die pferit vntz an die
settel vnd was ze mol ein grosseꝛ
nebel dz wir kum gesachend
vnd als mit grosser arbeit kame
wir ze mittem tag zuͦ sant
kristoffel vff den berg do
do sach ich die buͦcher do gar
vil herren wopen jn stond
die ir stür do hin geben hand
do stuͦnd mines vatters seligen
wopen och in dem einen","addition1":null,"addition2":null,"addition3":null}]}

Scoring

Fuzzy score85.8%
CER ↓15.4%

Speed

Model time, all inputs164.7 s
Mean per input13.73 s
Slowest input20.68 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens35.9K
Output tokens3.4K
Total tokens39.3K
Input cost$0.1795
Output cost$0.0843
Total cost$0.2638

Priced from 2026-09-16 · Input $/M $5.00 · Output $/M $25.00

Result 58 of 177

Test T1651 at 2026-09-16

manuscript transcription handwritten 15 de prose

genai gemini-3.8-flash · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score97.0%
CER ↓2.1%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vber hulfend
den Do was nienan kein weg
denne den wir machtend
vnd wichend die knecht duk
vnd vil in vntz an den arß
vnd die pferit vntz an die
settel vnd was ze mol ein grosser
nebel dz wir kum gepartend
vnd als mit grosser arbeit komẽ
wir ze mittem tag zů sant
kristoffel vff den berg do
Do sach ich die bůcher do gar
vil herren wopen jn stond
die in stür do hin geben hand
do stůnd mines vatters seligen
wopen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score78.0%
CER ↓22.7%

Speed

Model time, all inputs556.6 s
Mean per input46.38 s
Slowest input110.67 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens19.1K
Output tokens2.9K
Total tokens22K
Input cost$0.0143
Output cost$0.0109
Total cost$0.5376
Reasoning cost usd$0.5124
Total reasoning tokens136.6K

Priced from 2026-09-02 · Input $/M $0.75 · Output $/M $3.75

Result 59 of 177

Test T1516 at 2026-09-16

manuscript transcription handwritten 15 de prose

huggingface Qwen/Qwen3-VL-235B-A22B-Instruct · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score93.7%
CER ↓6.2%

{"folios":[{"folio":"3","text":"Vnd ein pferit die wir vnd
minen knechten vber Rulfend
Gen So was meryn ein Weg
Genne den wir machten
vnd vielen die knechte drut
vnd vil in vntz an den arb
vnd die pferit vnz an die
pettel vnd was ze mot ein grosser
nebel & wir kum gepaffen
vnd als mit grosser arbeit kame
wir ze mitten tag zu sant
kristoffel vff den berg So
So fach ich die bucher So gar
vil herrin wopen in stone
die ir stur & gyn geben hand
So fand mineb vatterb flugen
wopen sich in dem smey","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score72.0%
CER ↓28.8%

Speed

Model time, all inputs220.9 s
Mean per input18.41 s
Slowest input24.93 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens39.3K
Output tokens2.8K
Total tokens42K
Input cost$0.0079
Output cost$0.0024
Total cost$0.0103

Priced from 2026-09-16 · Input $/M $0.20 · Output $/M $0.88

Result 60 of 177

Test T0516 at 2026-09-16

manuscript transcription handwritten 15 de prose

anthropic claude-opus-4-5-20251101 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score97.4%
CER ↓1.7%

{"folios":[{"folio":"3","text":"Jnd ein pferit die mir vnd
minen knechten vber hulffend
den do was mengen kein weg
denne den wir machtend
vnd viehend die knecht dick
vnd vil in vntz an den arß
vnd die pferit vntz an die
settel vnd was ze mol ein grosser
nebel dz wir kum gesachend
vnd als mit grosser arbeit kame
wir ze mittem tag zuͦ sant
kristoffel vff den berg do
do sach ich die buͦcher do gar
vil herren wopen jn stond
die ir stur do hin geben hand
do stuͦnd mines vatters seligen
wopen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score82.8%
CER ↓18.2%

Speed

Model time, all inputs125.0 s
Mean per input10.41 s
Slowest input16.79 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens35.9K
Output tokens3.4K
Total tokens39.2K
Input cost$0.1795
Output cost$0.0839
Total cost$0.2633

Priced from 2026-09-16 · Input $/M $5.00 · Output $/M $25.00