RISE Humanities Data Benchmark, 0.6.1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Loading module...

Search Results

Your search for Benchmark 'medieval_manuscripts__true' with Search Hidden 'False' returned 177 results, showing page 5 of 18.
Result 41 of 177

Test T1108 at 2026-09-16

manuscript transcription handwritten 15 de prose

x-ai grok-4.3 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score95.8%
CER ↓3.9%

{"folios":[{"folio":"3","text":"Und ein pferit die mir vnd
minen knechten vber Rulfend
sen Do was menan kein weg
denne den wir machtend
vnd vriechend die knechte vnd
vnd vil in vntz an den arb
vnd die pferit vntz an die
pettel vnd was ze mol ein grosser
nebel dz wir kum gepassend
vnd als mit grosser arbeit kome
wir ze mittem tag zu sant
kirchoffel vff den berg Do
do sach ich die bucher Do gar
vil herren wapen in ston
die ir stin do hin geleyg hand
Do stund mines vatters Rulgen
wopen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score68.5%
CER ↓34.2%

Speed

Model time, all inputs142.8 s
Mean per input11.90 s
Slowest input17.05 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens39.2K
Output tokens2.7K
Total tokens41.9K
Input cost$0.049
Output cost$0.0067
Total cost$0.084
Reasoning cost usd$0.0283
Total reasoning tokens11.3K

Priced from 2026-09-16 · Input $/M $1.25 · Output $/M $2.50

Result 42 of 177

Test T0658 at 2026-09-16

manuscript transcription handwritten 15 de prose

openai gpt-5.4-2026-03-05 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score93.1%
CER ↓7.1%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir mit
minen knechten vber hulffend
bay do was meinen kẽy weg
Sünne. den wir machtenß
vnd irslend die knecht dick
vnd vil in vntz an den aͧb
vnd die pferit vntz an die
petel vnd was ze mol ein grosser
nebel dz wir kaum geꝑaͤchend
vnd alß mit groffer arbeit kam
wir ze mittentag zů sant
krisoffel vff den berg do
do hub ich die bücher do gar
vil hering wapen zu stont
Die ir für dꝛhin gelien hand
So sind mines vatters flügen
wappen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score77.7%
CER ↓24.0%

Speed

Model time, all inputs75.0 s
Mean per input6.25 s
Slowest input10.37 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens42.5K
Output tokens2.5K
Total tokens45K
Input cost$0.1062
Output cost$0.0378
Total cost$0.144

Priced from 2026-09-16 · Input $/M $2.50 · Output $/M $15.00

Result 43 of 177

Test T1666 at 2026-09-16

manuscript transcription handwritten 15 de prose

openai gpt-6-astra · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score98.2%
CER ↓0.7%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vber hulfend
den do was nienan kein weg
denne den wir machtend
vnd vielend die knecht dick
vnd vil in vntz an den ars
vnd die pferit vntz an die
settel vnd was ze mol ein grosser
nebel dz wir kum gesachend
vnd als mit grosser arbeit kamen
wir ze mittem tag zuo sant
kristoffel vff den berg do
do sach ich die buecher do gar
vil herren wopen in stont
die ir stur de hin geben hand
do stuond mines vatters seligen
wopen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score86.7%
CER ↓12.9%

Speed

Model time, all inputs808.5 s
Mean per input67.38 s
Slowest input169.39 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens47.5K
Output tokens24.5K
Total tokens72K
Input cost$0.4754
Output cost$1.23
Total cost$1.70

Priced from 2026-09-03 · Input $/M $10.00 · Output $/M $50.00

Result 44 of 177

Test T0494 at 2026-09-16

manuscript transcription handwritten 15 de prose

openai gpt-5.2-2025-12-11 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score93.8%
CER ↓6.4%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vber hulffend
So So was menen künig weg
Sume So wir machten
vnd vindend die knecht dick
vnd vil in vntz an den arm
vnd die pferit vntz an die
sittel vnd was ze mol ein grosser
nebel dz wir kum gesachend
vnd als mit grosser arbeit kame
wir ze mittem tag zu sant
kristoffel vff den berg So
So sach ich die hücher So gar
vil herꝛen wappen jn ston
Die in stür Edlen guldin hand
So stůnd mines vatters klagen
wappen och in dem vmech","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score70.9%
CER ↓31.8%

Speed

Model time, all inputs84.0 s
Mean per input7.00 s
Slowest input11.86 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens47.5K
Output tokens2.7K
Total tokens50.2K
Input cost$0.0832
Output cost$0.0375
Total cost$0.1207

Priced from 2026-09-16 · Input $/M $1.75 · Output $/M $14.00

Result 45 of 177

Test T0898 at 2026-09-16

manuscript transcription handwritten 15 de prose

openrouter qwen/qwen3.6-plus · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score95.3%
CER ↓4.3%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vber hulfend
gen do was menen fain weg
denne den wir machtend
vnd rittend die knecht dik
vnd vil in vntz an den anb
vnd die pferit vntz an die
petrel vnd was ze mol ein grosser
nebel dz wir kum gepassend
vnd als mit grosser arbeit kame
wir ze mittem tag zu sant
christoffel vff den berg do
do sach ich die bucher do gar
vil herren wopen in stone
die ir stur helm geberen hand
do fand mines vatters plogen
wopen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score72.3%
CER ↓30.1%

Speed

Model time, all inputs912.7 s
Mean per input76.06 s
Slowest input209.95 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens39.6K
Output tokens41.9K
Total tokens81.5K
Input cost$0.0129
Output cost$0.0818
Total cost$0.0946

Priced from 2026-09-16 · Input $/M $0.325 · Output $/M $1.95

Result 46 of 177

Test T1441 at 2026-09-16

manuscript transcription handwritten 15 de prose

genai gemini-3.5-flash-lite · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score94.9%
CER ↓4.5%

{"folios":[{"folio":"3","text":"Und ein pferit die mir vnd
minen knechten vber hulfend
Jen Do was menen kein weg
denne den wir machtend
und vihend die knechte dut
vnd vil in vns an den arb
vnd die pferit vns an die
petel vnd was ze mol ein grösse
nebel daz wir kum gejagtend
und als mit grosser arbeit kome
wir ze mittem tag zu sant
Kristoffel off den berg Do
do sach ich die bücher do gar
vil herren wopen in stoue
die in stur dolin geben hand
Do stund mines vatters sligen
wopen ast in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score76.2%
CER ↓26.1%

Speed

Model time, all inputs30.1 s
Mean per input2.50 s
Slowest input3.70 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens19.1K
Output tokens2.9K
Total tokens22K
Input cost$0.0057
Output cost$0.0072
Total cost$0.013

Priced from 2026-09-16 · Input $/M $0.30 · Output $/M $2.50

Result 47 of 177

Test T0634 at 2026-09-16

manuscript transcription handwritten 15 de prose

anthropic claude-opus-4-6 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score97.4%
CER ↓1.5%

{"folios":[{"folio":"3","text":"vnd ein pferit die mir vnd
minen knechten vber hulffend
den do was menen kein weg
denne den wir machtend
vnd viehend die knecht dick
vnd vil in vntz an den arß
vnd die pferit vntz an die
settel vnd was ze mol ein grosseꝛ
nebel dz wir kum gesachend
vnd als mit grosser arbeit kame
wir ze mittem tag zuͦ sant
kristoffel vff den berg do
do sach ich die buͦcher do gar
vil herren wopen jn stond
die ir stür do hin geben hand
do stuͦnd mines vatters seligen
wopen och in dem einen","addition1":null,"addition2":null,"addition3":null}]}

Scoring

Fuzzy score85.8%
CER ↓15.4%

Speed

Model time, all inputs164.7 s
Mean per input13.73 s
Slowest input20.68 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens35.9K
Output tokens3.4K
Total tokens39.3K
Input cost$0.1795
Output cost$0.0843
Total cost$0.2638

Priced from 2026-09-16 · Input $/M $5.00 · Output $/M $25.00

Result 48 of 177

Test T1082 at 2026-09-16

manuscript transcription handwritten 15 de prose

anthropic claude-opus-4-8 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score98.2%
CER ↓1.8%

{"folios":[{"folio":"3","text":"vnd ein pferit die mir vnd
 minen knechten iber hulffend
 den do was menen kein weg
 denne den wir machtend
 vnd ziehend die knecht dick
 vnd vil in vntz an den ars
 vnd die pferit vntz an die
 settel vnd was ze mol ein grosser
 nebel dz wir kum gesahend
 vnd als mit grosser arbeit kome
 wir ze mittem tag zu sant
 kristoffel vff den berg do
 do sach ich die bücher do gar
 vil herren wopen zu stone
 die ir stür do hin geben hand
 do stund mines vatters seligen
 wopen och in dem einen","addition1":null,"addition2":null,"addition3":null}]}

Scoring

Fuzzy score81.0%
CER ↓19.3%

Speed

Model time, all inputs119.4 s
Mean per input9.95 s
Slowest input17.13 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens61.9K
Output tokens3.9K
Total tokens65.8K
Input cost$0.3093
Output cost$0.0978
Total cost$0.4072

Priced from 2026-09-16 · Input $/M $5.00 · Output $/M $25.00

Result 49 of 177

Test T1651 at 2026-09-16

manuscript transcription handwritten 15 de prose

genai gemini-3.8-flash · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score97.0%
CER ↓2.1%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vber hulfend
den Do was nienan kein weg
denne den wir machtend
vnd wichend die knecht duk
vnd vil in vntz an den arß
vnd die pferit vntz an die
settel vnd was ze mol ein grosser
nebel dz wir kum gepartend
vnd als mit grosser arbeit komẽ
wir ze mittem tag zů sant
kristoffel vff den berg do
Do sach ich die bůcher do gar
vil herren wopen jn stond
die in stür do hin geben hand
do stůnd mines vatters seligen
wopen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score78.0%
CER ↓22.7%

Speed

Model time, all inputs556.6 s
Mean per input46.38 s
Slowest input110.67 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens19.1K
Output tokens2.9K
Total tokens22K
Input cost$0.0143
Output cost$0.0109
Total cost$0.5376
Reasoning cost usd$0.5124
Total reasoning tokens136.6K

Priced from 2026-09-02 · Input $/M $0.75 · Output $/M $3.75

Result 50 of 177

Test T1591 at 2026-09-16

manuscript transcription handwritten 15 de prose

genai gemini-3.7-flash · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score97.4%
CER ↓1.7%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vber hulfend
den Do was nienan kain weg
denne den wir machtend
vnd vielend die knecht dik
vnd vil in vntz an den ars
vnd die pferit vntz an die
settel vnd was ze mol ein grosser
nebel dz wir kum gepassend
vnd als mit grosser arbeit komē
wir ze mittem tag zů sant
kristoffel vff den berg do
do sach ich die bůcher do gar
vil herren wopen jn stond
die in stür do hin geben hand
do stůnd mines vatters seligen
wopen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score84.0%
CER ↓16.6%

Speed

Model time, all inputs91.9 s
Mean per input7.66 s
Slowest input10.33 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens19.1K
Output tokens3K
Total tokens22.1K
Input cost$0.0143
Output cost$0.0113
Total cost$0.0844
Reasoning cost usd$0.0587
Total reasoning tokens15.7K

Priced from 2026-08-18 · Input $/M $0.75 · Output $/M $3.75