RISE Humanities Data Benchmark, 0.6.1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Loading module...

Search Results

Your search for Benchmark 'medieval_manuscripts__true' with Search Hidden 'False' returned 177 results, showing page 8 of 18.
Result 71 of 177

Test T1711 at 2026-09-08

manuscript transcription handwritten 15 de prose

openrouter z-ai/glm-5.3-flash · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score89.9%
CER ↓10.9%

{"folios":[{"folio":"3","text":"vnd ein pferit die mir vnd
minem knechten über tusend
dan so was minem hêrwær
hême dʒ wir mazktend
vnd rittend die knechte dâ
vnd vil in vnz an dʒ arb
vnd die pferit vnz an die
steel vnd was ze mal ein grosser
nabet dʒ wir kùm ge 邦t信tend
vnd als mit grosser arbeit kame
wir ze mitten tag zû sant
krippel vff dʒ bergy so
so sach ich die küpfer so gar
vil görin wopin jn sant
die in stück zê shun gelogen 拓d
so stünd minem vatterz klägen
wopin och jn dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score76.8%
CER ↓25.8%

Speed

Model time, all inputs152.6 s
Mean per input12.72 s
Slowest input21.01 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens49.7K
Output tokens3K
Total tokens52.7K
Input cost$0.0037
Output cost$0.0007
Total cost$0.0045

Priced from 2026-09-08 · Input $/M $0.075 · Output $/M $0.25

Result 72 of 177

Test T1726 at 2026-09-08

manuscript transcription handwritten 15 de prose

openrouter qwen/qwen3.8-flash · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score93.9%
CER ↓5.8%

{"folios":[{"folio":"3","text":"Vnd ein pferit die wir vnd
minnen knechten vber fuhrend
San do waz menen lan weg
deme dan wir machend
vnd vichend die knechte duk
vnd vit in vntz an den arb
vnd die pferit vntz an die
pettel vnd waz ze mol ein grosser
nebel dz wir kaum gepathend
vnd als mit grosser arbeit kame
wir ze mitten tag zu sant
kristoffel vff den berg do
do sach ich die buecher do gar
vil herren wopen zu stone
die ir stur schim gebey hand
so seind mines vatters pflegen
wopen och in dem ein tag","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score73.1%
CER ↓28.0%

Speed

Model time, all inputs3086.5 s
Mean per input257.21 s
Slowest input391.72 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens39K
Output tokens227.2K
Total tokens266.2K
Input cost$0.005
Output cost$0.0992
Total cost$0.1111

Priced from 2026-09-08 · Input $/M $0.15 · Output $/M $0.47

Result 73 of 177

Test T1696 at 2026-09-08

manuscript transcription handwritten 15 de prose

openrouter meta/muse-spark-1.3 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score96.0%
CER ↓3.5%

{"folios":[{"folio":"3","text":"Vnd ein pferit die wir vnd
minen knechten vber hulfend
den do was meinen kein weg
denne den wir machtend
vnd vichend die knecht dik
vnd vil in vntz an den arb
vnd die pferit vntz an die
kettel vnd was ze mal ein grosser
nebel dz wir kum gesachend
vnd also mit grosser arbeit kame
wir ze mittem tag zuo sant
kristoffel vff den berg do
Do sach ich die buocher Do gar
vil herren wopen zuo rome
die in fir ochin geben hand
do stunt mines vatters schigen
wopen och in dem cwen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score79.4%
CER ↓22.8%

Speed

Model time, all inputs302.7 s
Mean per input25.22 s
Slowest input44.42 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens51.4K
Output tokens31.8K
Total tokens83.2K
Input cost$0.0643
Output cost$0.1352
Total cost$0.1995

Priced from 2026-09-08 · Input $/M $1.25 · Output $/M $4.25

Result 74 of 177

Test T1666 at 2026-09-04

manuscript transcription handwritten 15 de prose

openai gpt-6-astra · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score97.6%
CER ↓1.3%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vber hulfend
den do was menan kein weg
denne den wir machtend
vnd vielend die knecht dick
vnd vil in vntz an den ars
vnd die pferit vntz an die
settel vnd was ze mol ein grosser
nebel dz wir kum gesachend
vnd als mit grosser arbeit kamē
wir ze mittem tag zuo sant
kristoffel vff den berg do
do sach ich die buecher do gar
vil herren wopen jn stont
die ir stur de hin geten hand
do stuond mines vatters seligen
wopen och jn dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score80.2%
CER ↓19.2%

Speed

Model time, all inputs461.4 s
Mean per input38.45 s
Slowest input68.44 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens47.5K
Output tokens23.7K
Total tokens71.2K
Input cost$0.4754
Output cost$1.18
Total cost$1.66

Priced from 2026-09-03 · Input $/M $10.00 · Output $/M $50.00

Result 75 of 177

Test T1651 at 2026-09-03

manuscript transcription handwritten 15 de prose

genai gemini-3.8-flash · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score97.0%
CER ↓2.1%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vber hulfend
den do was nieman kain weg
denne den wir machtend
vnd sinckend die knecht dick
vnd vil in vntz an den ars
vnd die pferit vntz an die
settel vnd was ze mol ein grosser
nebel dz wir kum gesahend
vnd also mit grosser arbeit kome
wir ze mittem tag zů sant
kristoffel vff den berg do
do sach ich die bůcher do gar
vil herren wopen in stont
die in stůr dahin geben hand
do stůnd mines vatters seligen
wopen och in dem einan","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score79.9%
CER ↓20.8%

Speed

Model time, all inputs366.0 s
Mean per input30.50 s
Slowest input83.44 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens19.1K
Output tokens2.9K
Total tokens22K
Input cost$0.0143
Output cost$0.0109
Total cost$0.3506
Reasoning cost usd$0.3254
Total reasoning tokens86.8K

Priced from 2026-09-02 · Input $/M $0.75 · Output $/M $3.75

Result 76 of 177

Test T1606 at 2026-08-18

manuscript transcription handwritten 15 de prose

x-ai grok-4.6 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score97.1%
CER ↓1.9%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vber hulfend
den Do was menan kein Weg
denne den wir machtend
vnd vielend die knechte dick
vnd vil in vntz an den arb
vnd die pferit vntz an die
pettel vnd was ze mol ein grosser
nebel dz wir kum gesachend
vnd als mit grosser arbeit kame
wir ze mittem tag zu sant
kristoffel vff den berg do
do sach ich die bucher do gar
vil herren wapen in stond
die ir stir deßhin geben hand
do stund mines vatters slugen
wapen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score81.3%
CER ↓18.5%

Speed

Model time, all inputs818.7 s
Mean per input68.23 s
Slowest input108.90 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens40.1K
Output tokens2.7K
Total tokens42.9K
Input cost$0.0802
Output cost$0.0165
Total cost$0.3382
Reasoning cost usd$0.2415
Total reasoning tokens40.3K

Priced from 2026-08-18 · Input $/M $2.00 · Output $/M $6.00

Result 77 of 177

Test T1591 at 2026-08-18

manuscript transcription handwritten 15 de prose

genai gemini-3.7-flash · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score97.0%
CER ↓2.1%

{"folios":[{"folio":"3","text":"Vnd ein pferit die mir vnd
minen knechten vber hulfend
den do was nienen kain weg
denne den wir machetend
vnd viehend die knecht dick
vnd vil in vntz an den ars
vnd die pferit vntz an die
settel vnd was ze mol ein grosser
nebel dz wir kum gepassend
vnd also mit grosser arbeit komẽ
wir ze mittem tag zů sant
kristoffel vff den berg do
do sach ich die bůcher do gar
vil herren wopen jn stont
die in stür dahin geben hand
do stůnd mines vatters seligen
wopen och in dem einen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score84.5%
CER ↓14.8%

Speed

Model time, all inputs109.3 s
Mean per input9.11 s
Slowest input33.85 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens17.5K
Output tokens2.6K
Total tokens20.1K
Input cost$0.0132
Output cost$0.0098
Total cost$0.0665
Reasoning cost usd$0.0435
Total reasoning tokens11.6K

Priced from 2026-08-18 · Input $/M $0.75 · Output $/M $3.75

Result 78 of 177

Test T1636 at 2026-08-18

manuscript transcription handwritten 15 de prose

openrouter z-ai/glm-5v-turbo · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

{
  "folios": [
    {
      "folio": "3",
      "text": "vns ein pfeçit Sie mir vnß
minen Encksten vber Auſſend
ſen ſo waß minen Rey weg
ſeme ſon mir maſten
vnß viſchen Sie Encte ſut
vnß vil in vnganſen anß
vnß Sie pfeçit vng an Sie
peter vnß waß ze mot ein groſŝe
nebet ß win kuny geſtaſſen
vnß aß mit groſŝer anſcit kome
win ze mittam tag zū pant
Eniſoffel vffſey becg ſo
ſo pach iog die bucter ſo gar
vil gerien woſpen zū fone
die in firir ſchun geſtrey gand
ſo paind mincſ wattevo pleyen
woſpen aß in ſem cinen",
      "addition1": "",
      "addition2": "",
      "addition3": ""
    }
  ]
}

Scoring

Fuzzy score0.0%
CER ↓100.0%

Speed

Model time, all inputs1006.9 s
Mean per input83.90 s
Slowest input134.98 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens51.1K
Output tokens22.8K
Total tokens73.9K
Input cost$0.0614
Output cost$0.091
Total cost$0.1524

Priced from 2026-08-18 · Input $/M $1.20 · Output $/M $4.00

Result 79 of 177

Test T1621 at 2026-08-18

manuscript transcription handwritten 15 de prose

openrouter meta/muse-spark-1.2 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score94.8%
CER ↓4.9%

{"folios":[{"folio":"3","text":"Vnd ein pferit die wir mit
minen knechten vber hulffend
den So was mench schoen weg
demme den wir machtend
vnd vichend die knecht dick
vnd vil in vntz an den arb
vnd die pferit vntz an die
pettel vnd was ze mal ein grosser
nebel dz wir kum gesahend
vnd also mit grosser arbeit kame
wir ze mittem tag zuo sant
kristoffel vff den berg do
do sach ich die buocher do gar
vil herren wopen zuo Rome
die in stur edlen geben hand
do fund mines vatters seligen
wopen och in dem cimey","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score82.1%
CER ↓18.6%

Speed

Model time, all inputs487.9 s
Mean per input40.65 s
Slowest input81.23 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens49.5K
Output tokens28.4K
Total tokens77.9K
Input cost$0.0618
Output cost$0.1209
Total cost$0.1828

Priced from 2026-08-18 · Input $/M $1.25 · Output $/M $4.25

Result 80 of 177

Test T1576 at 2026-08-16

manuscript transcription handwritten 15 de prose

huggingface meta-models/Muse-Glimmer-30B · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score89.3%
CER ↓10.8%

{"folios":[{"folio":"3","text":"Und ein pferit Sie wir und
minen Enckten vnder Aufsand
Den So was menen Eyn weg
Semme Den wir machten
und vichent Sie Enckte Suck
und vil in vntz an Sen anb
und Sie pferit vntz an Sie
petel und was ze mol ein groffer
nebel Es wir kum gespand
und als mit groffer arbait kome
wir ze mittrem tag zu Sant
Eripoffel vff Sen Berg So
So fach ich die Bücher So gar
vil Gerrin wopen in Rome
Sie in fir Ed Gyn gelben Gand
So pünt mines vatters Plagen
wopen aof in Sen emen","addition1":"","addition2":"","addition3":""}]}

Scoring

Fuzzy score64.9%
CER ↓38.9%

Speed

Model time, all inputs824.7 s
Mean per input68.73 s
Slowest input300.47 s
Inputs timed12

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens49.7K
Output tokens57K
Total tokens106.7K
Input cost$0.0174
Output cost$0.0856
Total cost$0.1029

Priced from 2026-08-15 · Input $/M $0.35 · Output $/M $1.50