RISE Humanities Data Benchmark, 0.6.1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Search Results
Show compact results Refine Search New Search
Download JSON Download CSV

Your search for Benchmark 'personnel_cards__true' with Search Hidden 'False' returned 178 results, showing page 1 of 18.
Result 1 of 178

Test T1881 at 2026-09-29

index-card transcription, document-understanding, data-correction handwritten, typed, printed 20 de, fr table, form

anthropic claude-sonnet-5-5 · temp 0.0 · dataclass Table

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision96.6%
Recall91.3%
True positives84
False positives3
False negatives8
F1 score94.0%
Total fields114

{"rows":[{"row_number":1,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9","interpretation":"9","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"6,800.-","interpretation":"6800","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":2,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9.","interpretation":"9","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7'200.-","interpretation":"7200","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Sept. 1944","interpretation":"1944-09-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":3,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"\"","interpretation":"9","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 45","interpretation":"1945-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":4,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"I","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7.600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Juli 1945","interpretation":"1945-07-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen (Bes.Kl.)","interpretation":null,"is_crossed_out":false}},{"row_number":5,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.000.-","interpretation":"8000","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1946","interpretation":"1946-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":6,"dienstliche_stellung":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.400.-","interpretation":"8400","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1947","interpretation":"1947-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}}]}

Scoring

F1 micro97.7%
F1 macro91.6%
Micro precision97.8%
Micro recall97.5%
Instances61
True positives2,456
False positives56
False negatives62

Speed

Model time, all inputs402.9 s
Mean per input6.60 s
Slowest input30.52 s
Inputs timed61

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens416.1K
Output tokens66.5K
Total tokens482.6K
Input cost$0.8322
Output cost$0.6651
Total cost$1.50

Priced from 2026-09-28 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 2 of 178

Test T1821 at 2026-09-29

index-card transcription, document-understanding, data-correction handwritten, typed, printed 20 de, fr table, form

anthropic claude-opus-5-5 · temp 0.0 · dataclass Table

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision96.7%
Recall95.7%
True positives88
False positives3
False negatives4
F1 score96.0%
Total fields114

{"rows":[{"row_number":1,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"6,800.-","interpretation":"6800","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":2,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9.","interpretation":"9","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7'200.-","interpretation":"7200","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Sept. 1944","interpretation":"1944-09-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":3,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"\"","interpretation":"9","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 45","interpretation":"1945-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":4,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"I","interpretation":"1","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7.600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Juli 1945","interpretation":"1945-07-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen (Bes.Kl.)","interpretation":null,"is_crossed_out":false}},{"row_number":5,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.000.-","interpretation":"8000","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1946","interpretation":"1946-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":6,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.400.-","interpretation":"8400","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1947","interpretation":"1947-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}}]}

Scoring

F1 micro97.2%
F1 macro91.0%
Micro precision97.3%
Micro recall97.1%
Instances61
True positives2,446
False positives67
False negatives72

Speed

Model time, all inputs640.9 s
Mean per input10.51 s
Slowest input48.77 s
Inputs timed61

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens416.1K
Output tokens71.8K
Total tokens487.9K
Input cost$1.66
Output cost$1.44
Total cost$3.10

Priced from 2026-09-27 · Input $/M $4.00 · Output $/M $20.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 3 of 178

Test T1806 at 2026-09-29

index-card transcription, document-understanding, data-correction handwritten, typed, printed 20 de, fr table, form

scicore Qwen3.8-Flash-Next-FP8 · temp 0.0 · dataclass Table

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision89.2%
Recall90.2%
True positives83
False positives10
False negatives9
F1 score90.0%
Total fields114

{"rows":[{"row_number":1,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"6,800.-","interpretation":"6800","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Sept. 1944","interpretation":"1944-09-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":2,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9.","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7'200.-","interpretation":"7200","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 45","interpretation":"1945-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":3,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"\"","interpretation":"9.","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 45","interpretation":"1945-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":4,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"7","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7.600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Juli 1945","interpretation":"1945-07-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen (Bes.Kl.)","interpretation":null,"is_crossed_out":false}},{"row_number":5,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.000.-","interpretation":"8000","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1946","interpretation":"1946-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":6,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.400.-","interpretation":"8400","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1947","interpretation":"1947-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}}]}

Scoring

F1 micro96.1%
F1 macro90.8%
Micro precision95.9%
Micro recall96.2%
Instances61
True positives2,422
False positives103
False negatives96

Speed

Model time, all inputs1504.5 s
Mean per input24.66 s
Slowest input105.42 s
Inputs timed61

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens255.9K
Output tokens185.5K
Total tokens441.4K
Input cost$0.00
Output cost$0.00
Total cost$0.00

Priced from 2026-09-27 · Input $/M $0.00 · Output $/M $0.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 4 of 178

Test T1686 at 2026-09-29

index-card transcription, document-understanding, data-correction handwritten, typed, printed 20 de, fr table, form

anthropic claude-fable-5-1 · temp 0.0 · dataclass Table

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision96.7%
Recall96.7%
True positives89
False positives3
False negatives3
F1 score97.0%
Total fields114

{"rows":[{"row_number":1,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9","interpretation":"9","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"6,800.-","interpretation":"6800","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":2,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9.","interpretation":"9","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7'200.-","interpretation":"7200","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Sept. 1944","interpretation":"1944-09-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":3,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"\"","interpretation":"9","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 45","interpretation":"1945-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":4,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"7","interpretation":"7","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7.600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Juli 1945","interpretation":"1945-07-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen (Bes.Kl.)","interpretation":null,"is_crossed_out":false}},{"row_number":5,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.000.-","interpretation":"8000","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1946","interpretation":"1946-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":6,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.400.-","interpretation":"8400","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1947","interpretation":"1947-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}}]}

Scoring

F1 micro97.4%
F1 macro91.0%
Micro precision97.1%
Micro recall97.8%
Instances61
True positives2,462
False positives73
False negatives56

Speed

Model time, all inputs878.6 s
Mean per input14.40 s
Slowest input64.58 s
Inputs timed61

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens416.1K
Output tokens73.3K
Total tokens489.3K
Input cost$4.16
Output cost$3.66
Total cost$7.82

Priced from 2026-09-08 · Input $/M $10.00 · Output $/M $50.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 5 of 178

Test T1881 at 2026-09-28

index-card transcription, document-understanding, data-correction handwritten, typed, printed 20 de, fr table, form

anthropic claude-sonnet-5-5 · temp 0.0 · dataclass Table

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision95.6%
Recall94.6%
True positives87
False positives4
False negatives5
F1 score95.0%
Total fields114

```json
{
  "rows": [
    {
      "row_number": 1,
      "dienstliche_stellung": {
        "diplomatic_transcript": "Angestellter",
        "interpretation": null,
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "Zürich",
        "interpretation": null,
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "9",
        "interpretation": null,
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "6,800.-",
        "interpretation": "6.8",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "",
        "interpretation": null,
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen",
        "interpretation": null,
        "is_crossed_out": false
      }
    },
    {
      "row_number": 2,
      "dienstliche_stellung": {
        "diplomatic_transcript": "Angestellter",
        "interpretation": null,
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "Zürich",
        "interpretation": null,
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "9.",
        "interpretation": "9",
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "7'200.-",
        "interpretation": "7200",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "1. Sept. 1944",
        "interpretation": "1944-09-01",
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen",
        "interpretation": null,
        "is_crossed_out": false
      }
    },
    {
      "row_number": 3,
      "dienstliche_stellung": {
        "diplomatic_transcript": "\"",
        "interpretation": "Angestellter",
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "\"",
        "interpretation": "Zürich",
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "\"",
        "interpretation": "9",
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "7600.-",
        "interpretation": "7600",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "1. Jan. 45",
        "interpretation": "1945-01-01",
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen",
        "interpretation": null,
        "is_crossed_out": false
      }
    },
    {
      "row_number": 4,
      "dienstliche_stellung": {
        "diplomatic_transcript": "\"",
        "interpretation": "Angestellter",
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "\"",
        "interpretation": "Zürich",
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "I",
        "interpretation": "1",
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "7.600.-",
        "interpretation": "7600",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "1. Juli 1945",
        "interpretation": "1945-07-01",
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen (Bes.Kl.)",
        "interpretation": null,
        "is_crossed_out": false
      }
    },
    {
      "row_number": 5,
      "dienstliche_stellung": {
        "diplomatic_transcript": "\"",
        "interpretation": "Angestellter",
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "\"",
        "interpretation": "Zürich",
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "",
        "interpretation": null,
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "8.000.-",
        "interpretation": "8000",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "1. Jan. 1946",
        "interpretation": "1946-01-01",
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen",
        "interpretation": null,
        "is_crossed_out": false
      }
    },
    {
      "row_number": 6,
      "dienstliche_stellung": {
        "diplomatic_transcript": "\"",
        "interpretation": "Angestellter",
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "\"",
        "interpretation": "Zürich",
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "",
        "interpretation": null,
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "8.400.-",
        "interpretation": "8400",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "1. Jan. 1947",
        "interpretation": "1947-01-01",
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen",
        "interpretation": null,
        "is_crossed_out": false
      }
    }
  ]
}
```

Scoring

F1 micro97.5%
F1 macro91.3%
Micro precision97.5%
Micro recall97.4%
Instances61
True positives2,453
False positives63
False negatives65

Speed

Model time, all inputs461.0 s
Mean per input7.56 s
Slowest input31.23 s
Inputs timed61

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens343.9K
Output tokens79.5K
Total tokens423.5K
Input cost$0.6878
Output cost$0.7954
Total cost$1.48

Priced from 2026-09-28 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 6 of 178

Test T1851 at 2026-09-27

index-card transcription, document-understanding, data-correction handwritten, typed, printed 20 de, fr table, form

openai gpt-6-luna · temp 0.0 · dataclass Table

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision97.8%
Recall94.6%
True positives87
False positives2
False negatives5
F1 score96.0%
Total fields114

{"rows":[{"row_number":1,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"6.800.-","interpretation":"6800","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":2,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9.","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7.200.-","interpretation":"7200","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Sept. 1944","interpretation":"1944-09-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":3,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"\"","interpretation":"9.","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 45","interpretation":"1945-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":4,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"7","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7.600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Juli 1945","interpretation":"1945-07-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen (Bes.Kl.a.)","interpretation":null,"is_crossed_out":false}},{"row_number":5,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.000.-","interpretation":"8000","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1946","interpretation":"1946-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":6,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.400.-","interpretation":"8400","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1947","interpretation":"1947-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}}]}

Scoring

F1 micro96.7%
F1 macro90.9%
Micro precision96.4%
Micro recall97.1%
Instances61
True positives2,444
False positives91
False negatives74

Speed

Model time, all inputs592.3 s
Mean per input9.71 s
Slowest input39.81 s
Inputs timed61

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens345.5K
Output tokens75.9K
Total tokens421.5K
Input cost$0.0346
Output cost$0.038
Total cost$0.0725

Priced from 2026-09-27 · Input $/M $0.10 · Output $/M $0.50

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 7 of 178

Test T1821 at 2026-09-27

index-card transcription, document-understanding, data-correction handwritten, typed, printed 20 de, fr table, form

anthropic claude-opus-5-5 · temp 0.0 · dataclass Table

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision95.7%
Recall95.7%
True positives88
False positives4
False negatives4
F1 score96.0%
Total fields114

```json
{
  "rows": [
    {
      "row_number": 1,
      "dienstliche_stellung": {
        "diplomatic_transcript": "Angestellter",
        "interpretation": null,
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "Zürich",
        "interpretation": null,
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "9",
        "interpretation": "9",
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "6,800.-",
        "interpretation": "6800",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "",
        "interpretation": null,
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen",
        "interpretation": null,
        "is_crossed_out": false
      }
    },
    {
      "row_number": 2,
      "dienstliche_stellung": {
        "diplomatic_transcript": "Angestellter",
        "interpretation": null,
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "Zürich",
        "interpretation": null,
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "9.",
        "interpretation": "9",
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "7'200.-",
        "interpretation": "7200",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "1. Sept. 1944",
        "interpretation": "1944-09-01",
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen",
        "interpretation": null,
        "is_crossed_out": false
      }
    },
    {
      "row_number": 3,
      "dienstliche_stellung": {
        "diplomatic_transcript": "\"",
        "interpretation": "Angestellter",
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "\"",
        "interpretation": "Zürich",
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "\"",
        "interpretation": "9",
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "7600.-",
        "interpretation": "7600",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "1. Jan. 45",
        "interpretation": "1945-01-01",
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen",
        "interpretation": null,
        "is_crossed_out": false
      }
    },
    {
      "row_number": 4,
      "dienstliche_stellung": {
        "diplomatic_transcript": "\"",
        "interpretation": "Angestellter",
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "\"",
        "interpretation": "Zürich",
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "I",
        "interpretation": "1",
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "7.600.-",
        "interpretation": "7600",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "1. Juli 1945",
        "interpretation": "1945-07-01",
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen (Bes.Kl.)",
        "interpretation": null,
        "is_crossed_out": false
      }
    },
    {
      "row_number": 5,
      "dienstliche_stellung": {
        "diplomatic_transcript": "\"",
        "interpretation": "Angestellter",
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "\"",
        "interpretation": "Zürich",
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "",
        "interpretation": null,
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "8.000.-",
        "interpretation": "8000",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "1. Jan. 1946",
        "interpretation": "1946-01-01",
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen",
        "interpretation": null,
        "is_crossed_out": false
      }
    },
    {
      "row_number": 6,
      "dienstliche_stellung": {
        "diplomatic_transcript": "\"",
        "interpretation": "Angestellter",
        "is_crossed_out": false
      },
      "dienstort": {
        "diplomatic_transcript": "\"",
        "interpretation": "Zürich",
        "is_crossed_out": false
      },
      "gehaltsklasse": {
        "diplomatic_transcript": "",
        "interpretation": null,
        "is_crossed_out": false
      },
      "jahresgehalt_monatsgehalt_taglohn": {
        "diplomatic_transcript": "8.400.-",
        "interpretation": "8400",
        "is_crossed_out": false
      },
      "datum_gehaltsänderung": {
        "diplomatic_transcript": "1. Jan. 1947",
        "interpretation": "1947-01-01",
        "is_crossed_out": false
      },
      "bemerkungen": {
        "diplomatic_transcript": "+ Zulagen",
        "interpretation": null,
        "is_crossed_out": false
      }
    }
  ]
}
```

Scoring

F1 micro97.5%
F1 macro91.2%
Micro precision97.3%
Micro recall97.7%
Instances61
True positives2,459
False positives69
False negatives59

Speed

Model time, all inputs762.3 s
Mean per input12.50 s
Slowest input52.81 s
Inputs timed61

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens343.9K
Output tokens89.6K
Total tokens433.5K
Input cost$1.38
Output cost$1.79
Total cost$3.17

Priced from 2026-09-27 · Input $/M $4.00 · Output $/M $20.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 8 of 178

Test T1836 at 2026-09-27

index-card transcription, document-understanding, data-correction handwritten, typed, printed 20 de, fr table, form

openai gpt-6-sol · temp 0.0 · dataclass Table

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision97.8%
Recall94.6%
True positives87
False positives2
False negatives5
F1 score96.0%
Total fields114

{"rows":[{"row_number":1,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"6,800.-","interpretation":"6800","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":2,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9.","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7,200.-","interpretation":"7200","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Sept. 1944","interpretation":"1944-09-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":3,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"\"","interpretation":"9","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 45","interpretation":"1945-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":4,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"7","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7.600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Juli 1945","interpretation":"1945-07-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen (Bes.Kl.)","interpretation":null,"is_crossed_out":false}},{"row_number":5,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.000.-","interpretation":"8000","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1946","interpretation":"1946-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":6,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8.400.-","interpretation":"8400","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1947","interpretation":"1947-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}}]}

Scoring

F1 micro97.7%
F1 macro91.1%
Micro precision97.9%
Micro recall97.5%
Instances61
True positives2,455
False positives53
False negatives63

Speed

Model time, all inputs622.2 s
Mean per input10.20 s
Slowest input38.13 s
Inputs timed61

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens345.5K
Output tokens53.2K
Total tokens398.8K
Input cost$0.6911
Output cost$0.5322
Total cost$1.22

Priced from 2026-09-27 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 9 of 178

Test T1866 at 2026-09-27

index-card transcription, document-understanding, data-correction handwritten, typed, printed 20 de, fr table, form

x-ai grok-4.7 · temp 0.0 · dataclass Table

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision90.1%
Recall89.1%
True positives82
False positives9
False negatives10
F1 score90.0%
Total fields114

{"rows":[{"row_number":1,"dienstliche_stellung":{"diplomatic_transcript":"Angestellter","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"Zürich","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"6,800.-","interpretation":"6800","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":2,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"9.","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7,200.-","interpretation":"7200","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Sept. 1944","interpretation":"1944-09-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":3,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"\"","interpretation":"9","is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 45","interpretation":"1945-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":4,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"7","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"7,600.-","interpretation":"7600","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Juli 1945","interpretation":"1945-07-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen (Bes.Kl.)","interpretation":null,"is_crossed_out":false}},{"row_number":5,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8,000.-","interpretation":"8000","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1946","interpretation":"1946-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}},{"row_number":6,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Angestellter","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"\"","interpretation":"Zürich","is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"8,400.-","interpretation":"8400","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1947","interpretation":"1947-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"+ Zulagen","interpretation":null,"is_crossed_out":false}}]}

Scoring

F1 micro97.2%
F1 macro91.0%
Micro precision97.2%
Micro recall97.3%
Instances61
True positives2,450
False positives71
False negatives68

Speed

Model time, all inputs6610.2 s
Mean per input108.36 s
Slowest input420.52 s
Inputs timed61

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens374.4K
Output tokens47.3K
Total tokens421.7K
Input cost$0.7489
Output cost$0.2837
Total cost$4.40
Reasoning cost usd$3.37
Total reasoning tokens561.5K

Priced from 2026-09-27 · Input $/M $2.00 · Output $/M $6.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 10 of 178

Test T1731 at 2026-09-18

index-card transcription, document-understanding, data-correction handwritten, typed, printed 20 de, fr table, form

openrouter qwen/qwen3.8-flash · temp 0.0 · dataclass Table

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Precision96.2%
Recall96.2%
True positives25
False positives1
False negatives1
F1 score96.0%
Total fields38

{"rows":[{"row_number":1,"dienstliche_stellung":{"diplomatic_transcript":"Rechnungsführer","interpretation":null,"is_crossed_out":false},"dienstort":{"diplomatic_transcript":"-","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"3'320.-","interpretation":"3320","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Aug. 1943","interpretation":"1943-08-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"inkl. Fr. 200.- Techn.Z","interpretation":null,"is_crossed_out":false}},{"row_number":2,"dienstliche_stellung":{"diplomatic_transcript":"\"","interpretation":"Rechnungsführer","is_crossed_out":false},"dienstort":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"gehaltsklasse":{"diplomatic_transcript":"","interpretation":null,"is_crossed_out":false},"jahresgehalt_monatsgehalt_taglohn":{"diplomatic_transcript":"3'395.-","interpretation":"3395","is_crossed_out":false},"datum_gehaltsänderung":{"diplomatic_transcript":"1. Jan. 1944","interpretation":"1944-01-01","is_crossed_out":false},"bemerkungen":{"diplomatic_transcript":"inkl.Fr.200.- techn.Z","interpretation":null,"is_crossed_out":false}}]}

Scoring

F1 micro96.0%
F1 macro89.9%
Micro precision95.6%
Micro recall96.3%
Instances57
True positives2,254
False positives104
False negatives86

Speed

Model time, all inputs3707.1 s
Mean per input63.92 s
Slowest input259.96 s
Inputs timed58

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens307.5K
Output tokens231.1K
Total tokens538.6K
Input cost$0.046
Output cost$0.1086
Total cost$0.1546

Priced from 2026-09-18 · Input $/M $0.15 · Output $/M $0.47

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827