University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

o3

OpenAI
average
72.6
leaderboard rankof 114
≈54
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$43
seconds per inputmean response time
40.1
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    53.8

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    82.3

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    82.7

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    66.8

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Dataolder run 94.5 ≈57of 115 –– run 73.92 T0133 · 20 Aug 2025prompt.txt
Blacklist Cards 87.7±4.1 ≈79of 114 $6.65$0.22 run 16.81 T0312 · 26 Jan 2026prompt.txt
Book Advert XML Repair 16.4±6.1 ≈89of 119 $25$1.24 run 25.49 T0455 · 9 Dec 2025prompt.txt
Business Lettersolder run 65.0 ≈21of 114 $8.86$0.51 run 18.22 T0134 · 1 Oct 2025prompt.txt
Company Listsolder run 88.3 ≈26of 114 $18$0.27 run 39.76 T0353 · 28 Oct 2025prompt.txt
Duty Rosters 79.4±2.7 ≈46of 107 $237$4.99 run 35.09 T1303 · 24 Jul 2026prompt.txt
Fraktur Advertsolder run 46.6 93of 114 –– run 75.13 T0137 · 27 Aug 2025prompt_optimized.txt
General Meeting Minutes 76.8±10.5 ≈25of 108 $30$0.27 run 31.51 T1254 · 16 Sep 2026prompt.txt
Library Cardsolder run 86.8 ≈41of 114 –– run 14.99 T0168 · 2 Sep 2025prompt.txt
Magazine Pages 76.1±9.6 ≈34of 115 $8.43$0.39 run 9.37 T0780 · 16 Sep 2026prompt.txt
Medieval Manuscripts 62.4±15.7 ≈72of 114 $30$0.36 run 99.21 T0282 · 26 Jan 2026prompt.txt
Personnel Cards 91.3±2.6 ≈78of 114 $25$1.55 run 41.61 T0615 · 10 Feb 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
16 Sep 20262.08.0archived price page
22 Jul 202610.040.0archived price page
0 Sep 20252.08.0archived price page

Every run

  1. T1303Duty Rosters16 Sep 202678.5$1.08
  2. T1254General Meeting Minutes16 Sep 202676.8$0.27
  3. T0780Magazine Pages16 Sep 202676.1$0.39
  4. T0615Personnel Cards16 Sep 202690.1$1.56
  5. T1303Duty Rosters24 Jul 202679.4$4.99
  6. T1254General Meeting Minutes3 Jul 202675.3$0.27
  7. T0780Magazine Pages23 Mar 202675.4$0.36
  8. T0133Bibliographic Data17 Feb 202690.5$0.17
  9. T0615Personnel Cards10 Feb 202691.3$1.55
  10. T0455Book Advert XML Repair26 Jan 202614.3$1.21
  11. T0312Blacklist Cards26 Jan 202687.7$0.22
  12. T0282Medieval Manuscripts26 Jan 202662.4$0.36
  13. T0168Library Cards26 Jan 202683.2$2.39
  14. T0136Business Letters26 Jan 2026 · 32 signed letters68.0$0.31
  15. T0135Business Letters26 Jan 2026 · 25 unsigned letters79.0$0.22
  16. T0134Business Letters26 Jan 2026 · all 57 letters64.0$0.53
  17. T0354Company Lists25 Jan 202668.4$0.25
  18. T0353Company Lists25 Jan 202684.3$0.30
  19. T0137Fraktur Adverts25 Jan 202616.5$0.12
  20. T0455Book Advert XML Repair9 Dec 202516.4$1.24
  21. T0455Book Advert XML Repair8 Dec 20250.0$0
  22. T0354Company Lists28 Oct 202567.8$0.27
  23. T0353Company Lists28 Oct 202588.3$0.27
  24. T0312Blacklist Cards24 Oct 202585.7$0.21
  25. T0282Medieval Manuscripts24 Oct 202551.5$0.34
  26. T0168Library Cards1 Oct 202583.3$2.54
  27. T0137Fraktur Adverts1 Oct 202512.2$0.15
  28. T0136Business Letters1 Oct 2025 · 32 signed letters64.0$0.31
  29. T0135Business Letters1 Oct 2025 · 25 unsigned letters70.0$0.19
  30. T0134Business Letters1 Oct 2025 · all 57 letters65.0$0.51
  31. T0133Bibliographic Data1 Oct 202593.2$0.19
  32. T0133Bibliographic Data30 Sep 202594.0$0.20
  33. T0134Business Letters24 Sep 2025 · all 57 letters63.0–
  34. T0168Library Cards2 Sep 202586.8–
  35. T0137Fraktur Adverts27 Aug 202546.6–
  36. T0136Business Letters27 Aug 2025 · 32 signed letters67.0–
  37. T0136Business Letters20 Aug 2025 · 32 signed letters66.0–
  38. T0135Business Letters20 Aug 2025 · 25 unsigned letters67.0–
  39. T0134Business Letters20 Aug 2025 · all 57 letters63.0–
  40. T0133Bibliographic Data20 Aug 202594.5–