University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

gpt-4o-mini

OpenAI
average
56.3
leaderboard rankof 114
≈97
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$5.97
seconds per inputmean response time
20.7
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    46.7

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    53.5

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    69.0

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    56.4

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Dataolder run 70.3 102of 115 –– run 35.92 T0027 · 8 Apr 2025prompt.txt
Blacklist Cardsolder run 78.2 ≈103of 114 $3.98$0.13 run 4.72 T0306 · 24 Oct 2025prompt.txt
Book Advert XML Repair 13.6±6.1 ≈89of 119 $0.78$0.039 run 45.63 T0447 · 25 Jan 2026prompt.txt
Business Lettersolder run 55.0 ≈84of 114 $6.69$0.38 run 3.71 T0012 · 30 Sep 2025prompt.txt
Company Lists 61.3±17.3 ≈97of 114 $6.06$0.091 run 16.85 T0339 · 25 Jan 2026prompt.txt
Duty Rosters 71.1±3.2 ≈78of 107 $14$0.30 run 15.19 T1297 · 16 Sep 2026prompt.txt
Fraktur Adverts 35.2±27.0 ≈97of 114 $5.31$0.027 run 96.94 T0082 · 24 Jan 2026prompt_optimized.txt
General Meeting Minutes 66.5±11.6 ≈85of 108 $4.79$0.043 run 5.43 T1248 · 16 Sep 2026prompt.txt
Library Cardsolder run 80.3 ≈93of 114 –– run 4.75 T0164 · 2 Sep 2025prompt.txt
Magazine Pages 9.8±8.3 ≈66of 115 $5.58$0.26 run 2.17 T0769 · 16 Sep 2026prompt.txt
Medieval Manuscripts 54.4±15.4 ≈72of 114 $5.75$0.069 run 8.97 T0276 · 17 Feb 2026prompt.txt
Personnel Cards 79.7±7.1 ≈94of 114 $6.36$0.39 run 7.91 T0609 · 16 Sep 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
0 Sep 20250.150.6archived price page

Every run

  1. T1297Duty Rosters16 Sep 202671.1$0.30
  2. T1248General Meeting Minutes16 Sep 202666.5$0.043
  3. T0769Magazine Pages16 Sep 20269.8$0.26
  4. T0609Personnel Cards16 Sep 202679.7$0.39
  5. T1297Duty Rosters24 Jul 202670.3$0.30
  6. T1248General Meeting Minutes3 Jul 202664.0$0.043
  7. T0769Magazine Pages23 Mar 20267.6$0.26
  8. T0276Medieval Manuscripts17 Feb 202654.4$0.069
  9. T0609Personnel Cards10 Feb 202674.8$0.39
  10. T0306Blacklist Cards26 Jan 202675.5$0.19
  11. T0447Book Advert XML Repair25 Jan 202613.6$0.039
  12. T0340Company Lists25 Jan 202650.8$0.091
  13. T0339Company Lists25 Jan 202661.3$0.091
  14. T0164Library Cards25 Jan 20261.7$1.00
  15. T0082Fraktur Adverts24 Jan 202635.2$0.027
  16. T0078Business Letters24 Jan 2026 · 32 signed letters54.0$0.35
  17. T0077Business Letters24 Jan 2026 · 25 unsigned letters48.0$0.20
  18. T0076Business Letters24 Jan 2026 · all 57 letters50.0$0.55
  19. T0043Business Letters24 Jan 2026 · 32 signed letters55.0$0.35
  20. T0042Business Letters24 Jan 2026 · 25 unsigned letters44.0$0.20
  21. T0027Bibliographic Data24 Jan 202643.0$0.034
  22. T0012Business Letters24 Jan 2026 · all 57 letters51.0$0.55
  23. T0447Book Advert XML Repair8 Dec 202512.7$0.039
  24. T0340Company Lists28 Oct 202536.7$0.065
  25. T0339Company Lists28 Oct 202551.9$0.066
  26. T0306Blacklist Cards24 Oct 202578.2$0.13
  27. T0276Medieval Manuscripts24 Oct 202554.2$0.049
  28. T0164Library Cards3 Oct 20251.1$0.020
  29. T0082Fraktur Adverts30 Sep 202522.5$0.022
  30. T0078Business Letters30 Sep 2025 · 32 signed letters59.0$0.24
  31. T0077Business Letters30 Sep 2025 · 25 unsigned letters44.0$0.14
  32. T0076Business Letters30 Sep 2025 · all 57 letters55.0$0.38
  33. T0043Business Letters30 Sep 2025 · 32 signed letters58.0$0.24
  34. T0042Business Letters30 Sep 2025 · 25 unsigned letters44.0$0.14
  35. T0027Bibliographic Data30 Sep 202569.0$0.026
  36. T0012Business Letters30 Sep 2025 · all 57 letters55.0$0.38
  37. T0164Library Cards2 Sep 202580.3–
  38. T0082Fraktur Adverts9 May 202520.3–
  39. T0082Fraktur Adverts7 May 20250.7–
  40. T0078Business Letters17 Apr 2025 · 32 signed letters60.0–
  41. T0077Business Letters17 Apr 2025 · 25 unsigned letters48.0–
  42. T0076Business Letters17 Apr 2025 · all 57 letters54.0–
  43. T0043Business Letters11 Apr 2025 · 32 signed letters59.0–
  44. T0042Business Letters11 Apr 2025 · 25 unsigned letters46.0–
  45. T0012Business Letters11 Apr 2025 · all 57 letters53.0–
  46. T0027Bibliographic Data8 Apr 202570.3–
  47. T0012Business Letters1 Apr 2025 · all 57 letters52.0–
  48. T0012Business Letters5 Mar 2025 · all 57 letters52.0–