University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

gpt-5-mini

OpenAI
average
73.0
leaderboard rankof 114
≈50
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$5.77
seconds per inputmean response time
43.8
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    52.3

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    79.4

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    78.3

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    82.8

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Dataolder run 97.3 ≈29of 115 –– run 89.03 T0130 · 24 Sep 2025prompt.txt
Blacklist Cards 87.2±2.8 ≈79of 114 $2.75$0.091 run 20.96 T0310 · 26 Jan 2026prompt.txt
Book Advert XML Repair 11.0±5.5 ≈89of 119 $7.24$0.36 run 54.81 T0452 · 8 Dec 2025prompt.txt
Business Lettersolder run 55.0 ≈84of 114 $2.61$0.15 run 18.77 T0111 · 30 Sep 2025prompt.txt
Company Listsother prompt 71.9±12.4 ≈84of 114 $4.61$0.069 run 31.99 T0350 · 25 Jan 2026prompt_min.txt
Duty Rosters 76.4±3.9 ≈46of 107 $10$0.22 run 72.89 T1299 · 24 Jul 2026prompt.txt
Fraktur Adverts 81.1±14.2 ≈32of 114 $10$0.051 run 74.61 T0121 · 25 Jan 2026prompt_optimized.txt
General Meeting Minutes 76.0±15.8 ≈25of 108 $6.58$0.059 run 48.65 T1250 · 3 Jul 2026prompt.txt
Library Cardsolder run 84.1 ≈73of 114 –– run 18.05 T0166 · 2 Sep 2025prompt.txt
Magazine Pages 68.1±11.8 ≈34of 115 $2.27$0.10 run 16.3 T0715 · 21 Mar 2026prompt.txt
Medieval Manuscripts 73.8±11.2 ≈27of 114 $4.67$0.056 run 38.29 T0280 · 26 Jan 2026prompt.txt
Personnel Cards 93.6±2.6 ≈58of 114 $6.40$0.39 run 40.98 T0611 · 16 Sep 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
0 Sep 20250.252.0archived price page

Every run

  1. T1299Duty Rosters16 Sep 202671.0$0.21
  2. T1250General Meeting Minutes16 Sep 202675.5$0.063
  3. T0715Magazine Pages16 Sep 202658.7$0.12
  4. T0611Personnel Cards16 Sep 202693.6$0.39
  5. T1299Duty Rosters24 Jul 202676.4$0.22
  6. T1250General Meeting Minutes3 Jul 202676.0$0.059
  7. T0715Magazine Pages21 Mar 202668.1$0.10
  8. T0166Library Cards17 Feb 202651.3$1.01
  9. T0113Business Letters17 Feb 2026 · 32 signed letters61.0$0.097
  10. T0611Personnel Cards10 Feb 202693.2$0.39
  11. T0113Business Letters10 Feb 2026 · 32 signed letters61.0$0.095
  12. T0310Blacklist Cards26 Jan 202687.2$0.091
  13. T0280Medieval Manuscripts26 Jan 202673.8$0.056
  14. T0112Business Letters26 Jan 2026 · 25 unsigned letters51.0$0.067
  15. T0111Business Letters26 Jan 2026 · all 57 letters54.0$0.16
  16. T0452Book Advert XML Repair25 Jan 202610.6$0.39
  17. T0350Company Lists25 Jan 202671.9$0.069
  18. T0349Company Lists25 Jan 202660.1$0.091
  19. T0130Bibliographic Data25 Jan 202697.3$0.050
  20. T0121Fraktur Adverts25 Jan 202681.1$0.051
  21. T0452Book Advert XML Repair8 Dec 202511.0$0.36
  22. T0350Company Lists28 Oct 202568.7$0.074
  23. T0349Company Lists28 Oct 202571.6$0.085
  24. T0310Blacklist Cards24 Oct 202586.3$0.084
  25. T0280Medieval Manuscripts24 Oct 202569.4$0.062
  26. T0166Library Cards1 Oct 202579.2$1.32
  27. T0130Bibliographic Data1 Oct 202596.1$0.058
  28. T0130Bibliographic Data30 Sep 202597.2$0.058
  29. T0121Fraktur Adverts30 Sep 202545.1$0.035
  30. T0113Business Letters30 Sep 2025 · 32 signed letters60.0$0.087
  31. T0112Business Letters30 Sep 2025 · 25 unsigned letters54.0$0.062
  32. T0111Business Letters30 Sep 2025 · all 57 letters55.0$0.15
  33. T0130Bibliographic Data24 Sep 202597.3–
  34. T0166Library Cards2 Sep 202584.1–
  35. T0130Bibliographic Data14 Aug 202593.2–
  36. T0121Fraktur Adverts13 Aug 202563.6–
  37. T0113Business Letters13 Aug 2025 · 32 signed letters60.0–
  38. T0112Business Letters13 Aug 2025 · 25 unsigned letters50.0–
  39. T0111Business Letters13 Aug 2025 · all 57 letters54.0–