University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

gpt-5.4-2026-03-05

OpenAI
average±1.8 (95%)
80.2
leaderboard rankof 114
≈25
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$18
seconds per inputmean response time
8.5
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    63.8

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    85.5

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    83.8

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    89.8

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 97.9±1.1 ≈8of 115 $39$0.19 run 13.63 T0652 · 16 Sep 2026prompt.txt
Blacklist Cards 87.5±3.3 ≈79of 114 $9.38$0.31 run 3.68 T0659 · 16 Mar 2026prompt.txt
Book Advert XML Repair 30.8±7.6 ≈41of 119 $9.62$0.48 run 5.99 T0662 · 16 Sep 2026prompt.txt
Business Letters 59.0±6.4 ≈24of 114 $14$0.80 run 4.02 T0653 · 16 Mar 2026prompt.txt
Company Lists 88.1±7.1 ≈26of 114 $17$0.26 run 9.59 T0660 · 16 Mar 2026prompt.txt
Duty Rosters 84.3±4.4 ≈30of 107 $24$0.51 run 11.12 T1310 · 16 Sep 2026prompt.txt
Fraktur Adverts 93.6±4.4 ≈32of 114 $30$0.15 run 28.82 T0656 · 16 Mar 2026prompt_optimized.txt
General Meeting Minutes 86.3±9.5 ≈25of 108 $22$0.20 run 8.11 T0664 · 16 Mar 2026prompt.txt
Library Cards 83.4±1.5 ≈81of 114 $6.51$1.71 run 3.6 T0657 · 16 Sep 2026prompt.txt
Magazine Pages 75.4±10.5 ≈34of 115 $8.66$0.40 run 2.21 T0714 · 16 Sep 2026prompt.txt
Medieval Manuscripts 78.8±8.0 ≈27of 114 $12$0.14 run 6.25 T0658 · 16 Sep 2026prompt.txt
Personnel Cards 96.9±1.1 ≈30of 114 $22$1.33 run 5.43 T0663 · 16 Sep 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
16 Mar 20262.515.0archived price page

Every run

  1. T1310Duty Rosters16 Sep 202684.3$0.51
  2. T0714Magazine Pages16 Sep 202675.4$0.40
  3. T0668General Meeting Minutes16 Sep 2026 · legacy configuration78.0$0.14
  4. T0667General Meeting Minutes16 Sep 2026 · legacy configuration83.6$0.16
  5. T0666General Meeting Minutes16 Sep 2026 · legacy configuration81.1$0.15
  6. T0665General Meeting Minutes16 Sep 2026 · legacy configuration85.0$0.16
  7. T0664General Meeting Minutes16 Sep 202681.4$0.15
  8. T0663Personnel Cards16 Sep 202696.9$1.33
  9. T0662Book Advert XML Repair16 Sep 202630.8$0.48
  10. T0661Company Lists16 Sep 202675.5$0.25
  11. T0660Company Lists16 Sep 202684.3$0.26
  12. T0659Blacklist Cards16 Sep 202687.2$0.32
  13. T0658Medieval Manuscripts16 Sep 202678.8$0.14
  14. T0657Library Cards16 Sep 202683.4$1.71
  15. T0656Fraktur Adverts16 Sep 202693.6$0.14
  16. T0655Business Letters16 Sep 2026 · 32 signed letters63.0$0.54
  17. T0654Business Letters16 Sep 2026 · 25 unsigned letters53.0$0.31
  18. T0653Business Letters16 Sep 2026 · all 57 letters57.0$0.85
  19. T0652Bibliographic Data16 Sep 202697.9$0.19
  20. T1310Duty Rosters24 Jul 202684.2$0.51
  21. T0714Magazine Pages21 Mar 202670.9$0.38
  22. T0668General Meeting Minutes16 Mar 2026 · legacy configuration78.4$0.20
  23. T0667General Meeting Minutes16 Mar 2026 · legacy configuration82.6$0.23
  24. T0666General Meeting Minutes16 Mar 2026 · legacy configuration82.7$0.21
  25. T0665General Meeting Minutes16 Mar 2026 · legacy configuration88.8$0.24
  26. T0664General Meeting Minutes16 Mar 202686.3$0.20
  27. T0663Personnel Cards16 Mar 202696.8$1.30
  28. T0662Book Advert XML Repair16 Mar 202626.5$0.48
  29. T0661Company Lists16 Mar 202676.0$0.24
  30. T0660Company Lists16 Mar 202688.1$0.26
  31. T0659Blacklist Cards16 Mar 202687.5$0.31
  32. T0658Medieval Manuscripts16 Mar 202676.4$0.14
  33. T0657Library Cards16 Mar 202682.6$1.95
  34. T0656Fraktur Adverts16 Mar 202693.6$0.15
  35. T0655Business Letters16 Mar 2026 · 32 signed letters63.0$0.50
  36. T0654Business Letters16 Mar 2026 · 25 unsigned letters54.0$0.30
  37. T0653Business Letters16 Mar 2026 · all 57 letters59.0$0.80
  38. T0652Bibliographic Data16 Mar 202697.7$0.19