University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

gpt-4.1-nano

OpenAI
average
41.9
leaderboard rankof 114
109
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$0.63
seconds per inputmean response time
14.3
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    39.5

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    27.1

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    53.3

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    40.2

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Dataolder run 48.2 109of 115 $0.89$0.004 run 21.17 T0141 · 1 Oct 2025prompt.txt
Blacklist Cards 82.7±4.8 ≈95of 114 $0.45$0.015 run 3.37 T0308 · 26 Jan 2026prompt.txt
Book Advert XML Repair 7.3±4.8 ≈105of 119 $0.52$0.026 run 13.81 T0450 · 25 Jan 2026prompt.txt
Business Lettersolder run 51.0 ≈98of 114 –– run 2.21 T0073 · 17 Apr 2025prompt.txt
Company Listsolder run 56.2 104of 114 $0.45$0.007 run 7.97 T0345 · 28 Oct 2025prompt.txt
Duty Rosters 7.5±0.8 ≈103of 107 $0.60$0.013 run 36.57 T1295 · 24 Jul 2026prompt.txt
Fraktur Adverts 0.6±1.1 ≈104of 114 $0.68$0.003 run 8.22 T0085 · 24 Jan 2026prompt_optimized.txt
General Meeting Minutes 55.6±16.5 ≈103of 108 $0.99$0.009 run 5.68 T1246 · 16 Sep 2026prompt.txt
Library Cardsolder run 71.9 106of 114 –– run 2.18 T0162 · 2 Sep 2025prompt.txt
Magazine Pages 2.2±4.3 ≈79of 115 $0.39$0.018 run 2.83 T0774 · 23 Mar 2026prompt.txt
Medieval Manuscripts 48.4±16.3 ≈95of 114 $0.50$0.006 run 61.23 T0278 · 17 Feb 2026prompt.txt
Personnel Cards 71.7±5.2 ≈104of 114 $0.81$0.049 run 6.69 T0607 · 9 Feb 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
0 Sep 20250.10.4archived price page

Every run

  1. T1295Duty Rosters16 Sep 20266.1$0.016
  2. T1246General Meeting Minutes16 Sep 202655.6$0.009
  3. T0774Magazine Pages16 Sep 20260.0$0.035
  4. T0607Personnel Cards16 Sep 202671.2$0.070
  5. T1295Duty Rosters24 Jul 20267.5$0.013
  6. T1246General Meeting Minutes3 Jul 202647.5$0.007
  7. T0774Magazine Pages23 Mar 20262.2$0.018
  8. T0278Medieval Manuscripts17 Feb 202648.4$0.006
  9. T0607Personnel Cards9 Feb 202671.7$0.049
  10. T0308Blacklist Cards26 Jan 202682.7$0.015
  11. T0450Book Advert XML Repair25 Jan 20267.3$0.026
  12. T0346Company Lists25 Jan 202652.3$0.009
  13. T0345Company Lists25 Jan 202654.4$0.009
  14. T0162Library Cards25 Jan 202664.6$0.075
  15. T0141Bibliographic Data24 Jan 202639.2$0.004
  16. T0085Fraktur Adverts24 Jan 20260.6$0.003
  17. T0075Business Letters24 Jan 2026 · 32 signed letters54.0$0.025
  18. T0074Business Letters24 Jan 2026 · 25 unsigned letters39.0$0.014
  19. T0073Business Letters24 Jan 2026 · all 57 letters48.0$0.040
  20. T0450Book Advert XML Repair8 Dec 20256.7$0.014
  21. T0346Company Lists28 Oct 202546.6$0.006
  22. T0345Company Lists28 Oct 202556.2$0.007
  23. T0308Blacklist Cards24 Oct 202578.9$0.009
  24. T0278Medieval Manuscripts24 Oct 202535.1$0.003
  25. T0162Library Cards2 Oct 202566.7–
  26. T0141Bibliographic Data1 Oct 202548.2$0.004
  27. T0085Fraktur Adverts30 Sep 20250.0$0.001
  28. T0075Business Letters30 Sep 2025 · 32 signed letters54.0$0.014
  29. T0074Business Letters30 Sep 2025 · 25 unsigned letters37.0$0.008
  30. T0073Business Letters30 Sep 2025 · all 57 letters51.0$0.022
  31. T0162Library Cards24 Sep 202566.5–
  32. T0162Library Cards2 Sep 202571.9–
  33. T0141Bibliographic Data27 Aug 202547.4–
  34. T0085Fraktur Adverts9 May 20250.3–
  35. T0085Fraktur Adverts7 May 20250.0–
  36. T0075Business Letters17 Apr 2025 · 32 signed letters54.0–
  37. T0074Business Letters17 Apr 2025 · 25 unsigned letters38.0–
  38. T0073Business Letters17 Apr 2025 · all 57 letters51.0–