University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

gemini-2.5-pro

Google
average
73.2
leaderboard rankof 114
≈50
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$42
seconds per inputmean response time
30.2
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    53.7

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    63.4

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    83.3

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    86.7

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 96.5±1.5 ≈40of 115 $53$0.26 run 35.5 T0128 · 24 Jan 2026prompt.txt
Blacklist Cards 97.6±1.9 ≈1of 114 $13$0.42 run 10.64 T0316 · 24 Jan 2026prompt.txt
Book Advert XML Repair 12.4±5.9 ≈89of 119 $80$3.99 run 58.36 T0458 · 8 Dec 2025prompt.txt
Business Lettersolder run 57.0 ≈65of 114 $9.44$0.54 run 8.65 T0124 · 30 Sep 2025prompt.txt
Company Listsolder run 82.4 ≈55of 114 $41$0.61 run 31.21 T0361 · 28 Oct 2025prompt.txt
Duty Rosters 73.0±3.4 ≈64of 107 $79$1.66 run 55.11 T1283 · 16 Sep 2026prompt.txt
Fraktur Advertsolder run 96.1 31of 114 $64$0.32 run 48.8 T0132 · 1 Oct 2025prompt_optimized.txt
General Meeting Minutes 88.3±6.4 ≈25of 108 $48$0.43 run 34.86 T1230 · 16 Sep 2026prompt.txt
Library Cardsolder run 88.2 ≈33of 114 –– run 19.13 T0155 · 2 Sep 2025prompt.txt
Magazine Pages 22.2±11.8 ≈56of 115 $14$0.63 run 12.46 T0779 · 23 Mar 2026prompt.txt
Medieval Manuscripts 69.2±14.5 ≈27of 114 $27$0.32 run 22.75 T0272 · 24 Jan 2026prompt.txt
Personnel Cards 94.9±2.2 ≈58of 114 $33$2.03 run 24.64 T0592 · 9 Feb 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
0 Sep 20251.2510.0archived price page

Every run

  1. T1283Duty Rosters16 Sep 202673.0$1.66
  2. T1230General Meeting Minutes16 Sep 202688.3$0.43
  3. T0779Magazine Pages16 Sep 202621.7$0.53
  4. T0592Personnel Cards16 Sep 202694.3$1.99
  5. T1283Duty Rosters24 Jul 202672.0$1.64
  6. T1230General Meeting Minutes3 Jul 202684.2$0.096
  7. T0779Magazine Pages23 Mar 202622.2$0.63
  8. T0592Personnel Cards9 Feb 202694.9$2.03
  9. T0458Book Advert XML Repair24 Jan 202611.9$3.24
  10. T0362Company Lists24 Jan 202672.7$0.50
  11. T0361Company Lists24 Jan 202681.7$0.59
  12. T0316Blacklist Cards24 Jan 202697.6$0.42
  13. T0272Medieval Manuscripts24 Jan 202669.2$0.32
  14. T0155Library Cards24 Jan 202686.5$4.13
  15. T0132Fraktur Adverts24 Jan 202695.2$0.29
  16. T0128Bibliographic Data24 Jan 202696.5$0.26
  17. T0126Business Letters24 Jan 2026 · 32 signed letters60.0$0.30
  18. T0125Business Letters24 Jan 2026 · 25 unsigned letters55.0$0.23
  19. T0124Business Letters24 Jan 2026 · all 57 letters57.0$0.54
  20. T0458Book Advert XML Repair8 Dec 202512.4$3.99
  21. T0362Company Lists28 Oct 202576.1$0.47
  22. T0361Company Lists28 Oct 202582.4$0.61
  23. T0316Blacklist Cards24 Oct 202592.3$1.03
  24. T0272Medieval Manuscripts24 Oct 202568.9$0.32
  25. T0155Library Cards1 Oct 202586.6$3.66
  26. T0132Fraktur Adverts1 Oct 202596.1$0.32
  27. T0132Fraktur Adverts30 Sep 202594.0$0.26
  28. T0128Bibliographic Data30 Sep 202594.7$0.33
  29. T0126Business Letters30 Sep 2025 · 32 signed letters61.0$0.31
  30. T0125Business Letters30 Sep 2025 · 25 unsigned letters52.0$0.24
  31. T0124Business Letters30 Sep 2025 · all 57 letters57.0$0.54
  32. T0132Fraktur Adverts24 Sep 202595.9–
  33. T0125Business Letters24 Sep 2025 · 25 unsigned letters49.0–
  34. T0155Library Cards2 Sep 202588.2–
  35. T0132Fraktur Adverts14 Aug 202595.5–
  36. T0128Bibliographic Data14 Aug 202540.7–
  37. T0126Business Letters14 Aug 2025 · 32 signed letters59.0–
  38. T0125Business Letters14 Aug 2025 · 25 unsigned letters49.0–
  39. T0124Business Letters14 Aug 2025 · all 57 letters55.0–