University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

gemini-2.5-flash

Google
average
71.3
leaderboard rankof 114
≈61
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$9.23
seconds per inputmean response time
17.8
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    60.1

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    56.5

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    81.5

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    86.1

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Dataolder run 95.9 ≈50of 115 $15$0.075 run 39.16 T0195 · 30 Sep 2025prompt.txt
Blacklist Cards 93.3±2.8 ≈51of 114 $1.81$0.060 run 3.62 T0315 · 24 Jan 2026prompt.txt
Book Advert XML Repair 24.5±7.3 ≈64of 119 $15$0.76 run 30.73 T0459 · 8 Dec 2025prompt.txt
Business Letters 56.0±7.1 ≈75of 114 $2.36$0.13 run 5.58 T0196 · 24 Nov 2025prompt.txt
Company Lists 82.9±9.3 ≈29of 114 $6.31$0.095 run 10.73 T0359 · 24 Nov 2025prompt.txt
Duty Rosters 71.6±4.4 ≈64of 107 $22$0.46 run 34.91 T1281 · 16 Sep 2026prompt.txt
Fraktur Adverts 93.6±6.7 ≈32of 114 $18$0.088 run 29.75 T0199 · 24 Jan 2026prompt_optimized.txt
General Meeting Minutes 84.5±11.3 ≈25of 108 $8.78$0.079 run 15.41 T1228 · 16 Sep 2026prompt.txt
Library Cards 86.6±1.5 ≈41of 114 $3.32$0.87 run 6.39 T0200 · 24 Jan 2026prompt.txt
Magazine Pages 2.2±4.3 ≈79of 115 $5.85$0.27 run 11.15 T0784 · 16 Sep 2026prompt.txt
Medieval Manuscriptsolder run 68.8 ≈68of 114 $5.50$0.066 run 15.45 T0271 · 24 Oct 2025prompt.txt
Personnel Cards 95.8±2.3 ≈30of 114 $6.99$0.43 run 11.19 T0588 · 9 Feb 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
0 Sep 20250.32.5archived price page

Every run

  1. T1281Duty Rosters16 Sep 202671.6$0.46
  2. T1228General Meeting Minutes16 Sep 202684.5$0.079
  3. T0784Magazine Pages16 Sep 20262.2$0.27
  4. T0588Personnel Cards16 Sep 202695.8$0.41
  5. T1281Duty Rosters24 Jul 202671.1$0.51
  6. T1228General Meeting Minutes3 Jul 202683.8$0.024
  7. T0784Magazine Pages23 Mar 20261.6$0.27
  8. T0588Personnel Cards9 Feb 202695.8$0.43
  9. T0459Book Advert XML Repair24 Jan 202617.1$2.43
  10. T0360Company Lists24 Jan 202676.6$0.088
  11. T0359Company Lists24 Jan 202681.8$0.13
  12. T0315Blacklist Cards24 Jan 202693.3$0.060
  13. T0271Medieval Manuscripts24 Jan 202662.4$0.057
  14. T0200Library Cards24 Jan 202686.6$0.87
  15. T0199Fraktur Adverts24 Jan 202693.6$0.088
  16. T0198Business Letters24 Jan 2026 · 32 signed letters57.0$0.064
  17. T0197Business Letters24 Jan 2026 · 25 unsigned letters50.0$0.059
  18. T0196Business Letters24 Jan 2026 · all 57 letters55.0$0.14
  19. T0195Bibliographic Data24 Jan 202695.6$0.080
  20. T0459Book Advert XML Repair8 Dec 202524.5$0.76
  21. T0360Company Lists24 Nov 202567.7$0.082
  22. T0359Company Lists24 Nov 202582.9$0.095
  23. T0315Blacklist Cards24 Nov 202591.6$0.062
  24. T0271Medieval Manuscripts24 Nov 202562.9$0.090
  25. T0200Library Cards24 Nov 202586.3$0.98
  26. T0199Fraktur Adverts24 Nov 202587.7$0.11
  27. T0198Business Letters24 Nov 2025 · 32 signed letters54.0$0.074
  28. T0197Business Letters24 Nov 2025 · 25 unsigned letters45.0$0.055
  29. T0196Business Letters24 Nov 2025 · all 57 letters56.0$0.13
  30. T0195Bibliographic Data24 Nov 202595.6$0.078
  31. T0360Company Lists28 Oct 202571.1$0.094
  32. T0359Company Lists28 Oct 202579.8$0.11
  33. T0315Blacklist Cards24 Oct 202586.8$0.057
  34. T0271Medieval Manuscripts24 Oct 202568.8$0.066
  35. T0200Library Cards30 Sep 202585.2$1.11
  36. T0199Fraktur Adverts30 Sep 202591.4$0.091
  37. T0198Business Letters30 Sep 2025 · 32 signed letters58.0$0.066
  38. T0197Business Letters30 Sep 2025 · 25 unsigned letters56.0$0.067
  39. T0196Business Letters30 Sep 2025 · all 57 letters55.0$0.14
  40. T0195Bibliographic Data30 Sep 202595.9$0.075