University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

gemini-2.5-flash-lite

Google
average
60.3
leaderboard rankof 114
91
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$1.43
seconds per inputmean response time
11.9
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    49.4

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    53.8

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    71.1

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    71.8

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 81.9±4.6 ≈91of 115 $0.80$0.004 run 5.53 T0203 · 17 Oct 2026prompt.txt
Blacklist Cards 88.3±3.4 ≈79of 114 $0.12$0.004 run 1.37 T0317 · 24 Jan 2026prompt.txt
Book Advert XML Repair 9.7±6.4 ≈89of 119 $8.09$0.40 run 84.73 T0460 · 8 Dec 2025prompt.txt
Business Lettersolder run 47.0 ≈104of 114 $0.12$0.007 run 1.08 T0204 · 1 Oct 2025prompt.txt
Company Listsother prompt 60.1±14.9 ≈97of 114 $0.50$0.007 run 4.15 T0364 · 24 Jan 2026prompt_min.txt
Duty Rosters 72.3±5.0 ≈64of 107 $0.99$0.021 run 5.68 T1282 · 16 Sep 2026prompt.txt
Fraktur Adverts 63.8±33.3 ≈67of 114 $0.96$0.005 run 9.89 T0207 · 17 Oct 2026prompt_optimized.txt
General Meeting Minutes 79.4±8.8 ≈25of 108 $0.45$0.004 run 4.05 T1229 · 16 Sep 2026prompt.txt
Library Cardsolder run 69.0 107of 114 $0.40$0.10 run 2.24 T0208 · 1 Oct 2025prompt.txt
Magazine Pages 0.0±0.0 ≈79of 115 $3.49$0.16 run 14.9 T0785 · 23 Mar 2026prompt.txt
Medieval Manuscripts 62.6±18.4 ≈72of 114 $0.71$0.009 run 5.31 T0285 · 17 Oct 2026prompt.txt
Personnel Cards 89.0±3.0 ≈78of 114 $0.56$0.034 run 3.79 T0589 · 16 Sep 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
0 Sep 20250.10.4archived price page

Every run

  1. T1282Duty Rosters17 Oct 202672.3$0.021
  2. T1229General Meeting Minutes17 Oct 202679.4$0.004
  3. T0785Magazine Pages17 Oct 20260.0$0.049
  4. T0589Personnel Cards17 Oct 202689.0$0.034
  5. T0460Book Advert XML Repair17 Oct 20267.3$0.13
  6. T0364Company Lists17 Oct 202657.3$0.013
  7. T0363Company Lists17 Oct 202659.2$0.008
  8. T0317Blacklist Cards17 Oct 202687.6$0.004
  9. T0285Medieval Manuscripts17 Oct 202662.6$0.009
  10. T0208Library Cards17 Oct 202668.1$0.056
  11. T0207Fraktur Adverts17 Oct 202663.8$0.005
  12. T0206Business Letters17 Oct 2026 · 32 signed letters50.0$0.011
  13. T0205Business Letters17 Oct 2026 · 25 unsigned letters41.0$0.003
  14. T0204Business Letters17 Oct 2026 · all 57 letters47.0$0.013
  15. T0203Bibliographic Data17 Oct 202681.9$0.004
  16. T1282Duty Rosters16 Sep 202672.3$0.021
  17. T1229General Meeting Minutes16 Sep 202679.4$0.004
  18. T0785Magazine Pages16 Sep 20260.0$0.095
  19. T0589Personnel Cards16 Sep 202689.0$0.034
  20. T1282Duty Rosters24 Jul 202667.0$0.022
  21. T1229General Meeting Minutes3 Jul 202677.3$0.004
  22. T0285Medieval Manuscripts31 Mar 202661.7$0.002
  23. T0785Magazine Pages23 Mar 20260.0$0.16
  24. T0589Personnel Cards9 Feb 202687.8$0.034
  25. T0460Book Advert XML Repair24 Jan 20267.3$0.46
  26. T0364Company Lists24 Jan 202660.1$0.007
  27. T0363Company Lists24 Jan 202653.1$0.008
  28. T0317Blacklist Cards24 Jan 202688.3$0.004
  29. T0208Library Cards24 Jan 202668.5$0.089
  30. T0207Fraktur Adverts24 Jan 202614.7$0.055
  31. T0206Business Letters24 Jan 2026 · 32 signed letters51.0$0.004
  32. T0205Business Letters24 Jan 2026 · 25 unsigned letters41.0$0.003
  33. T0204Business Letters24 Jan 2026 · all 57 letters46.0$0.007
  34. T0203Bibliographic Data24 Jan 202680.7$0.004
  35. T0460Book Advert XML Repair8 Dec 20259.7$0.40
  36. T0364Company Lists28 Oct 202547.5$0.007
  37. T0363Company Lists28 Oct 202545.6$0.034
  38. T0317Blacklist Cards24 Oct 202586.1$0.004
  39. T0285Medieval Manuscripts24 Oct 202559.8$0.002
  40. T0208Library Cards1 Oct 202569.0$0.10
  41. T0207Fraktur Adverts1 Oct 202558.6$0.005
  42. T0206Business Letters1 Oct 2025 · 32 signed letters50.0$0.004
  43. T0205Business Letters1 Oct 2025 · 25 unsigned letters45.0$0.003
  44. T0204Business Letters1 Oct 2025 · all 57 letters47.0$0.007
  45. T0203Bibliographic Data1 Oct 202563.0$0.004