University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

google/gemma-4-31b-it

Googlevia OpenRouter
average±3.5 (95%)
69.9
leaderboard rankof 114
≈63
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$0.39
seconds per inputmean response time
152.5
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    68.4

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    57.5

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    80.6

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    77.5

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 88.2±6.2 ≈74of 115 $1.10$0.005 run 804.32 T1009 · 21 Apr 2026prompt.txt
Blacklist Cards 91.7±3.0 ≈51of 114 $0.14$0.004 run 59.65 T1016 · 21 Apr 2026prompt.txt
Book Advert XML Repair 41.5±9.8 ≈16of 119 $0.29$0.014 run 22.42 T1019 · 18 Sep 2026prompt.txt
Business Letters 57.0±7.1 ≈65of 114 $0.14$0.008 run 10.9 T1010 · 21 Apr 2026prompt.txt
Company Lists 79.9±13.9 ≈58of 114 $0.42$0.006 run 40.74 T1017 · 18 Sep 2026prompt.txt
Duty Rosters 77.2±2.7 ≈46of 107 $0.66$0.014 run 45.43 T1331 · 18 Sep 2026prompt.txt
Fraktur Adverts 60.7±33.8 ≈67of 114 $0.61$0.003 run 212.83 T1013 · 17 Sep 2026prompt_optimized.txt
General Meeting Minutes 85.9±8.7 ≈25of 108 $0.38$0.003 run 107.93 T1256 · 3 Jul 2026prompt.txt
Library Cards 84.3±1.9 ≈51of 114 $0.26$0.068 run 475.66 T1014 · 17 Sep 2026prompt.txt
Magazine Pages 0.0±0.0 ≈79of 115 $0.061$0.003 run 6.84 T1021 · 21 Apr 2026prompt.txt
Medieval Manuscripts 76.7±12.1 ≈27of 114 $0.20$0.002 run 24.82 T1015 · 21 Apr 2026prompt.txt
Personnel Cards 95.2±1.5 ≈58of 114 $0.48$0.029 run 18.66 T1020 · 18 Sep 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
16 Sep 20260.090.34archived price page
22 Jul 20260.120.37archived price page
21 Apr 20260.130.38archived price page

Every run

  1. T1331Duty Rosters18 Sep 202677.2$0.014
  2. T1256General Meeting Minutes18 Sep 202674.8$0.003
  3. T1021Magazine Pages18 Sep 20260.0$0.002
  4. T1020Personnel Cards18 Sep 202695.2$0.029
  5. T1019Book Advert XML Repair18 Sep 202641.5$0.014
  6. T1018Company Lists18 Sep 202648.6$0.005
  7. T1017Company Lists18 Sep 202679.9$0.006
  8. T1016Blacklist Cards18 Sep 202690.3$0.003
  9. T1015Medieval Manuscripts18 Sep 202674.9$0.002
  10. T1014Library Cards17 Sep 202684.3$0.068
  11. T1013Fraktur Adverts17 Sep 202660.7$0.003
  12. T1012Business Letters17 Sep 2026 · 32 signed letters60.0$0.003
  13. T1011Business Letters17 Sep 2026 · 25 unsigned letters46.0$0.002
  14. T1010Business Letters17 Sep 2026 · all 57 letters55.0$0.006
  15. T1009Bibliographic Data17 Sep 202671.0$0.004
  16. T1331Duty Rosters22 Jul 202674.6$0.016
  17. T1256General Meeting Minutes3 Jul 202685.9$0.003
  18. T1021Magazine Pages21 Apr 20260.0$0.003
  19. T1020Personnel Cards21 Apr 202694.8$0.033
  20. T1019Book Advert XML Repair21 Apr 202639.1$0.017
  21. T1018Company Lists21 Apr 202643.9$0.005
  22. T1017Company Lists21 Apr 202675.0$0.007
  23. T1016Blacklist Cards21 Apr 202691.7$0.004
  24. T1015Medieval Manuscripts21 Apr 202676.7$0.002
  25. T1014Library Cards21 Apr 202681.4$0.056
  26. T1013Fraktur Adverts21 Apr 202651.1$0.003
  27. T1012Business Letters21 Apr 2026 · 32 signed letters61.0$0.005
  28. T1011Business Letters21 Apr 2026 · 25 unsigned letters53.0$0.003
  29. T1010Business Letters21 Apr 2026 · all 57 letters57.0$0.008
  30. T1009Bibliographic Data21 Apr 202688.2$0.005