University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

google/gemma-4-26b-a4b-it

Googlevia OpenRouter
average±3.4 (95%)
66.2
leaderboard rankof 114
≈77
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$0.38
seconds per inputmean response time
75.5
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    69.7

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    55.1

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    76.2

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    70.6

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 90.4±4.9 ≈74of 115 $1.01$0.005 run 124.16 T0996 · 17 Sep 2026prompt.txt
Blacklist Cards 93.5±3.8 ≈45of 114 $0.10$0.003 run 4.82 T1003 · 21 Apr 2026prompt.txt
Book Advert XML Repair 49.0±10.4 ≈16of 119 $0.29$0.014 run 12.57 T1006 · 21 Apr 2026prompt.txt
Business Letters 54.0±6.4 ≈88of 114 $0.100$0.006 run 7.75 T0997 · 17 Sep 2026prompt.txt
Company Lists 58.6±14.7 ≈97of 114 $0.44$0.007 run 43.93 T1004 · 17 Sep 2026prompt.txt
Duty Rosters 75.0±2.7 ≈64of 107 $0.87$0.018 run 97.26 T1330 · 22 Jul 2026prompt.txt
Fraktur Adverts 47.4±30.7 ≈67of 114 $0.51$0.003 run 15.55 T1000 · 17 Sep 2026prompt_optimized.txt
General Meeting Minutes 81.2±10.7 ≈25of 108 $0.41$0.004 run 552.51 T1255 · 18 Sep 2026prompt.txt
Library Cards 81.0±1.6 ≈90of 114 $0.13$0.034 run 10.21 T1001 · 17 Sep 2026prompt.txt
Magazine Pages 0.0±0.0 ≈79of 115 $0.057$0.003 run 3.45 T1008 · 21 Apr 2026prompt.txt
Medieval Manuscripts 74.0±11.7 ≈27of 114 $0.15$0.002 run 10.77 T1002 · 17 Sep 2026prompt.txt
Personnel Cards 90.3±2.7 ≈78of 114 $0.46$0.028 run 23.18 T1007 · 17 Sep 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
16 Sep 20260.090.3archived price page
22 Jul 20260.070.34archived price page
21 Apr 20260.080.35archived price page

Every run

  1. T1330Duty Rosters18 Sep 202672.3$0.018
  2. T1255General Meeting Minutes18 Sep 202681.2$0.004
  3. T1008Magazine Pages17 Sep 20260.0$0.003
  4. T1007Personnel Cards17 Sep 202690.3$0.028
  5. T1006Book Advert XML Repair17 Sep 202629.8$0.027
  6. T1005Company Lists17 Sep 202654.1$0.005
  7. T1004Company Lists17 Sep 202658.6$0.007
  8. T1003Blacklist Cards17 Sep 202691.7$0.004
  9. T1002Medieval Manuscripts17 Sep 202674.0$0.002
  10. T1001Library Cards17 Sep 202681.0$0.034
  11. T1000Fraktur Adverts17 Sep 202647.4$0.003
  12. T0999Business Letters17 Sep 2026 · 32 signed letters58.0$0.003
  13. T0998Business Letters17 Sep 2026 · 25 unsigned letters49.0$0.002
  14. T0997Business Letters17 Sep 2026 · all 57 letters54.0$0.006
  15. T0996Bibliographic Data17 Sep 202690.4$0.005
  16. T1330Duty Rosters22 Jul 202675.0$0.018
  17. T1255General Meeting Minutes3 Jul 202675.8$0.003
  18. T1008Magazine Pages21 Apr 20260.0$0.003
  19. T1007Personnel Cards21 Apr 202687.2$0.029
  20. T1006Book Advert XML Repair21 Apr 202649.0$0.014
  21. T1005Company Lists21 Apr 202633.3$0.007
  22. T1004Company Lists21 Apr 202624.1$0.008
  23. T1003Blacklist Cards21 Apr 202693.5$0.003
  24. T1002Medieval Manuscripts21 Apr 202670.2$0.002
  25. T1001Library Cards21 Apr 202679.8$0.036
  26. T1000Fraktur Adverts21 Apr 202630.4$0.048
  27. T0999Business Letters21 Apr 2026 · 32 signed letters52.0$0.003
  28. T0998Business Letters21 Apr 2026 · 25 unsigned letters44.0$0.002
  29. T0997Business Letters21 Apr 2026 · all 57 letters50.0$0.005
  30. T0996Bibliographic Data21 Apr 202650.9$0.005