University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

ministral-8b-2512

Mistral
average±5.3 (95%)
49.8
leaderboard rankof 114
≈103
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$0.59
seconds per inputmean response time
21.5
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    28.3

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    47.9

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    58.5

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    54.1

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 71.5±35.5 ≈91of 115 $0.73$0.004 run 20.73 T0554 · 4 Jun 2026prompt.txt
Blacklist Cards 22.6±6.1 ≈112of 114 $0.48$0.016 run 5.61 T0561 · 4 Jun 2026prompt.txt
Book Advert XML Repair 3.0±2.6 ≈105of 119 $0.26$0.013 run 18.51 T0564 · 4 Jun 2026prompt.txt
Business Letters 44.0±6.1 ≈107of 114 $0.67$0.038 run 3.35 T0555 · 4 Jun 2026prompt.txt
Company Lists 41.1±21.9 ≈105of 114 $0.55$0.008 run 9.58 T0562 · 4 Jun 2026prompt.txt
Duty Rosters 66.5±4.0 ≈78of 107 $0.77$0.016 run 20.43 T1288 · 16 Sep 2026prompt.txt
Fraktur Adverts 53.5±39.9 ≈67of 114 $0.98$0.005 run 140.59 T0558 · 4 Jun 2026prompt_optimized.txt
General Meeting Minutes 78.4±12.2 ≈25of 108 $0.57$0.005 run 12.12 T1238 · 3 Jul 2026prompt.txt
Library Cards 85.2±1.5 ≈51of 114 $0.32$0.085 run 2.09 T0559 · 4 Jun 2026prompt.txt
Magazine Pages 23.5±11.5 ≈56of 115 $0.40$0.018 run 3.52 T0809 · 4 Jun 2026prompt.txt
Medieval Manuscripts 55.2±17.0 ≈72of 114 $0.49$0.005 run 5.0 T0560 · 4 Jun 2026prompt.txt
Personnel Cards 53.5±4.7 ≈106of 114 $0.84$0.051 run 16.89 T0598 · 4 Jun 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
23 Jan 20260.150.15archived price page

Every run

  1. T1288Duty Rosters16 Sep 202666.5$0.016
  2. T1238General Meeting Minutes16 Sep 202669.0$0.005
  3. T1288Duty Rosters24 Jul 202665.7$0.016
  4. T1238General Meeting Minutes3 Jul 202678.4$0.005
  5. T0809Magazine Pages4 Jun 202623.5$0.018
  6. T0598Personnel Cards4 Jun 202653.5$0.051
  7. T0564Book Advert XML Repair4 Jun 20263.0$0.013
  8. T0563Company Lists4 Jun 202635.4$0.008
  9. T0562Company Lists4 Jun 202641.1$0.008
  10. T0561Blacklist Cards4 Jun 202622.6$0.016
  11. T0560Medieval Manuscripts4 Jun 202655.2$0.005
  12. T0559Library Cards4 Jun 202685.2$0.085
  13. T0558Fraktur Adverts4 Jun 202653.5$0.005
  14. T0557Business Letters4 Jun 2026 · 32 signed letters49.0$0.024
  15. T0556Business Letters4 Jun 2026 · 25 unsigned letters37.0$0.014
  16. T0555Business Letters4 Jun 2026 · all 57 letters44.0$0.038
  17. T0554Bibliographic Data4 Jun 202671.5$0.004
  18. T0557Business Letters31 Mar 2026 · 32 signed letters0.0<$0.001
  19. T0556Business Letters31 Mar 2026 · 25 unsigned letters0.0<$0.001
  20. T0809Magazine Pages23 Mar 20260.3$0.005
  21. T0598Personnel Cards9 Feb 202612.6$0.050
  22. T0560Medieval Manuscripts26 Jan 2026––
  23. T0555Business Letters26 Jan 2026 · all 57 letters––
  24. T0564Book Advert XML Repair25 Jan 20262.2$0.013
  25. T0563Company Lists25 Jan 20260.0$0.002
  26. T0562Company Lists25 Jan 20260.0$0.007
  27. T0561Blacklist Cards25 Jan 20262.5$0.004
  28. T0559Library Cards25 Jan 20260.0$0.055
  29. T0558Fraktur Adverts25 Jan 20260.0$0.001
  30. T0554Bibliographic Data25 Jan 20266.8$0.001