University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

ministral-14b-2512

Mistral
average±3.6 (95%)
63.7
leaderboard rankof 114
≈79
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$0.74
seconds per inputmean response time
13.6
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    44.0

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    61.4

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    74.5

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    67.1

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 96.0±1.6 ≈40of 115 $0.96$0.005 run 23.46 T0543 · 4 Jun 2026prompt.txt
Blacklist Cards 77.8±7.0 ≈103of 114 $0.65$0.021 run 7.22 T0550 · 4 Jun 2026prompt.txt
Book Advert XML Repair 5.5±4.3 ≈105of 119 $0.35$0.018 run 12.66 T0553 · 4 Jun 2026prompt.txt
Business Letters 43.0±5.4 ≈107of 114 $0.89$0.051 run 4.03 T0544 · 4 Jun 2026prompt.txt
Company Lists 74.1±15.7 ≈58of 114 $0.71$0.011 run 12.6 T0551 · 4 Jun 2026prompt.txt
Duty Rosters 65.5±6.9 ≈78of 107 $0.96$0.020 run 25.06 T1287 · 16 Sep 2026prompt.txt
Fraktur Adverts 54.5±31.4 ≈67of 114 $1.05$0.005 run 38.13 T0547 · 4 Jun 2026prompt_optimized.txt
General Meeting Minutes 81.1±10.5 ≈25of 108 $0.76$0.007 run 12.93 T1237 · 3 Jul 2026prompt.txt
Library Cards 83.7±1.5 ≈73of 114 $0.43$0.11 run 2.84 T0548 · 4 Jun 2026prompt.txt
Magazine Pages 36.4±12.8 ≈56of 115 $0.51$0.024 run 3.85 T0808 · 4 Jun 2026prompt.txt
Medieval Manuscripts 64.3±14.2 ≈72of 114 $0.62$0.007 run 4.97 T0549 · 4 Jun 2026prompt.txt
Personnel Cards 82.4±3.1 ≈94of 114 $1.01$0.062 run 15.74 T0597 · 4 Jun 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
23 Jan 20260.20.2archived price page

Every run

  1. T1287Duty Rosters16 Sep 202665.5$0.020
  2. T1237General Meeting Minutes16 Sep 202680.4$0.007
  3. T1287Duty Rosters24 Jul 202662.9$0.020
  4. T1237General Meeting Minutes3 Jul 202681.1$0.007
  5. T0808Magazine Pages4 Jun 202636.4$0.024
  6. T0597Personnel Cards4 Jun 202682.4$0.062
  7. T0553Book Advert XML Repair4 Jun 20265.5$0.018
  8. T0552Company Lists4 Jun 202641.5$0.011
  9. T0551Company Lists4 Jun 202674.1$0.011
  10. T0550Blacklist Cards4 Jun 202677.8$0.021
  11. T0549Medieval Manuscripts4 Jun 202664.3$0.007
  12. T0548Library Cards4 Jun 202683.7$0.11
  13. T0547Fraktur Adverts4 Jun 202654.5$0.005
  14. T0546Business Letters4 Jun 2026 · 32 signed letters48.0$0.032
  15. T0545Business Letters4 Jun 2026 · 25 unsigned letters33.0$0.019
  16. T0544Business Letters4 Jun 2026 · all 57 letters43.0$0.051
  17. T0543Bibliographic Data4 Jun 202696.0$0.005
  18. T0549Medieval Manuscripts31 Mar 20260.0$0.002
  19. T0808Magazine Pages23 Mar 20260.0$0.002
  20. T0597Personnel Cards9 Feb 20268.6$0.070
  21. T0553Book Advert XML Repair25 Jan 20261.9$0.018
  22. T0552Company Lists25 Jan 20260.0$0.003
  23. T0551Company Lists25 Jan 20260.0$0.002
  24. T0550Blacklist Cards25 Jan 202612.1$0.006
  25. T0548Library Cards25 Jan 20260.6$0.095
  26. T0547Fraktur Adverts25 Jan 20260.0<$0.001
  27. T0546Business Letters25 Jan 2026 · 32 signed letters0.0$0.004
  28. T0545Business Letters25 Jan 2026 · 25 unsigned letters0.0$0.003
  29. T0544Business Letters25 Jan 2026 · all 57 letters0.0$0.007
  30. T0543Bibliographic Data25 Jan 20268.3$0.002