University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

mistral-medium-3.5

Mistral
average±2.9 (95%)
67.6
leaderboard rankof 114
≈70
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$10
seconds per inputmean response time
16.0
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    56.3

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    67.3

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    76.5

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    75.4

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 93.9±4.1 ≈57of 115 $17$0.086 run 12.62 T1089 · 16 Sep 2026prompt.txt
Blacklist Cards 90.0±3.4 ≈51of 114 $5.25$0.17 run 3.15 T1096 · 16 Sep 2026prompt.txt
Book Advert XML Repair 17.4±6.5 ≈64of 119 $5.96$0.30 run 5.42 T1099 · 16 Sep 2026prompt.txt
Business Letters 49.0±5.6 ≈100of 114 $7.06$0.40 run 3.62 T1090 · 16 Sep 2026prompt.txt
Company Lists 62.8±12.9 ≈97of 114 $11$0.16 run 56.24 T1097 · 4 Jun 2026prompt.txt
Duty Rosters 75.0±2.2 ≈64of 107 $20$0.42 run 13.67 T1337 · 16 Sep 2026prompt.txt
Fraktur Adverts 66.5±19.8 ≈67of 114 $15$0.076 run 16.75 T1093 · 16 Sep 2026prompt_optimized.txt
General Meeting Minutes 82.1±10.7 ≈25of 108 $11$0.099 run 9.91 T1242 · 3 Jul 2026prompt.txt
Library Cards 83.0±1.6 ≈81of 114 $4.27$1.12 run 1.97 T1094 · 16 Sep 2026prompt.txt
Magazine Pages 31.8±12.7 ≈56of 115 $4.34$0.20 run 3.0 T1101 · 16 Sep 2026prompt.txt
Medieval Manuscripts 64.7±16.4 ≈72of 114 $6.15$0.074 run 57.99 T1095 · 4 Jun 2026prompt.txt
Personnel Cards 95.1±2.9 ≈58of 114 $13$0.80 run 7.98 T1100 · 16 Sep 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
4 Jun 20261.57.5archived price page

Every run

  1. T1337Duty Rosters16 Sep 202675.0$0.42
  2. T1242General Meeting Minutes16 Sep 202681.8$0.099
  3. T1101Magazine Pages16 Sep 202631.8$0.20
  4. T1100Personnel Cards16 Sep 202695.1$0.80
  5. T1099Book Advert XML Repair16 Sep 202617.4$0.30
  6. T1098Company Lists16 Sep 202658.9$0.15
  7. T1097Company Lists16 Sep 202659.1$0.16
  8. T1096Blacklist Cards16 Sep 202690.0$0.17
  9. T1095Medieval Manuscripts16 Sep 202664.2$0.074
  10. T1094Library Cards16 Sep 202683.0$1.12
  11. T1093Fraktur Adverts16 Sep 202666.5$0.076
  12. T1092Business Letters16 Sep 2026 · 32 signed letters51.0$0.25
  13. T1091Business Letters16 Sep 2026 · 25 unsigned letters45.0$0.15
  14. T1090Business Letters16 Sep 2026 · all 57 letters49.0$0.40
  15. T1089Bibliographic Data16 Sep 202693.9$0.086
  16. T1337Duty Rosters24 Jul 202672.5$0.41
  17. T1242General Meeting Minutes3 Jul 202682.1$0.099
  18. T1101Magazine Pages4 Jun 202624.2$0.15
  19. T1100Personnel Cards4 Jun 202685.2$0.66
  20. T1099Book Advert XML Repair4 Jun 202616.4$0.30
  21. T1098Company Lists4 Jun 202657.6$0.15
  22. T1097Company Lists4 Jun 202662.8$0.16
  23. T1096Blacklist Cards4 Jun 202687.6$0.17
  24. T1095Medieval Manuscripts4 Jun 202664.7$0.074
  25. T1094Library Cards4 Jun 202682.3$1.12
  26. T1093Fraktur Adverts4 Jun 202657.1$0.078
  27. T1092Business Letters4 Jun 2026 · 32 signed letters51.0$0.24
  28. T1091Business Letters4 Jun 2026 · 25 unsigned letters45.0$0.15
  29. T1090Business Letters4 Jun 2026 · all 57 letters48.0$0.32
  30. T1089Bibliographic Data4 Jun 202691.1$0.087