University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

qwen/qwen3-vl-8b-thinking

Qwenvia OpenRouter
average±3.8 (95%)
64.3
leaderboard rankof 114
≈79
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$18
seconds per inputmean response time
96.8
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    61.5

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    58.0

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    74.8

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    65.2

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 94.5±1.5 ≈57of 115 $33$0.17 run 190.58 T0233 · 17 Sep 2026prompt.txt
Blacklist Cards 83.6±4.4 ≈89of 114 $8.25$0.27 run 33.35 T0332 · 17 Sep 2026prompt.txt
Book Advert XML Repair 32.8±10.5 ≈41of 119 $23$1.17 run 96.69 T0477 · 17 Sep 2026prompt.txt
Business Letters 57.0±6.8 ≈65of 114 $7.49$0.43 run 28.89 T0243 · 17 Sep 2026prompt.txt
Company Lists 71.2±16.6 ≈84of 114 $17$0.25 run 74.94 T0393 · 17 Sep 2026prompt.txt
Duty Rosters 64.3±4.5 ≈87of 107 $31$0.65 run 218.12 T1307 · 18 Sep 2026prompt.txt
Fraktur Adverts 58.3±31.9 ≈67of 114 $30$0.15 run 149.4 T0246 · 17 Sep 2026prompt_optimized.txt
General Meeting Minutes 75.7±11.2 ≈85of 108 $23$0.20 run 118.83 T1261 · 18 Sep 2026prompt.txt
Library Cards 77.4±1.7 ≈98of 114 $8.75$2.30 run 49.68 T0247 · 17 Sep 2026prompt.txt
Magazine Pages 19.6±11.1 ≈56of 115 $6.08$0.28 run 23.4 T0788 · 18 Sep 2026prompt.txt
Medieval Manuscripts 47.1±18.6 ≈95of 114 $13$0.16 run 56.38 T0300 · 17 Sep 2026prompt.txt
Personnel Cards 90.2±3.4 ≈78of 114 $20$1.21 run 121.58 T0619 · 16 Sep 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
16 Sep 20260.182.1archived price page
2 Mar 20260.1171.365archived price page
17 Oct 20250.182.1archived price page

Every run

  1. T1307Duty Rosters18 Sep 202664.3$0.65
  2. T1261General Meeting Minutes18 Sep 202675.7$0.20
  3. T0788Magazine Pages18 Sep 202619.6$0.28
  4. T0619Personnel Cards17 Sep 202688.5$1.16
  5. T0477Book Advert XML Repair17 Sep 202632.8$1.17
  6. T0394Company Lists17 Sep 202648.1$0.21
  7. T0393Company Lists17 Sep 202671.2$0.25
  8. T0332Blacklist Cards17 Sep 202683.6$0.27
  9. T0300Medieval Manuscripts17 Sep 202647.1$0.16
  10. T0247Library Cards17 Sep 202677.4$2.30
  11. T0246Fraktur Adverts17 Sep 202658.3$0.15
  12. T0245Business Letters17 Sep 2026 · 32 signed letters57.0$0.22
  13. T0244Business Letters17 Sep 2026 · 25 unsigned letters43.0$0.22
  14. T0243Business Letters17 Sep 2026 · all 57 letters57.0$0.43
  15. T0233Bibliographic Data17 Sep 202694.5$0.17
  16. T0788Magazine Pages16 Sep 202617.9$0.33
  17. T0619Personnel Cards16 Sep 202690.2$1.21
  18. T1307Duty Rosters22 Jul 202652.4$0.33
  19. T1261General Meeting Minutes3 Jul 202673.9$0.13
  20. T0788Magazine Pages23 Mar 20260.0$0.022
  21. T0245Business Letters4 Mar 2026 · 32 signed letters55.0$0.14
  22. T0244Business Letters4 Mar 2026 · 25 unsigned letters54.0$0.12
  23. T0243Business Letters17 Feb 2026 · all 57 letters52.0$0.37
  24. T0619Personnel Cards9 Feb 202689.8$1.14
  25. T0477Book Advert XML Repair25 Jan 20263.2$0.16
  26. T0394Company Lists25 Jan 202634.6$0.27
  27. T0393Company Lists25 Jan 20260.0$0.022
  28. T0332Blacklist Cards25 Jan 20260.0$0.011
  29. T0300Medieval Manuscripts25 Jan 2026––
  30. T0247Library Cards24 Jan 20269.9$0.29
  31. T0246Fraktur Adverts24 Jan 202648.3$0.097
  32. T0233Bibliographic Data24 Jan 202633.0$0.046
  33. T0477Book Advert XML Repair8 Dec 20250.0$0.053
  34. T0394Company Lists28 Oct 202546.3$0.14
  35. T0393Company Lists28 Oct 20255.3$0.051
  36. T0332Blacklist Cards24 Oct 20250.0$0.017
  37. T0300Medieval Manuscripts24 Oct 20250.0$0.030
  38. T0247Library Cards17 Oct 20255.9$0.18
  39. T0246Fraktur Adverts17 Oct 20250.0$0.005
  40. T0245Business Letters17 Oct 2025 · 32 signed letters14.0$0.058
  41. T0244Business Letters17 Oct 2025 · 25 unsigned letters30.0$0.034
  42. T0243Business Letters17 Oct 2025 · all 57 letters7.0$0.058
  43. T0233Bibliographic Data17 Oct 202593.6$0.13