University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

qwen/qwen3-vl-8b-instruct

Qwenvia OpenRouter
average±5.2 (95%)
58.8
leaderboard rankof 114
≈92
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$0.67
seconds per inputmean response time
13.0
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    56.3

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    51.2

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    69.5

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    65.0

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 68.4±34.3 ≈103of 115 $1.57$0.008 run 32.42 T0259 · 25 Jan 2026prompt.txt
Blacklist Cards 74.4±3.9 ≈106of 114 $0.28$0.009 run 4.72 T0335 · 25 Jan 2026prompt.txt
Book Advert XML Repair 23.1±9.7 ≈64of 119 $0.29$0.015 run 7.7 T0480 · 25 Jan 2026prompt.txt
Business Letters 52.0±5.4 ≈95of 114 $0.41$0.023 run 5.75 T0260 · 25 Jan 2026prompt.txt
Company Lists 75.7±11.6 ≈58of 114 $0.69$0.010 run 15.34 T0399 · 25 Jan 2026prompt.txt
Duty Rosters 64.0±6.1 ≈87of 107 $1.10$0.023 run 16.06 T1306 · 22 Jul 2026prompt.txt
Fraktur Adverts 36.8±44.2 ≈97of 114 $0.88$0.004 run 15.17 T0263 · 17 Sep 2026prompt_optimized.txt
General Meeting Minutes 79.8±14.1 ≈25of 108 $0.99$0.009 run 21.84 T1260 · 18 Sep 2026prompt.txt
Library Cards 72.6±1.6 ≈103of 114 $0.20$0.053 run 12.46 T0264 · 17 Sep 2026prompt.txt
Magazine Pages 0.0±0.0 ≈79of 115 $0.31$0.014 run 5.45 T0792 · 23 Mar 2026prompt.txt
Medieval Manuscripts 68.8±16.1 ≈68of 114 $0.38$0.005 run 6.2 T0303 · 25 Jan 2026prompt.txt
Personnel Cards 89.4±4.2 ≈78of 114 $0.88$0.053 run 13.43 T0618 · 17 Sep 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
22 Jul 20260.1170.455archived price page
20 Oct 20250.080.5archived price page

Every run

  1. T1306Duty Rosters18 Sep 202663.6$0.024
  2. T1260General Meeting Minutes18 Sep 202679.8$0.009
  3. T0792Magazine Pages18 Sep 20260.0$0.017
  4. T0618Personnel Cards17 Sep 202689.4$0.053
  5. T0480Book Advert XML Repair17 Sep 202617.7$0.018
  6. T0400Company Lists17 Sep 202657.4$0.012
  7. T0399Company Lists17 Sep 202671.6$0.012
  8. T0335Blacklist Cards17 Sep 202671.8$0.012
  9. T0303Medieval Manuscripts17 Sep 202664.4$0.005
  10. T0264Library Cards17 Sep 202672.6$0.053
  11. T0263Fraktur Adverts17 Sep 202636.8$0.004
  12. T0262Business Letters17 Sep 2026 · 32 signed letters56.0$0.023
  13. T0261Business Letters17 Sep 2026 · 25 unsigned letters50.0$0.013
  14. T0260Business Letters17 Sep 2026 · all 57 letters52.0$0.035
  15. T0259Bibliographic Data17 Sep 202655.2$0.008
  16. T0792Magazine Pages16 Sep 20260.0$0.016
  17. T0618Personnel Cards16 Sep 202688.0$0.053
  18. T0263Fraktur Adverts16 Sep 202619.5$0.004
  19. T0262Business Letters16 Sep 2026 · 32 signed letters55.0$0.022
  20. T0261Business Letters16 Sep 2026 · 25 unsigned letters51.0$0.012
  21. T0260Business Letters16 Sep 2026 · all 57 letters52.0$0.033
  22. T0259Bibliographic Data16 Sep 202667.7$0.010
  23. T1306Duty Rosters22 Jul 202664.0$0.023
  24. T1260General Meeting Minutes3 Jul 202678.0$0.007
  25. T0792Magazine Pages23 Mar 20260.0$0.014
  26. T0618Personnel Cards9 Feb 202687.2$0.052
  27. T0480Book Advert XML Repair25 Jan 202623.1$0.015
  28. T0400Company Lists25 Jan 202635.9$0.007
  29. T0399Company Lists25 Jan 202675.7$0.010
  30. T0335Blacklist Cards25 Jan 202674.4$0.009
  31. T0303Medieval Manuscripts25 Jan 202668.8$0.005
  32. T0264Library Cards25 Jan 202661.6$0.056
  33. T0263Fraktur Adverts25 Jan 202618.9$0.004
  34. T0262Business Letters25 Jan 2026 · 32 signed letters53.0$0.014
  35. T0261Business Letters25 Jan 2026 · 25 unsigned letters49.0$0.008
  36. T0260Business Letters25 Jan 2026 · all 57 letters52.0$0.023
  37. T0259Bibliographic Data25 Jan 202668.4$0.008
  38. T0480Book Advert XML Repair8 Dec 202510.9$0.017
  39. T0400Company Lists28 Oct 20250.0$0.012
  40. T0399Company Lists28 Oct 202538.8$0.007
  41. T0335Blacklist Cards24 Oct 202571.4$0.005
  42. T0303Medieval Manuscripts24 Oct 202565.4$0.002