University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

qwen/qwen3-vl-30b-a3b-instruct

Qwenvia OpenRouter
average±4.3 (95%)
61.9
leaderboard rankof 114
≈89
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$0.96
seconds per inputmean response time
32.7
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    59.2

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    53.3

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    72.5

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    70.0

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 85.9±8.4 ≈74of 115 $2.23$0.011 run 68.27 T0253 · 24 Jan 2026prompt.txt
Blacklist Cards 83.2±3.3 ≈89of 114 $0.48$0.016 run 4.42 T0334 · 17 Sep 2026prompt.txt
Book Advert XML Repair 25.6±10.0 ≈64of 119 $0.59$0.030 run 12.52 T0479 · 8 Dec 2025prompt.txt
Business Letters 49.0±6.1 ≈100of 114 $0.83$0.047 run 4.66 T0254 · 24 Jan 2026prompt.txt
Company Lists 70.3±13.2 ≈84of 114 $1.03$0.015 run 15.07 T0397 · 17 Sep 2026prompt.txt
Duty Rosters 67.2±4.6 ≈78of 107 $1.36$0.029 run 42.77 T1305 · 22 Jul 2026prompt.txt
Fraktur Adverts 52.7±42.5 ≈67of 114 $1.32$0.007 run 28.02 T0257 · 16 Sep 2026prompt_optimized.txt
General Meeting Minutes 79.2±11.2 ≈25of 108 $0.90$0.008 run 33.13 T1259 · 3 Jul 2026prompt.txt
Library Cards 72.6±2.2 ≈103of 114 $0.30$0.078 run 107.6 T0258 · 17 Sep 2026prompt.txt
Magazine Pages 0.0±0.0 ≈79of 115 $0.83$0.038 run 52.68 T0791 · 23 Mar 2026prompt.txt
Medieval Manuscripts 64.4±16.1 ≈72of 114 $0.59$0.007 run 7.34 T0302 · 17 Sep 2026prompt.txt
Personnel Cards 92.8±4.9 ≈58of 114 $1.08$0.066 run 15.66 T0617 · 9 Feb 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
16 Sep 20260.150.6archived price page
2 Mar 20260.130.52archived price page
23 Jan 20260.150.6archived price page
24 Nov 20250.20.6archived price page
20 Oct 20250.20.7archived price page

Every run

  1. T1305Duty Rosters18 Sep 202665.0$0.033
  2. T1259General Meeting Minutes18 Sep 202652.8$0.008
  3. T0791Magazine Pages18 Sep 20260.0$0.022
  4. T0617Personnel Cards17 Sep 202689.5$0.068
  5. T0479Book Advert XML Repair17 Sep 202615.5$0.024
  6. T0398Company Lists17 Sep 202646.4$0.015
  7. T0397Company Lists17 Sep 202670.3$0.015
  8. T0334Blacklist Cards17 Sep 202683.2$0.016
  9. T0302Medieval Manuscripts17 Sep 202664.4$0.007
  10. T0258Library Cards17 Sep 202672.6$0.078
  11. T0257Fraktur Adverts17 Sep 202637.1$0.006
  12. T0256Business Letters17 Sep 2026 · 32 signed letters51.0$0.027
  13. T0255Business Letters17 Sep 2026 · 25 unsigned letters48.0$0.016
  14. T0254Business Letters17 Sep 2026 · all 57 letters47.0$0.043
  15. T0253Bibliographic Data17 Sep 202674.0$0.011
  16. T0791Magazine Pages16 Sep 20260.0$0.020
  17. T0617Personnel Cards16 Sep 202687.5$0.068
  18. T0257Fraktur Adverts16 Sep 202652.7$0.007
  19. T0256Business Letters16 Sep 2026 · 32 signed letters50.0$0.028
  20. T0255Business Letters16 Sep 2026 · 25 unsigned letters45.0$0.016
  21. T0254Business Letters16 Sep 2026 · all 57 letters48.0$0.043
  22. T0253Bibliographic Data16 Sep 202677.0$0.012
  23. T1305Duty Rosters22 Jul 202667.2$0.029
  24. T1259General Meeting Minutes3 Jul 202679.2$0.008
  25. T0791Magazine Pages23 Mar 20260.0$0.038
  26. T0617Personnel Cards9 Feb 202692.8$0.066
  27. T0479Book Advert XML Repair25 Jan 202624.0$0.023
  28. T0398Company Lists25 Jan 202637.5$0.013
  29. T0397Company Lists25 Jan 202663.9$0.013
  30. T0334Blacklist Cards25 Jan 202679.7$0.014
  31. T0302Medieval Manuscripts25 Jan 202662.8$0.006
  32. T0258Library Cards24 Jan 202653.7$0.082
  33. T0257Fraktur Adverts24 Jan 202651.1$0.006
  34. T0256Business Letters24 Jan 2026 · 32 signed letters54.0$0.030
  35. T0255Business Letters24 Jan 2026 · 25 unsigned letters49.0$0.017
  36. T0254Business Letters24 Jan 2026 · all 57 letters49.0$0.047
  37. T0253Bibliographic Data24 Jan 202685.9$0.011
  38. T0479Book Advert XML Repair8 Dec 202525.6$0.030
  39. T0398Company Lists28 Oct 202539.7$0.012
  40. T0397Company Lists28 Oct 202550.5$0.015
  41. T0334Blacklist Cards24 Oct 202570.2$0.012
  42. T0302Medieval Manuscripts24 Oct 202551.1$0.008