University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

qwen/qwen3.5-9b

Qwenvia OpenRouter
average±5.0 (95%)
59.2
leaderboard rankof 114
≈92
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$1.89
seconds per inputmean response time
442.3
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    46.0

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    32.9

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    68.2

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    74.0

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 72.8±36.2 ≈91of 115 $1.39$0.007 run 408.46 T0983 · 21 Apr 2026prompt.txt
Blacklist Cards 94.7±2.4 ≈14of 114 $0.63$0.021 run 94.53 T0990 · 21 Apr 2026prompt.txt
Book Advert XML Repair 4.4±3.8 ≈105of 119 $3.66$0.18 run 506.14 T0993 · 17 Sep 2026prompt.txt
Business Letters 60.0±8.0 ≈24of 114 $0.88$0.044 run 155.89 T0984 · 22 Apr 2026prompt.txt
Company Lists 91.2±4.7 ≈6of 114 $0.91$0.014 run 71.24 T0991 · 21 Apr 2026prompt.txt
Duty Rosters 4.5±8.0 ≈103of 107 $5.69$0.12 run 1322.87 T1329 · 22 Jul 2026prompt.txt
Fraktur Adverts 49.7±39.5 ≈67of 114 $2.11$0.011 run 374.13 T0987 · 22 Apr 2026prompt_optimized.txt
General Meeting Minutes 79.2±20.3 ≈25of 108 $2.32$0.021 run 1493.08 T1266 · 3 Jul 2026prompt.txt
Library Cards 75.0±3.9 ≈98of 114 $1.12$0.29 run 271.27 T0988 · 18 Sep 2026prompt.txt
Magazine Pages 6.5±6.4 ≈66of 115 $0.96$0.044 run 161.53 T0995 · 18 Sep 2026prompt.txt
Medieval Manuscripts 84.6±10.6 ≈1of 114 $0.96$0.004 run 48.28 T0989 · 21 Apr 2026prompt.txt
Personnel Cards 87.7±6.7 ≈78of 114 $2.00$0.12 run 399.92 T0994 · 21 Apr 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
21 Apr 20260.10.15archived price page

Every run

  1. T0983Bibliographic Data26 Sep 202635.0$0.009
  2. T1266General Meeting Minutes18 Sep 202655.0$0.022
  3. T0995Magazine Pages18 Sep 20266.5$0.044
  4. T0994Personnel Cards18 Sep 202687.6$0.067
  5. T0992Company Lists18 Sep 202658.5$0.012
  6. T0991Company Lists18 Sep 202684.1$0.015
  7. T0990Blacklist Cards18 Sep 202688.3$0.019
  8. T0989Medieval Manuscripts18 Sep 202664.5$0.005
  9. T0988Library Cards18 Sep 202675.0$0.29
  10. T0987Fraktur Adverts18 Sep 202647.5$0.008
  11. T0986Business Letters18 Sep 2026 · 32 signed letters54.0$0.034
  12. T0985Business Letters18 Sep 2026 · 25 unsigned letters55.0$0.019
  13. T0984Business Letters18 Sep 2026 · all 57 letters56.0$0.062
  14. T0983Bibliographic Data18 Sep 202660.7$0.006
  15. T0993Book Advert XML Repair17 Sep 20264.4$0.18
  16. T1329Duty Rosters22 Jul 20264.5$0.12
  17. T1266General Meeting Minutes3 Jul 202679.2$0.021
  18. T0994Personnel Cards22 Apr 202683.9$0.14
  19. T0993Book Advert XML Repair22 Apr 20261.4$0.31
  20. T0992Company Lists22 Apr 202641.5$0.010
  21. T0991Company Lists22 Apr 202672.0$0.014
  22. T0990Blacklist Cards22 Apr 202685.9$0.016
  23. T0989Medieval Manuscripts22 Apr 202669.0$0.005
  24. T0988Library Cards22 Apr 202663.9$0.73
  25. T0987Fraktur Adverts22 Apr 202649.7$0.011
  26. T0986Business Letters22 Apr 2026 · 32 signed letters59.0$0.026
  27. T0985Business Letters22 Apr 2026 · 25 unsigned letters54.0$0.022
  28. T0984Business Letters22 Apr 2026 · all 57 letters60.0$0.044
  29. T0983Bibliographic Data22 Apr 20260.0$0.012
  30. T0995Magazine Pages21 Apr 20265.4$0.089
  31. T0994Personnel Cards21 Apr 202687.7$0.12
  32. T0992Company Lists21 Apr 202635.9$0.015
  33. T0991Company Lists21 Apr 202691.2$0.014
  34. T0990Blacklist Cards21 Apr 202694.7$0.021
  35. T0989Medieval Manuscripts21 Apr 202684.6$0.004
  36. T0988Library Cards21 Apr 202663.9$0.51
  37. T0987Fraktur Adverts21 Apr 202639.7$0.007
  38. T0986Business Letters21 Apr 2026 · 32 signed letters61.0$0.026
  39. T0985Business Letters21 Apr 2026 · 25 unsigned letters54.0$0.023
  40. T0984Business Letters21 Apr 2026 · all 57 letters58.0$0.055
  41. T0983Bibliographic Data21 Apr 202672.8$0.007