University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

qwen/qwen3.5-27b

Qwenvia OpenRouter
average±1.8 (95%)
73.4
leaderboard rankof 114
≈44
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$6.63
seconds per inputmean response time
123.7
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    64.2

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    58.4

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    83.3

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    88.8

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 92.0±4.7 ≈72of 115 $5.67$0.028 run 51.07 T0918 · 21 Apr 2026prompt.txt
Blacklist Cards 96.7±2.4 ≈8of 114 $2.04$0.067 run 31.8 T0925 · 17 Sep 2026prompt.txt
Book Advert XML Repair 30.6±9.4 ≈41of 119 $41$2.07 run 848.52 T0928 · 21 Apr 2026prompt.txt
Business Letters 56.0±5.8 ≈75of 114 $1.13$0.064 run 8.31 T0919 · 21 Apr 2026prompt.txt
Company Lists 87.8±8.1 ≈29of 114 $3.98$0.060 run 62.87 T0926 · 17 Sep 2026prompt.txt
Duty Rosters 77.1±6.6 ≈46of 107 $9.27$0.19 run 216.83 T1324 · 18 Sep 2026prompt.txt
Fraktur Adverts 95.1±1.7 ≈32of 114 $3.69$0.018 run 34.04 T0922 · 21 Apr 2026prompt_optimized.txt
General Meeting Minutes 87.1±8.0 ≈25of 108 $4.93$0.044 run 63.22 T1263 · 18 Sep 2026prompt.txt
Library Cards 86.7±1.5 ≈41of 114 $0.65$0.17 run 6.37 T0923 · 21 Apr 2026prompt.txt
Magazine Pages 0.4±0.8 ≈79of 115 $3.05$0.14 run 129.3 T0930 · 17 Sep 2026prompt.txt
Medieval Manuscripts 73.5±12.3 ≈27of 114 $1.04$0.012 run 11.0 T0924 · 21 Apr 2026prompt.txt
Personnel Cards 97.8±1.1 ≈1of 114 $2.60$0.16 run 21.22 T0929 · 21 Apr 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
16 Sep 20260.1951.56archived price page
22 Jul 20260.262.6archived price page
21 Apr 20260.1951.56archived price page

Every run

  1. T1324Duty Rosters18 Sep 202677.1$0.19
  2. T1263General Meeting Minutes18 Sep 202687.1$0.044
  3. T0930Magazine Pages17 Sep 20260.4$0.14
  4. T0929Personnel Cards17 Sep 202696.8$0.27
  5. T0928Book Advert XML Repair17 Sep 202618.4$1.27
  6. T0927Company Lists17 Sep 202662.5$0.046
  7. T0926Company Lists17 Sep 202687.8$0.060
  8. T0925Blacklist Cards17 Sep 202696.7$0.067
  9. T0924Medieval Manuscripts17 Sep 202673.2$0.033
  10. T0923Library Cards17 Sep 202684.1$0.68
  11. T0922Fraktur Adverts17 Sep 202677.0$0.064
  12. T0921Business Letters17 Sep 2026 · 32 signed letters56.0$0.54
  13. T0920Business Letters17 Sep 2026 · 25 unsigned letters54.0$0.31
  14. T0919Business Letters17 Sep 2026 · all 57 letters53.0$0.81
  15. T0918Bibliographic Data17 Sep 202685.9$0.047
  16. T1324Duty Rosters22 Jul 202664.1$0.60
  17. T1263General Meeting Minutes3 Jul 202684.8$0.031
  18. T0930Magazine Pages21 Apr 20260.0$0.034
  19. T0929Personnel Cards21 Apr 202697.8$0.16
  20. T0928Book Advert XML Repair21 Apr 202630.6$2.07
  21. T0927Company Lists21 Apr 202665.5$0.033
  22. T0926Company Lists21 Apr 202675.6$0.035
  23. T0925Blacklist Cards21 Apr 202693.9$0.027
  24. T0924Medieval Manuscripts21 Apr 202673.5$0.012
  25. T0923Library Cards21 Apr 202686.7$0.17
  26. T0922Fraktur Adverts21 Apr 202695.1$0.018
  27. T0921Business Letters21 Apr 2026 · 32 signed letters62.0$0.040
  28. T0920Business Letters21 Apr 2026 · 25 unsigned letters43.0$0.024
  29. T0919Business Letters21 Apr 2026 · all 57 letters56.0$0.064
  30. T0918Bibliographic Data21 Apr 202692.0$0.028