University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

Qwen/Qwen3-VL-235B-A22B-Instruct:deepinfra

Qwenvia Hugging Face
average±3.9 (95%)
64.8
leaderboard rankof 114
≈79
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$1.37
seconds per inputmean response time
71.0
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    62.2

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    56.1

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    71.5

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    82.8

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 81.9±13.5 ≈74of 115 $3.14$0.016 run 219.66 T1510 · 15 Aug 2026prompt.txt
Blacklist Cards 84.9±4.5 ≈89of 114 $0.64$0.021 run 10.95 T1517 · 16 Sep 2026prompt.txt
Book Advert XML Repair 28.2±9.1 ≈41of 119 $0.68$0.034 run 28.13 T1520 · 15 Aug 2026prompt.txt
Business Letters 54.0±6.6 ≈88of 114 $1.12$0.064 run 7.09 T1511 · 15 Aug 2026prompt.txt
Company Lists 66.4±15.5 ≈97of 114 $1.51$0.023 run 51.28 T1518 · 16 Sep 2026prompt.txt
Duty Rosters 72.1±2.5 ≈64of 107 $2.27$0.048 run 105.75 T1524 · 15 Aug 2026prompt.txt
Fraktur Adverts 77.1±37.8 ≈32of 114 $1.85$0.009 run 72.99 T1514 · 15 Aug 2026prompt_optimized.txt
General Meeting Minutes 65.6±5.5 ≈85of 108 $1.57$0.014 run 75.79 T1523 · 15 Aug 2026prompt.txt
Library Cards 75.5±1.7 ≈98of 114 $0.43$0.11 run 215.04 T1515 · 15 Aug 2026prompt.txt
Magazine Pages 0.0±0.0 ≈79of 115 $0.66$0.031 run 6.59 T1522 · 15 Aug 2026prompt.txt
Medieval Manuscripts 75.0±13.4 ≈27of 114 $0.86$0.010 run 28.25 T1516 · 18 Sep 2026prompt.txt
Personnel Cards 96.3±2.0 ≈30of 114 $1.66$0.10 run 30.46 T1521 · 16 Sep 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
16 Sep 20260.20.8799999999999999archived price page
15 Aug 20260.20.88archived price page

Every run

  1. T1524Duty Rosters18 Sep 202611.9$0.014
  2. T1523General Meeting Minutes18 Sep 202661.0$0.013
  3. T1522Magazine Pages18 Sep 20260.0$0.031
  4. T1521Personnel Cards18 Sep 202667.4$0.080
  5. T1520Book Advert XML Repair18 Sep 202626.2$0.034
  6. T1519Company Lists18 Sep 202638.0$0.019
  7. T1518Company Lists18 Sep 202663.5$0.023
  8. T1517Blacklist Cards18 Sep 202684.2$0.021
  9. T1516Medieval Manuscripts18 Sep 202675.0$0.010
  10. T1514Fraktur Adverts18 Sep 202638.2$0.005
  11. T1510Bibliographic Data18 Sep 202636.2$0.006
  12. T1515Library Cards17 Sep 202675.3$0.11
  13. T1513Business Letters17 Sep 2026 · 32 signed letters54.0$0.041
  14. T1512Business Letters17 Sep 2026 · 25 unsigned letters53.0$0.023
  15. T1511Business Letters17 Sep 2026 · all 57 letters53.0$0.064
  16. T1524Duty Rosters16 Sep 202659.2$0.038
  17. T1523General Meeting Minutes16 Sep 202637.1$0.010
  18. T1522Magazine Pages16 Sep 20260.0$0.031
  19. T1521Personnel Cards16 Sep 202696.3$0.10
  20. T1520Book Advert XML Repair16 Sep 202628.1$0.033
  21. T1519Company Lists16 Sep 202650.0$0.023
  22. T1518Company Lists16 Sep 202666.4$0.023
  23. T1517Blacklist Cards16 Sep 202684.9$0.021
  24. T1516Medieval Manuscripts16 Sep 202674.0$0.010
  25. T1514Fraktur Adverts16 Sep 202619.6$0.004
  26. T1513Business Letters16 Sep 2026 · 32 signed letters53.0$0.041
  27. T1512Business Letters16 Sep 2026 · 25 unsigned letters54.0$0.023
  28. T1511Business Letters16 Sep 2026 · all 57 letters53.0$0.064
  29. T1510Bibliographic Data16 Sep 202637.3$0.006
  30. T1524Duty Rosters15 Aug 202672.1$0.048
  31. T1523General Meeting Minutes15 Aug 202665.6$0.014
  32. T1522Magazine Pages15 Aug 20260.0$0.031
  33. T1521Personnel Cards15 Aug 202690.5$0.096
  34. T1520Book Advert XML Repair15 Aug 202628.2$0.034
  35. T1519Company Lists15 Aug 202646.6$0.023
  36. T1518Company Lists15 Aug 202665.0$0.023
  37. T1517Blacklist Cards15 Aug 202684.0$0.021
  38. T1516Medieval Manuscripts15 Aug 202669.5$0.010
  39. T1515Library Cards15 Aug 202675.5$0.11
  40. T1514Fraktur Adverts15 Aug 202677.1$0.009
  41. T1513Business Letters15 Aug 2026 · 32 signed letters56.0$0.041
  42. T1512Business Letters15 Aug 2026 · 25 unsigned letters54.0$0.023
  43. T1511Business Letters15 Aug 2026 · all 57 letters54.0$0.064
  44. T1510Bibliographic Data15 Aug 202681.9$0.016