University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

thinkingmachines/Inkling-Small:deepinfra

Thinking Machinesvia Hugging Face
average±4.3 (95%)
64.4
leaderboard rankof 114
≈79
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$7.42
seconds per inputmean response time
181.0
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    52.5

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    69.1

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    74.4

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    60.3

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Data 67.9±23.0 ≈103of 115 $8.19$0.041 run 44.38 T1540 · 17 Sep 2026prompt.txt
Blacklist Cards 94.1±2.7 ≈14of 114 $1.70$0.056 run 7.59 T1547 · 16 Aug 2026prompt.txt
Book Advert XML Repair 17.2±5.8 ≈64of 119 $7.01$0.35 run 212.14 T1550 · 17 Sep 2026prompt.txt
Business Letters 51.0±7.8 ≈98of 114 $3.48$0.20 run 19.59 T1541 · 17 Sep 2026prompt.txt
Company Lists 84.6±11.0 ≈29of 114 $5.91$0.089 run 35.3 T1548 · 16 Aug 2026prompt.txt
Duty Rosters 66.2±5.9 ≈78of 107 $16$0.34 run 307.67 T1554 · 16 Aug 2026prompt.txt
Fraktur Adverts 52.4±35.7 ≈67of 114 $16$0.081 run 1031.44 T1544 · 17 Sep 2026prompt_optimized.txt
General Meeting Minutes 75.4±14.5 ≈85of 108 $6.67$0.060 run 74.67 T1553 · 16 Aug 2026prompt.txt
Library Cards 81.7±1.7 ≈81of 114 $3.87$1.02 run 316.76 T1545 · 17 Sep 2026prompt.txt
Magazine Pages 53.5±12.9 ≈47of 115 $2.18$0.10 run 10.2 T1552 · 16 Aug 2026prompt.txt
Medieval Manuscripts 40.7±11.8 ≈95of 114 $11$0.14 run 68.72 T1546 · 17 Sep 2026prompt.txt
Personnel Cards 87.7±6.8 ≈78of 114 $6.52$0.40 run 43.42 T1551 · 16 Aug 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
15 Aug 20260.451.2archived price page

Every run

  1. T1554Duty Rosters17 Sep 202659.8$0.35
  2. T1553General Meeting Minutes17 Sep 202672.1$0.060
  3. T1552Magazine Pages17 Sep 202651.3$0.11
  4. T1551Personnel Cards17 Sep 202687.0$0.41
  5. T1550Book Advert XML Repair17 Sep 202617.2$0.35
  6. T1549Company Lists17 Sep 202638.6$0.038
  7. T1548Company Lists17 Sep 202678.5$0.089
  8. T1547Blacklist Cards17 Sep 202692.9$0.060
  9. T1546Medieval Manuscripts17 Sep 202640.7$0.14
  10. T1545Library Cards17 Sep 202681.7$1.02
  11. T1544Fraktur Adverts17 Sep 202652.4$0.081
  12. T1543Business Letters17 Sep 2026 · 32 signed letters53.0$0.10
  13. T1542Business Letters17 Sep 2026 · 25 unsigned letters48.0$0.11
  14. T1541Business Letters17 Sep 2026 · all 57 letters51.0$0.20
  15. T1540Bibliographic Data17 Sep 202667.9$0.041
  16. T1554Duty Rosters16 Aug 202666.2$0.34
  17. T1553General Meeting Minutes16 Aug 202675.4$0.060
  18. T1552Magazine Pages16 Aug 202653.5$0.10
  19. T1551Personnel Cards16 Aug 202687.7$0.40
  20. T1550Book Advert XML Repair16 Aug 202616.9$0.45
  21. T1549Company Lists16 Aug 202650.7$0.048
  22. T1548Company Lists16 Aug 202684.6$0.089
  23. T1547Blacklist Cards16 Aug 202694.1$0.056
  24. T1546Medieval Manuscripts16 Aug 202639.4$0.14
  25. T1545Library Cards15 Aug 202662.4$0.72
  26. T1544Fraktur Adverts15 Aug 202618.7$0.009
  27. T1543Business Letters15 Aug 2026 · 32 signed letters54.0$0.098
  28. T1542Business Letters15 Aug 2026 · 25 unsigned letters49.0$0.097
  29. T1541Business Letters15 Aug 2026 · all 57 letters50.0$0.18
  30. T1540Bibliographic Data15 Aug 202665.3$0.036