claude-sonnet-4-20250514

Anthropic

legacy model Its test configurations are retired, so it is no longer run. The figures are from its best legacy runs, scored as they ran at the time; it is not ranked.

average
61.6
benchmarksof 12
10
per 1,000 documentsmean over its benchmarks
$17
seconds per inputmean response time
13.6

By task

  • Data correction

    61.0

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Transcription

    68.7

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best legacy run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error. Legacy models are not ranked.Per 1,000 docss / inputBest run
Bibliographic Dataolder run 95.9 – $34$0.17 run 25.56 T0107 · 30 Sep 2025prompt.txt
Blacklist Cards 85.0±3.3 – $11$0.35 run 5.37 T0323 · 24 Jan 2026prompt.txt
Book Advert XML Repair 29.7±8.2 – $14$0.70 run 9.82 T0466 · 24 Jan 2026prompt.txt
Business Letters 44.0±6.4 – $12$0.71 run 4.04 T0103 · 24 Jan 2026prompt.txt
Company Listsolder run 71.0 – $23$0.34 run 18.18 T0375 · 28 Oct 2025prompt.txt
Fraktur Advertsolder run 54.7 – –– run 41.93 T0099 · 23 May 2025prompt_optimized.txt
Library Cards 84.3±1.8 – $10$2.72 run 5.1 T0148 · 24 Jan 2026prompt.txt
Magazine Pages 0.0±0.0 – $7.79$0.36 run 4.02 T0776 · 23 Mar 2026prompt.txt
Medieval Manuscripts 59.1±16.5 – $13$0.15 run 11.67 T0291 · 24 Jan 2026prompt.txt
Personnel Cards 92.4±3.6 – $26$1.60 run 10.33 T0580 · 9 Feb 2026prompt.txt

Not run on: Duty Rosters, General Meeting Minutes.

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
0 Sep 20253.015.0archived price page

Every run

  1. T0776Magazine Pages23 Mar 2026 · legacy configuration0.0$0.36
  2. T0580Personnel Cards9 Feb 2026 · legacy configuration92.4$1.60
  3. T0466Book Advert XML Repair24 Jan 2026 · legacy configuration29.7$0.70
  4. T0376Company Lists24 Jan 2026 · legacy configuration68.7$0.33
  5. T0375Company Lists24 Jan 2026 · legacy configuration70.9$0.37
  6. T0323Blacklist Cards24 Jan 2026 · legacy configuration85.0$0.35
  7. T0291Medieval Manuscripts24 Jan 2026 · legacy configuration59.1$0.15
  8. T0148Library Cards24 Jan 2026 · legacy configuration84.3$2.72
  9. T0107Bibliographic Data24 Jan 2026 · legacy configuration95.3$0.18
  10. T0105Business Letters24 Jan 2026 · 32 signed letters · legacy configuration50.0$0.44
  11. T0104Business Letters24 Jan 2026 · 25 unsigned letters · legacy configuration34.0$0.27
  12. T0103Business Letters24 Jan 2026 · all 57 letters · legacy configuration44.0$0.71
  13. T0099Fraktur Adverts24 Jan 2026 · legacy configuration13.1$0.18
  14. T0466Book Advert XML Repair8 Dec 2025 · legacy configuration27.9$0.71
  15. T0376Company Lists28 Oct 2025 · legacy configuration55.6$0.32
  16. T0375Company Lists28 Oct 2025 · legacy configuration71.0$0.34
  17. T0323Blacklist Cards24 Oct 2025 · legacy configuration79.7$0.29
  18. T0291Medieval Manuscripts24 Oct 2025 · legacy configuration51.7$0.13
  19. T0148Library Cards1 Oct 2025 · legacy configuration83.3$2.51
  20. T0107Bibliographic Data30 Sep 2025 · legacy configuration95.9$0.17
  21. T0105Business Letters30 Sep 2025 · 32 signed letters · legacy configuration36.0$0.32
  22. T0104Business Letters30 Sep 2025 · 25 unsigned letters · legacy configuration23.0$0.21
  23. T0103Business Letters30 Sep 2025 · all 57 letters · legacy configuration32.0$0.53
  24. T0099Fraktur Adverts30 Sep 2025 · legacy configuration33.6$0.21
  25. T0107Bibliographic Data24 Sep 2025 · legacy configuration95.1–
  26. T0099Fraktur Adverts24 Sep 2025 · legacy configuration50.0–
  27. T0148Library Cards2 Sep 2025 · legacy configuration78.5–
  28. T0107Bibliographic Data23 May 2025 · legacy configuration26.1–
  29. T0105Business Letters23 May 2025 · 32 signed letters · legacy configuration40.0–
  30. T0104Business Letters23 May 2025 · 25 unsigned letters · legacy configuration23.0–
  31. T0103Business Letters23 May 2025 · all 57 letters · legacy configuration35.0–
  32. T0099Fraktur Adverts23 May 2025 · legacy configuration54.7–