claude-3-5-sonnet-20241022

Anthropic

legacy model Its test configurations are retired, so it is no longer run. The figures are from its best legacy runs, scored as they ran at the time; it is not ranked.

average
68.8
benchmarksof 12
7
per 1,000 documentsmean over its benchmarks
$20
seconds per inputmean response time
12.6

By benchmark

BenchmarkScoreThe best legacy run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error. Legacy models are not ranked.Per 1,000 docss / inputBest run
Bibliographic Dataolder run 94.9 – $34$0.17 run 24.84 T0009 · 30 Sep 2025prompt.txt
Blacklist Cardsolder run 65.8 – $8.76$0.29 run 4.3 T0319 · 24 Oct 2025prompt.txt
Business Lettersolder run 45.0 – –– run 3.18 T0018 · 5 Mar 2025prompt.txt
Company Listsolder run 66.6 – $22$0.33 run 15.59 T0367 · 28 Oct 2025prompt.txt
Fraktur Advertsolder run 49.8 – $26$0.13 run 26.61 T0093 · 30 Sep 2025prompt_optimized.txt
Library Cardsolder run 88.5 – –– run 5.57 T0143 · 2 Sep 2025prompt.txt
Medieval Manuscriptsolder run 71.0 – $10$0.12 run 8.06 T0288 · 24 Oct 2025prompt.txt

Not run on: Book Advert XML Repair, Duty Rosters, General Meeting Minutes, Magazine Pages, Personnel Cards.

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
0 Sep 20253.015.0archived price page

Every run

  1. T0368Company Lists28 Oct 2025 · legacy configuration58.9$0.29
  2. T0367Company Lists28 Oct 2025 · legacy configuration66.6$0.33
  3. T0319Blacklist Cards24 Oct 2025 · legacy configuration65.8$0.29
  4. T0288Medieval Manuscripts24 Oct 2025 · legacy configuration71.0$0.12
  5. T0143Library Cards1 Oct 2025 · legacy configuration87.1$2.50
  6. T0093Fraktur Adverts30 Sep 2025 · legacy configuration49.8$0.13
  7. T0053Business Letters30 Sep 2025 · 32 signed letters · legacy configuration45.0$0.33
  8. T0052Business Letters30 Sep 2025 · 25 unsigned letters · legacy configuration36.0$0.21
  9. T0018Business Letters30 Sep 2025 · all 57 letters · legacy configuration42.0$0.54
  10. T0009Bibliographic Data30 Sep 2025 · legacy configuration94.9$0.17
  11. T0143Library Cards2 Sep 2025 · legacy configuration88.5–
  12. T0093Fraktur Adverts9 May 2025 · legacy configuration3.5–
  13. T0093Fraktur Adverts7 May 2025 · legacy configuration0.0–
  14. T0053Business Letters11 Apr 2025 · 32 signed letters · legacy configuration48.0–
  15. T0052Business Letters11 Apr 2025 · 25 unsigned letters · legacy configuration39.0–
  16. T0018Business Letters11 Apr 2025 · all 57 letters · legacy configuration43.0–
  17. T0009Bibliographic Data8 Apr 2025 · legacy configuration0.0–
  18. T0018Business Letters1 Apr 2025 · all 57 letters · legacy configuration44.0–
  19. T0009Bibliographic Data1 Apr 2025 · legacy configuration0.0–
  20. T0018Business Letters5 Mar 2025 · all 57 letters · legacy configuration45.0–
  21. T0009Bibliographic Data5 Mar 2025 · legacy configuration0.0–
  22. T0009Bibliographic Data2 Mar 2025 · legacy configuration0.0–