claude-3-5-sonnet-20241022
Anthropiclegacy model Its test configurations are retired, so it is no longer run. The figures are from its best legacy runs, scored as they ran at the time; it is not ranked.
- average
- 68.8
- benchmarksof 12
- 7
- per 1,000 documentsmean over its benchmarks
- $20
- seconds per inputmean response time
- 12.6
By benchmark
| Benchmark | ScoreThe best legacy run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs. | RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error. Legacy models are not ranked. | Per 1,000 docs | s / input | Best run |
|---|---|---|---|---|---|
| Bibliographic Dataolder run | 94.9 | – | $34$0.17 run | 24.84 | T0009 · 30 Sep 2025prompt.txt |
| Blacklist Cardsolder run | 65.8 | – | $8.76$0.29 run | 4.3 | T0319 · 24 Oct 2025prompt.txt |
| Business Lettersolder run | 45.0 | – | –– run | 3.18 | T0018 · 5 Mar 2025prompt.txt |
| Company Listsolder run | 66.6 | – | $22$0.33 run | 15.59 | T0367 · 28 Oct 2025prompt.txt |
| Fraktur Advertsolder run | 49.8 | – | $26$0.13 run | 26.61 | T0093 · 30 Sep 2025prompt_optimized.txt |
| Library Cardsolder run | 88.5 | – | –– run | 5.57 | T0143 · 2 Sep 2025prompt.txt |
| Medieval Manuscriptsolder run | 71.0 | – | $10$0.12 run | 8.06 | T0288 · 24 Oct 2025prompt.txt |
Not run on: Book Advert XML Repair, Duty Rosters, General Meeting Minutes, Magazine Pages, Personnel Cards.
Price
| From | Input, $ per million tokens | Output, $ per million tokens | Source |
|---|---|---|---|
| 0 Sep 2025 | 3.0 | 15.0 | archived price page |
Every run
- T0368Company Lists28 Oct 2025 · legacy configuration58.9$0.29
- T0367Company Lists28 Oct 2025 · legacy configuration66.6$0.33
- T0319Blacklist Cards24 Oct 2025 · legacy configuration65.8$0.29
- T0288Medieval Manuscripts24 Oct 2025 · legacy configuration71.0$0.12
- T0143Library Cards1 Oct 2025 · legacy configuration87.1$2.50
- T0093Fraktur Adverts30 Sep 2025 · legacy configuration49.8$0.13
- T0053Business Letters30 Sep 2025 · 32 signed letters · legacy configuration45.0$0.33
- T0052Business Letters30 Sep 2025 · 25 unsigned letters · legacy configuration36.0$0.21
- T0018Business Letters30 Sep 2025 · all 57 letters · legacy configuration42.0$0.54
- T0009Bibliographic Data30 Sep 2025 · legacy configuration94.9$0.17
- T0143Library Cards2 Sep 2025 · legacy configuration88.5–
- T0093Fraktur Adverts9 May 2025 · legacy configuration3.5–
- T0093Fraktur Adverts7 May 2025 · legacy configuration0.0–
- T0053Business Letters11 Apr 2025 · 32 signed letters · legacy configuration48.0–
- T0052Business Letters11 Apr 2025 · 25 unsigned letters · legacy configuration39.0–
- T0018Business Letters11 Apr 2025 · all 57 letters · legacy configuration43.0–
- T0009Bibliographic Data8 Apr 2025 · legacy configuration0.0–
- T0018Business Letters1 Apr 2025 · all 57 letters · legacy configuration44.0–
- T0009Bibliographic Data1 Apr 2025 · legacy configuration0.0–
- T0018Business Letters5 Mar 2025 · all 57 letters · legacy configuration45.0–
- T0009Bibliographic Data5 Mar 2025 · legacy configuration0.0–
- T0009Bibliographic Data2 Mar 2025 · legacy configuration0.0–