vs
0:3
overall capability wins (1 ties across 4 scored). Claude Sonnet 4 leads overall.
- Coding0:1
- Arena0:1
- Pricing3:0
- Speed2:0
- Specs0:1
Verdict
Claude Sonnet 4 leads coding (widest gap: +28.0 on LiveCode); Claude Sonnet 4 ranks higher on LMArena (+66 Elo); Claude Sonnet 4 allows ~7.8x more max output (64K vs 8K).
- Claude Sonnet 4 leads coding (widest gap: +28.0 on LiveCode)
- Claude Sonnet 4 ranks higher on LMArena (+66 Elo)
- Claude Sonnet 4 allows ~7.8x more max output (64K vs 8K)
- Claude Haiku 3.5 is ~3.8x cheaper on a blended token basis than Claude Sonnet 4
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Claude Haiku 3.5
- $1.80
- Claude Sonnet 4
- $6.75
Claude Haiku 3.5 is about 3.8x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
Anthropic
Anthropic
Family
Claude Sonnet / Haiku
Claude Sonnet / Haiku
License
Proprietary
Proprietary
Open weights
No
No
Release
Oct 22, 2024
May 22, 2025
Knowledge cutoff
-
-
API / provider
Anthropic
Anthropic
Modalities
text, image → text
text, image → text
Specs
Context window
200K
200K
Max output
8K
64K
Parameters
—
—
Pricing
Input $/1M
$0.80
$3
Output $/1M
$4
$15
Blended $/1M (3∶1)
$1.60
$6
Speed
tok/s
160
95
TTFT (s)
0.18
0.35
Reasoning
MMLU-Pro
63.4
—
GPQA Diamond
40.8
—
Humanity's Last Exam
3.6
—
AIME 2025
—
—
MATH-500
72.1
—
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
—
—
AA-LCR v1.1
—
—
CritPt
—
—
MMMU-Pro
—
—
IFBench
—
—
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
40.6
—
SWE-bench Pro
—
42.7
SWE-bench Multilingual
—
—
LiveCodeBench
31.4
59.4
Terminal-Bench 2.1
10.1
—
Aider Polyglot
—
56.4
Terminal-Bench 3
—
—
BigCodeBench
46.1
—
SciCode
27.4
—
CursorBench
—
—
SWE-Rebench
—
44.6
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,324
1,391
| Metric | Claude Haiku 3.5 | Claude Sonnet 4 | Delta |
|---|---|---|---|
| Identity | |||
| Organization | Anthropic | Anthropic | — |
| Family | Claude Sonnet / Haiku | Claude Sonnet / Haiku | — |
| License | Proprietary | Proprietary | — |
| Open weights | No | No | — |
| Release | Oct 22, 2024 | May 22, 2025 | — |
| Knowledge cutoff | - | - | — |
| API / provider | Anthropic | Anthropic | — |
| Modalities | text, image → text | text, image → text | — |
| Specs | |||
| Context window | 200K | 200K | tie |
| Max output | 8K | 64K | B +56K |
| Parameters | — | — | — |
| Pricing | |||
| Input $/1M | $0.80 | $3 | A +$2.20 |
| Output $/1M | $4 | $15 | A +$11 |
| Blended $/1M (3∶1) | $1.60 | $6 | A +$4.40 |
| Speed | |||
| tok/s | 160 | 95 | A +65 |
| TTFT (s) | 0.18 | 0.35 | A +0.17 |
| Reasoning | |||
| MMLU-Pro | 63.4 | — | — |
| GPQA Diamond | 40.8 | — | — |
| Humanity's Last Exam | 3.6 | — | — |
| AIME 2025 | — | — | — |
| MATH-500 | 72.1 | — | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | — | — | — |
| AA-LCR v1.1 | — | — | — |
| CritPt | — | — | — |
| MMMU-Pro | — | — | — |
| IFBench | — | — | — |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | 40.6 | — | — |
| SWE-bench Pro | — | 42.7 | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | 31.4 | 59.4 | B +28.0 pts |
| Terminal-Bench 2.1 | 10.1 | — | — |
| Aider Polyglot | — | 56.4 | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | 46.1 | — | — |
| SciCode | 27.4 | — | — |
| CursorBench | — | — | — |
| SWE-Rebench | — | 44.6 | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,324 | 1,391 | B +66 Elo |
Claude Haiku 3.5
- Context
- 200K / 8K out
- Parameters
- —
- Price
- $0.80 / $4
- Speed
- 160 tok/s · 0.18s TTFT
- Modalities
- text, image → text
- License
- Proprietary
Retired-on-API Haiku generation retained on Bedrock/Vertex; cheap vision-capable tier for high-throughput apps.
Claude Sonnet 4
- Context
- 200K / 64K out
- Parameters
- —
- Price
- $3 / $15
- Speed
- 95 tok/s · 0.35s TTFT
- Modalities
- text, image → text
- License
- Proprietary
Prior Sonnet generation still available on Bedrock and Google Cloud after Anthropic API retirement of the primary SKU.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.