LLMcompare

Search

Search for a command to run...

A · closed · Claude Sonnet / Haiku

Claude 3 Sonnet

Anthropic

B · closed · Claude Sonnet / Haiku

Claude Sonnet 4

Anthropic

0:3

overall capability wins (1 ties across 4 scored). Claude Sonnet 4 leads overall.

  • Coding0:1
  • Arena0:1
  • Speed0:2
  • Specs0:1

Verdict

Claude Sonnet 4 leads coding (widest gap: +41.9 on LiveCode); Claude Sonnet 4 ranks higher on LMArena (+110 Elo); Claude Sonnet 4 allows ~15.6x more max output (64K vs 4K).

  • Claude Sonnet 4 leads coding (widest gap: +41.9 on LiveCode)
  • Claude Sonnet 4 ranks higher on LMArena (+110 Elo)
  • Claude Sonnet 4 allows ~15.6x more max output (64K vs 4K)

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Claude 3 Sonnet
$6.75
Claude Sonnet 4
$6.75

Price per 1M tokens

Full comparison

Organization

Anthropic

Anthropic

Family

Claude Sonnet / Haiku

Claude Sonnet / Haiku

License

Proprietary

Proprietary

Open weights

No

No

Release

Mar 4, 2024

May 22, 2025

Knowledge cutoff

-

-

API / provider

Anthropic

Anthropic

Modalities

text, image → text

text, image → text

Specs

Context window

200K

200K

tie

Max output

4K

64K

B +60K

Parameters

—

—

—

Pricing

Input $/1M

$3

$3

tie

Output $/1M

$15

$15

tie

Blended $/1M (3∶1)

$6

$6

tie

Speed

tok/s

65

95

B +30

TTFT (s)

0.5

0.35

B +0.15

Reasoning

MMLU-Pro

57.9

—

—

GPQA Diamond

40.0

—

—

Humanity's Last Exam

3.6

—

—

AIME 2025

—

—

—

MATH-500

41.4

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

—

—

—

AA-LCR v1.1

—

—

—

CritPt

—

—

—

MMMU-Pro

—

—

—

IFBench

—

—

—

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

—

—

—

SWE-bench Pro

—

42.7

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

17.5

59.4

B +41.9 pts

Terminal-Bench 2.1

—

—

—

Aider Polyglot

—

56.4

—

Terminal-Bench 3

—

—

—

BigCodeBench

42.7

—

—

SciCode

22.9

—

—

CursorBench

—

—

—

SWE-Rebench

—

44.6

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

—

—

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

1,281

1,391

B +110 Elo

Claude 3 Sonnet

Context
200K / 4K out
Parameters
—
Price
$3 / $15
Speed
65 tok/s · 0.5s TTFT
Modalities
text, image → text
License
Proprietary

Balanced Claude 3 mid-tier between Haiku and Opus — superseded by 3.5 / 4.x Sonnet.

Claude Sonnet 4

Context
200K / 64K out
Parameters
—
Price
$3 / $15
Speed
95 tok/s · 0.35s TTFT
Modalities
text, image → text
License
Proprietary

Prior Sonnet generation still available on Bedrock and Google Cloud after Anthropic API retirement of the primary SKU.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Coding

LiveCode: B +41.9

Arena

Arena Elo: B +110

Pick a different pair · Back to catalog