LLMcompare

Search

Search for a command to run...

A · closed · Claude Sonnet / Haiku

Claude 3.7 Sonnet

Anthropic

B · closed · Claude Sonnet / Haiku

Claude Sonnet 4

Anthropic

1:3

overall capability wins (5 ties across 9 scored). Quality is close, so price/speed break the overall tie. Claude Sonnet 4 leads overall.

  • Coding1:0
  • Arena0:1
  • Speed0:2

Verdict

Claude 3.7 Sonnet leads coding (widest gap: +4.0 on Aider); Claude Sonnet 4 ranks higher on LMArena (+19 Elo).

  • Claude 3.7 Sonnet leads coding (widest gap: +4.0 on Aider)
  • Claude Sonnet 4 ranks higher on LMArena (+19 Elo)

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Claude 3.7 Sonnet
$6.75
Claude Sonnet 4
$6.75

Price per 1M tokens

Full comparison

Organization

Anthropic

Anthropic

Family

Claude Sonnet / Haiku

Claude Sonnet / Haiku

License

Proprietary

Proprietary

Open weights

No

No

Release

Feb 19, 2025

May 22, 2025

Knowledge cutoff

-

-

API / provider

Anthropic

Anthropic

Modalities

text, image → text

text, image → text

Specs

Context window

200K

200K

tie

Max output

64K

64K

tie

Parameters

—

—

—

Pricing

Input $/1M

$3

$3

tie

Output $/1M

$15

$15

tie

Blended $/1M (3∶1)

$6

$6

tie

Speed

tok/s

65

95

B +30

TTFT (s)

0.5

0.35

B +0.15

Reasoning

MMLU-Pro

—

—

—

GPQA Diamond

77.2

—

—

Humanity's Last Exam

9.7

—

—

AIME 2025

—

—

—

MATH-500

—

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

28.0

—

—

AA-LCR v1.1

—

—

—

CritPt

0.9

—

—

MMMU-Pro

—

—

—

IFBench

48.3

—

—

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

52.8

—

—

SWE-bench Pro

—

42.7

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

—

59.4

—

Terminal-Bench 2.1

—

—

—

Aider Polyglot

60.4

56.4

A +4.0 pts

Terminal-Bench 3

—

—

—

BigCodeBench

—

—

—

SciCode

40.3

—

—

CursorBench

—

—

—

SWE-Rebench

—

44.6

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

—

—

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

1,372

1,391

B +19 Elo

Claude 3.7 Sonnet

Context
200K / 64K out
Parameters
—
Price
$3 / $15
Speed
65 tok/s · 0.5s TTFT
Modalities
text, image → text
License
Proprietary

Hybrid-reasoning Sonnet (claude-3-7-sonnet-20250219) between 3.5 and the Claude 4 line — extended thinking for agents and coding.

Claude Sonnet 4

Context
200K / 64K out
Parameters
—
Price
$3 / $15
Speed
95 tok/s · 0.35s TTFT
Modalities
text, image → text
License
Proprietary

Prior Sonnet generation still available on Bedrock and Google Cloud after Anthropic API retirement of the primary SKU.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Coding

Aider: A +4.0

Arena

Arena Elo: B +19

Pick a different pair · Back to catalog