LLMcompare

Search

Search for a command to run...

A · open · Llama / Muse

Llama 3.1 70B

Meta

B · open · Llama / Muse

Llama 4 Maverick

Meta

0:14

overall capability wins (0 ties across 14 scored). Llama 4 Maverick leads overall.

  • Reasoning0:7
  • Coding0:3
  • Arena0:1
  • Pricing0:3
  • Speed0:2
  • Specs0:3

Verdict

Llama 4 Maverick leads coding (widest gap: +20.2 on LiveCode); Llama 4 Maverick ranks higher on LMArena (+34 Elo); Llama 4 Maverick offers ~7.8x larger context (1M vs 128K).

  • Llama 4 Maverick leads coding (widest gap: +20.2 on LiveCode)
  • Llama 4 Maverick ranks higher on LMArena (+34 Elo)
  • Llama 4 Maverick offers ~7.8x larger context (1M vs 128K)
  • Llama 4 Maverick allows ~8.0x more max output (33K vs 4K)
  • Llama 4 Maverick is ~2.1x cheaper on a blended token basis than Llama 3.1 70B

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Llama 3.1 70B
$1.10
Llama 4 Maverick
$0.48

Llama 4 Maverick is about 2.3x cheaper on this workload.

Price per 1M tokens

Full comparison

Organization

Meta

Meta

Family

Llama / Muse

Llama / Muse

License

Llama 3.1 Community

Llama 4 Community

Open weights

Yes

Yes

Release

Jul 23, 2024

Apr 5, 2025

Knowledge cutoff

2023-12

-

API / provider

Together / Fireworks (ref.)

Together / Fireworks (ref.)

Modalities

text → text

text, image → text

Specs

Context window

128K

1M

B +872K

Max output

4K

33K

B +29K

Parameters

70B

400B (17B act.)

B +330

Pricing

Input $/1M

$0.88

$0.27

B +$0.61

Output $/1M

$0.88

$0.85

B +$0.03

Blended $/1M (3∶1)

$0.88

$0.42

B +$0.46

Speed

tok/s

75

95

B +20

TTFT (s)

0.4

0.35

B +0.05

Reasoning

MMLU-Pro

66.4

80.5

B +14.1 pts

GPQA Diamond

40.9

67.1

B +26.2 pts

Humanity's Last Exam

4.5

4.9

B +0.4 pts

AIME 2025

4.0

19.3

B +15.3 pts

MATH-500

64.9

88.9

B +24.0 pts

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

19.7

24.9

B +5.2 pts

AA-LCR v1.1

—

50.0

—

CritPt

—

—

—

MMMU-Pro

—

62.1

—

IFBench

34.4

43.0

B +8.6 pts

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

—

21.0

—

SWE-bench Pro

—

5.2

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

23.2

43.4

B +20.2 pts

Terminal-Bench 2.1

—

7.9

—

Aider Polyglot

—

15.6

—

Terminal-Bench 3

—

—

—

BigCodeBench

46.1

49.7

B +3.6 pts

SciCode

26.7

31.7

B +5.0 pts

CursorBench

—

—

—

SWE-Rebench

—

11.0

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

—

—

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

1,293

1,327

B +34 Elo

Llama 3.1 70B

Context
128K / 4K out
Parameters
70B
Price
$0.88 / $0.88
Speed
75 tok/s · 0.4s TTFT
Modalities
text → text
License
Llama 3.1 Community

Meta's July 2024 70B instruct model with 128K context - still a common Bedrock / Together production baseline.

Llama 4 Maverick

Context
1M / 33K out
Parameters
400B (17B act.)
Price
$0.27 / $0.85
Speed
95 tok/s · 0.35s TTFT
Modalities
text, image → text
License
Llama 4 Community

Meta's open multimodal MoE flagship - 400B total / 17B active with 1M context.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Reasoning & knowledge

MMLU-Pro: B +14.1GPQA: B +26.2HLE: B +0.4AIME: B +15.3MATH-500: B +24.0Omniscience Acc.: B +5.2IFBench: B +8.6

Coding

LiveCode: B +20.2SciCode: B +5.0BigCodeBench: B +3.6

Arena

Arena Elo: B +34

Pick a different pair · Back to catalog