vs
1:8
overall capability wins (0 ties across 9 scored). Llama 4 Maverick leads overall.
- Reasoning1:3
- Coding0:1
- Arena0:1
- Pricing3:0
- Speed2:0
- Specs0:3
Verdict
Llama 4 Maverick leads coding (widest gap: +17.8 on BigCodeBench); Llama 4 Maverick ranks higher on LMArena (+104 Elo); Llama 4 Maverick offers ~122.1x larger context (1M vs 8K).
- Llama 4 Maverick leads coding (widest gap: +17.8 on BigCodeBench)
- Llama 4 Maverick ranks higher on LMArena (+104 Elo)
- Llama 4 Maverick offers ~122.1x larger context (1M vs 8K)
- Llama 4 Maverick allows ~4.0x more max output (33K vs 8K)
- Llama 3 8B is ~7.2x cheaper on a blended token basis than Llama 4 Maverick
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Llama 3 8B
- $0.07
- Llama 4 Maverick
- $0.48
Llama 3 8B is about 6.9x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
Meta
Meta
Family
Llama / Muse
Llama / Muse
License
Llama 3
Llama 4 Community
Open weights
Yes
Yes
Release
Apr 18, 2024
Apr 5, 2025
Knowledge cutoff
-
-
API / provider
Groq / Together (ref.)
Together / Fireworks (ref.)
Modalities
text → text
text, image → text
Specs
Context window
8K
1M
Max output
8K
33K
Parameters
8B
400B (17B act.)
Pricing
Input $/1M
$0.05
$0.27
Output $/1M
$0.08
$0.85
Blended $/1M (3∶1)
$0.06
$0.42
Speed
tok/s
200
95
TTFT (s)
0.12
0.35
Reasoning
MMLU-Pro
—
80.5
GPQA Diamond
29.6
67.1
Humanity's Last Exam
5.1
4.9
AIME 2025
—
19.3
MATH-500
—
88.9
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
10.4
24.9
AA-LCR v1.1
—
50.0
CritPt
—
—
MMMU-Pro
—
62.1
IFBench
24.6
43.0
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
21.0
SWE-bench Pro
—
5.2
SWE-bench Multilingual
—
—
LiveCodeBench
—
43.4
Terminal-Bench 2.1
—
7.9
Aider Polyglot
—
15.6
Terminal-Bench 3
—
—
BigCodeBench
31.9
49.7
SciCode
—
31.7
CursorBench
—
—
SWE-Rebench
—
11.0
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,223
1,327
| Metric | Llama 3 8B | Llama 4 Maverick | Delta |
|---|---|---|---|
| Identity | |||
| Organization | Meta | Meta | — |
| Family | Llama / Muse | Llama / Muse | — |
| License | Llama 3 | Llama 4 Community | — |
| Open weights | Yes | Yes | — |
| Release | Apr 18, 2024 | Apr 5, 2025 | — |
| Knowledge cutoff | - | - | — |
| API / provider | Groq / Together (ref.) | Together / Fireworks (ref.) | — |
| Modalities | text → text | text, image → text | — |
| Specs | |||
| Context window | 8K | 1M | B +992K |
| Max output | 8K | 33K | B +25K |
| Parameters | 8B | 400B (17B act.) | B +392 |
| Pricing | |||
| Input $/1M | $0.05 | $0.27 | A +$0.22 |
| Output $/1M | $0.08 | $0.85 | A +$0.77 |
| Blended $/1M (3∶1) | $0.06 | $0.42 | A +$0.36 |
| Speed | |||
| tok/s | 200 | 95 | A +105 |
| TTFT (s) | 0.12 | 0.35 | A +0.23 |
| Reasoning | |||
| MMLU-Pro | — | 80.5 | — |
| GPQA Diamond | 29.6 | 67.1 | B +37.5 pts |
| Humanity's Last Exam | 5.1 | 4.9 | A +0.2 pts |
| AIME 2025 | — | 19.3 | — |
| MATH-500 | — | 88.9 | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | 10.4 | 24.9 | B +14.5 pts |
| AA-LCR v1.1 | — | 50.0 | — |
| CritPt | — | — | — |
| MMMU-Pro | — | 62.1 | — |
| IFBench | 24.6 | 43.0 | B +18.4 pts |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | 21.0 | — |
| SWE-bench Pro | — | 5.2 | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | — | 43.4 | — |
| Terminal-Bench 2.1 | — | 7.9 | — |
| Aider Polyglot | — | 15.6 | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | 31.9 | 49.7 | B +17.8 pts |
| SciCode | — | 31.7 | — |
| CursorBench | — | — | — |
| SWE-Rebench | — | 11.0 | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,223 | 1,327 | B +104 Elo |
Llama 3 8B
- Context
- 8K / 8K out
- Parameters
- 8B
- Price
- $0.05 / $0.08
- Speed
- 200 tok/s · 0.12s TTFT
- Modalities
- text → text
- License
- Llama 3
Compact Llama 3 instruct — still a common local and Groq ultra-low-latency SKU.
Llama 4 Maverick
- Context
- 1M / 33K out
- Parameters
- 400B (17B act.)
- Price
- $0.27 / $0.85
- Speed
- 95 tok/s · 0.35s TTFT
- Modalities
- text, image → text
- License
- Llama 4 Community
Meta's open multimodal MoE flagship - 400B total / 17B active with 1M context.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.