LLMcompare

Search

Search for a command to run...

A · open · Llama / Muse

Llama 3 8B

Meta

B · open · Llama / Muse

Llama 4 Scout

Meta

1:7

overall capability wins (0 ties across 8 scored). Llama 4 Scout leads overall.

  • Reasoning1:3
  • Arena0:1
  • Pricing3:0
  • Speed2:0
  • Specs0:3

Verdict

Llama 4 Scout edges reasoning & knowledge; Llama 4 Scout ranks higher on LMArena (+98 Elo); Llama 4 Scout offers ~1220.7x larger context (10M vs 8K).

  • Llama 4 Scout edges reasoning & knowledge
  • Llama 4 Scout ranks higher on LMArena (+98 Elo)
  • Llama 4 Scout offers ~1220.7x larger context (10M vs 8K)
  • Llama 4 Scout allows ~4.0x more max output (33K vs 8K)
  • Llama 3 8B is ~4.9x cheaper on a blended token basis than Llama 4 Scout

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Llama 3 8B
$0.07
Llama 4 Scout
$0.33

Llama 3 8B is about 4.7x cheaper on this workload.

Price per 1M tokens

Full comparison

Organization

Meta

Meta

Family

Llama / Muse

Llama / Muse

License

Llama 3

Llama 4 Community

Open weights

Yes

Yes

Release

Apr 18, 2024

Apr 5, 2025

Knowledge cutoff

-

-

API / provider

Groq / Together (ref.)

Together / Fireworks (ref.)

Modalities

text → text

text, image → text

Specs

Context window

8K

10M

B +10.0M

Max output

8K

33K

B +25K

Parameters

8B

109B (17B act.)

B +101

Pricing

Input $/1M

$0.05

$0.18

A +$0.13

Output $/1M

$0.08

$0.59

A +$0.51

Blended $/1M (3∶1)

$0.06

$0.28

A +$0.22

Speed

tok/s

200

110

A +90

TTFT (s)

0.12

0.3

A +0.18

Reasoning

MMLU-Pro

—

74.3

—

GPQA Diamond

29.6

58.7

B +29.1 pts

Humanity's Last Exam

5.1

3.8

A +1.3 pts

AIME 2025

—

14.0

—

MATH-500

—

84.4

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

10.4

15.2

B +4.8 pts

AA-LCR v1.1

—

27.7

—

CritPt

—

—

—

MMMU-Pro

—

52.9

—

IFBench

24.6

39.5

B +14.9 pts

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

—

9.1

—

SWE-bench Pro

—

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

—

32.8

—

Terminal-Bench 2.1

—

3.7

—

Aider Polyglot

—

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

31.9

—

—

SciCode

—

21.3

—

CursorBench

—

—

—

SWE-Rebench

—

6.6

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

—

—

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

1,223

1,322

B +98 Elo

Llama 3 8B

Context
8K / 8K out
Parameters
8B
Price
$0.05 / $0.08
Speed
200 tok/s · 0.12s TTFT
Modalities
text → text
License
Llama 3

Compact Llama 3 instruct — still a common local and Groq ultra-low-latency SKU.

Llama 4 Scout

Context
10M / 33K out
Parameters
109B (17B act.)
Price
$0.18 / $0.59
Speed
110 tok/s · 0.3s TTFT
Modalities
text, image → text
License
Llama 4 Community

Llama 4 variant with an extreme 10M context window for long-document retrieval workloads.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Reasoning & knowledge

GPQA: B +29.1HLE: A +1.3Omniscience Acc.: B +4.8IFBench: B +14.9

Arena

Arena Elo: B +98

Pick a different pair · Back to catalog