LLMcompare

Search

Search for a command to run...

A · open · Llama / Muse

Llama 4 Scout

Meta

B · closed · Llama / Muse

Muse Spark 1.1

Meta

1:9

overall capability wins (0 ties across 10 scored). Muse Spark 1.1 leads overall.

  • Reasoning0:4
  • Coding0:2
  • Arena0:1
  • Tool use0:1
  • Composite indices0:2
  • Pricing3:0
  • Speed2:0
  • Specs1:1

Verdict

Muse Spark 1.1 leads coding (widest gap: +74.2 on TermBench); Muse Spark 1.1 ranks higher on LMArena (+171 Elo); Llama 4 Scout offers ~9.5x larger context (10M vs 1.0M).

  • Muse Spark 1.1 leads coding (widest gap: +74.2 on TermBench)
  • Muse Spark 1.1 ranks higher on LMArena (+171 Elo)
  • Llama 4 Scout offers ~9.5x larger context (10M vs 1.0M)
  • Muse Spark 1.1 allows ~4.0x more max output (131K vs 33K)
  • Llama 4 Scout ships open weights (Llama 4 Community)
  • Llama 4 Scout is ~7.1x cheaper on a blended token basis than Muse Spark 1.1

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Llama 4 Scout
$0.33
Muse Spark 1.1
$2.31

Llama 4 Scout is about 7.1x cheaper on this workload.

Price per 1M tokens

Full comparison

Organization

Meta

Meta

Family

Llama / Muse

Llama / Muse

License

Llama 4 Community

Proprietary

Open weights

Yes

No

Release

Apr 5, 2025

Jul 9, 2026

Knowledge cutoff

-

-

API / provider

Together / Fireworks (ref.)

Meta

Modalities

text, image → text

text, image, video, audio, pdf → text

Specs

Context window

10M

1.0M

A +9.0M

Max output

33K

131K

B +98K

Parameters

109B (17B act.)

—

—

Pricing

Input $/1M

$0.18

$1.25

A +$1.07

Output $/1M

$0.59

$4.25

A +$3.66

Blended $/1M (3∶1)

$0.28

$2

A +$1.72

Speed

tok/s

110

90

A +20

TTFT (s)

0.3

0.4

A +0.10

Reasoning

MMLU-Pro

74.3

—

—

GPQA Diamond

58.7

89.8

B +31.1 pts

Humanity's Last Exam

3.8

46.2

B +42.4 pts

AIME 2025

14.0

—

—

MATH-500

84.4

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

15.2

52.1

B +36.9 pts

AA-LCR v1.1

27.7

77.7

B +50.0 pts

CritPt

—

15.1

—

MMMU-Pro

52.9

—

—

IFBench

39.5

—

—

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

9.1

—

—

SWE-bench Pro

—

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

32.8

—

—

Terminal-Bench 2.1

3.7

77.9

B +74.2 pts

Aider Polyglot

—

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

—

—

—

SciCode

21.3

58.8

B +37.5 pts

CursorBench

—

—

—

SWE-Rebench

6.6

—

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

—

1,542

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

1,322

1,493

B +171 Elo

Llama 4 Scout

Context
10M / 33K out
Parameters
109B (17B act.)
Price
$0.18 / $0.59
Speed
110 tok/s · 0.3s TTFT
Modalities
text, image → text
License
Llama 4 Community

Llama 4 variant with an extreme 10M context window for long-document retrieval workloads.

Muse Spark 1.1

Context
1.0M / 131K out
Parameters
—
Price
$1.25 / $4.25
Speed
90 tok/s · 0.4s TTFT
Modalities
text, image, video, audio, pdf → text
License
Proprietary

Meta's first paid API model - agentic coding focus with MCP support and 1M context; no numeric scorecard retained until the report's exact model/protocol values are independently transcribed.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Reasoning & knowledge

GPQA: B +31.1HLE: B +42.4AA-LCR: B +50.0Omniscience Acc.: B +36.9

Coding

TermBench: B +74.2SciCode: B +37.5

Tool use & function calling

τ³-Banking: B +28.5

Arena

Arena Elo: B +171

Composite indices

AA Index: B +27.8AA Index v4.3: B +27.8

Pick a different pair · Back to catalog