vs
0:9
overall capability wins (0 ties across 9 scored). Muse Spark 1.2 leads overall.
- Reasoning0:4
- Coding0:2
- Arena0:1
- Pricing3:0
- Speed2:0
- Specs0:2
Verdict
Muse Spark 1.2 leads coding (widest gap: +78.6 on TermBench); Muse Spark 1.2 ranks higher on LMArena (+289 Elo); Muse Spark 1.2 offers ~8.2x larger context (1.0M vs 128K).
- Muse Spark 1.2 leads coding (widest gap: +78.6 on TermBench)
- Muse Spark 1.2 ranks higher on LMArena (+289 Elo)
- Muse Spark 1.2 offers ~8.2x larger context (1.0M vs 128K)
- Muse Spark 1.2 allows ~32.0x more max output (131K vs 4K)
- Llama 3.1 8B ships open weights (Llama 3.1 Community)
- Llama 3.1 8B is ~11.1x cheaper on a blended token basis than Muse Spark 1.2
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Llama 3.1 8B
- $0.22
- Muse Spark 1.2
- $2.31
Llama 3.1 8B is about 10.3x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
Meta
Meta
Family
Llama / Muse
Llama / Muse
License
Llama 3.1 Community
Proprietary
Open weights
Yes
No
Release
Jul 23, 2024
Aug 5, 2026
Knowledge cutoff
2023-12
-
API / provider
Together / Fireworks (ref.)
Meta
Modalities
text → text
text, image, video, audio, pdf → text
Specs
Context window
128K
1.0M
Max output
4K
131K
Parameters
8B
—
Pricing
Input $/1M
$0.18
$1.25
Output $/1M
$0.18
$4.25
Blended $/1M (3∶1)
$0.18
$2
Speed
tok/s
160
95
TTFT (s)
0.15
0.38
Reasoning
MMLU-Pro
48.3
—
GPQA Diamond
25.9
90.4
Humanity's Last Exam
5.3
45.5
AIME 2025
4.3
—
MATH-500
51.9
—
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
8.5
45.4
AA-LCR v1.1
18.0
79.0
CritPt
—
17.7
MMMU-Pro
—
—
IFBench
28.6
—
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
11.6
—
Terminal-Bench 2.1
1.5
80.1
Aider Polyglot
—
—
Terminal-Bench 3
—
—
BigCodeBench
32.8
—
SciCode
13.2
57.4
CursorBench
—
—
SWE-Rebench
—
—
NL2Repo-Bench
—
—
DeepSWE
—
55.0
WebDev Arena
—
1,535
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,211
1,500
| Metric | Llama 3.1 8B | Muse Spark 1.2 | Delta |
|---|---|---|---|
| Identity | |||
| Organization | Meta | Meta | — |
| Family | Llama / Muse | Llama / Muse | — |
| License | Llama 3.1 Community | Proprietary | — |
| Open weights | Yes | No | — |
| Release | Jul 23, 2024 | Aug 5, 2026 | — |
| Knowledge cutoff | 2023-12 | - | — |
| API / provider | Together / Fireworks (ref.) | Meta | — |
| Modalities | text → text | text, image, video, audio, pdf → text | — |
| Specs | |||
| Context window | 128K | 1.0M | B +921K |
| Max output | 4K | 131K | B +127K |
| Parameters | 8B | — | — |
| Pricing | |||
| Input $/1M | $0.18 | $1.25 | A +$1.07 |
| Output $/1M | $0.18 | $4.25 | A +$4.07 |
| Blended $/1M (3∶1) | $0.18 | $2 | A +$1.82 |
| Speed | |||
| tok/s | 160 | 95 | A +65 |
| TTFT (s) | 0.15 | 0.38 | A +0.23 |
| Reasoning | |||
| MMLU-Pro | 48.3 | — | — |
| GPQA Diamond | 25.9 | 90.4 | B +64.5 pts |
| Humanity's Last Exam | 5.3 | 45.5 | B +40.2 pts |
| AIME 2025 | 4.3 | — | — |
| MATH-500 | 51.9 | — | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | 8.5 | 45.4 | B +36.9 pts |
| AA-LCR v1.1 | 18.0 | 79.0 | B +61.0 pts |
| CritPt | — | 17.7 | — |
| MMMU-Pro | — | — | — |
| IFBench | 28.6 | — | — |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | 11.6 | — | — |
| Terminal-Bench 2.1 | 1.5 | 80.1 | B +78.6 pts |
| Aider Polyglot | — | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | 32.8 | — | — |
| SciCode | 13.2 | 57.4 | B +44.2 pts |
| CursorBench | — | — | — |
| SWE-Rebench | — | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | 55.0 | — |
| WebDev Arena | — | 1,535 | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,211 | 1,500 | B +289 Elo |
Llama 3.1 8B
- Context
- 128K / 4K out
- Parameters
- 8B
- Price
- $0.18 / $0.18
- Speed
- 160 tok/s · 0.15s TTFT
- Modalities
- text → text
- License
- Llama 3.1 Community
Compact Llama 3.1 instruct model for edge, RAG, and high-throughput classification at sub-$0.20/1M rates.
Muse Spark 1.2
- Context
- 1.0M / 131K out
- Parameters
- —
- Price
- $1.25 / $4.25
- Speed
- 95 tok/s · 0.38s TTFT
- Modalities
- text, image, video, audio, pdf → text
- License
- Proprietary
Co-trained with Muse Code for higher first-attempt accuracy and more reliable tool calling — 1M context coding-focused upgrade; Meta Model API at $1.25/$4.25 (contributor tier $0.10/$0.20).
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.