LLMcompare

Search

Search for a command to run...

A · open · Llama / Muse

Llama 4 Maverick

Meta

B · open · Mistral

Mistral Large 3

Mistral

5:11

overall capability wins (0 ties across 16 scored). Mistral Large 3 leads overall.

  • Reasoning4:4
  • Coding0:3
  • Arena0:1
  • Tool use0:1
  • Composite indices0:2
  • Pricing3:0
  • Speed2:0
  • Specs1:2

Verdict

Mistral Large 3 leads coding (widest gap: +4.9 on SciCode); Mistral Large 3 ranks higher on LMArena (+86 Elo); Llama 4 Maverick offers ~3.9x larger context (1M vs 256K).

  • Mistral Large 3 leads coding (widest gap: +4.9 on SciCode)
  • Mistral Large 3 ranks higher on LMArena (+86 Elo)
  • Llama 4 Maverick offers ~3.9x larger context (1M vs 256K)
  • Mistral Large 3 allows ~2.0x more max output (64K vs 33K)
  • Llama 4 Maverick is ~7.2x cheaper on a blended token basis than Mistral Large 3

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Llama 4 Maverick
$0.48
Mistral Large 3
$3.50

Llama 4 Maverick is about 7.3x cheaper on this workload.

Price per 1M tokens

Full comparison

Organization

Meta

Mistral

Family

Llama / Muse

Mistral

License

Llama 4 Community

Apache 2.0

Open weights

Yes

Yes

Release

Apr 5, 2025

Nov 19, 2025

Knowledge cutoff

-

-

API / provider

Together / Fireworks (ref.)

Mistral

Modalities

text, image → text

text, image → text

Specs

Context window

1M

256K

A +744K

Max output

33K

64K

B +31K

Parameters

400B (17B act.)

675B (41B act.)

B +275

Pricing

Input $/1M

$0.27

$2

A +$1.73

Output $/1M

$0.85

$6

A +$5.15

Blended $/1M (3∶1)

$0.42

$3

A +$2.58

Speed

tok/s

95

70

A +25

TTFT (s)

0.35

0.45

A +0.10

Reasoning

MMLU-Pro

80.5

80.7

B +0.2 pts

GPQA Diamond

67.1

68.0

B +0.9 pts

Humanity's Last Exam

4.9

4.2

A +0.7 pts

AIME 2025

19.3

38.0

B +18.7 pts

MATH-500

88.9

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

24.9

25.0

B +0.1 pts

AA-LCR v1.1

50.0

36.0

A +14.0 pts

CritPt

—

—

—

MMMU-Pro

62.1

55.7

A +6.4 pts

IFBench

43.0

36.2

A +6.8 pts

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

21.0

—

—

SWE-bench Pro

5.2

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

43.4

46.5

B +3.1 pts

Terminal-Bench 2.1

7.9

12.0

B +4.1 pts

Aider Polyglot

15.6

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

49.7

—

—

SciCode

31.7

36.6

B +4.9 pts

CursorBench

—

—

—

SWE-Rebench

11.0

—

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

—

1,230

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

1,327

1,413

B +86 Elo

Llama 4 Maverick

Context
1M / 33K out
Parameters
400B (17B act.)
Price
$0.27 / $0.85
Speed
95 tok/s · 0.35s TTFT
Modalities
text, image → text
License
Llama 4 Community

Meta's open multimodal MoE flagship - 400B total / 17B active with 1M context.

Mistral Large 3

Context
256K / 64K out
Parameters
675B (41B act.)
Price
$2 / $6
Speed
70 tok/s · 0.45s TTFT
Modalities
text, image → text
License
Apache 2.0

Mistral's open Large 3 MoE - multilingual European frontier alternative under Apache 2.0.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Reasoning & knowledge

MMLU-Pro: B +0.2GPQA: B +0.9HLE: A +0.7AIME: B +18.7AA-LCR: A +14.0Omniscience Acc.: B +0.1MMMU-Pro: A +6.4IFBench: A +6.8

Coding

LiveCode: B +3.1TermBench: B +4.1SciCode: B +4.9

Tool use & function calling

τ³-Banking: B +2.1

Arena

Arena Elo: B +86

Composite indices

AA Index: B +1.8AA Index v4.3: B +0.4

Pick a different pair · Back to catalog