LLMcompare

Search

Search for a command to run...

A · open · Mistral

Devstral 2

Mistral

B · open · Mistral

Magistral Small

Mistral

3:3

overall capability wins (0 ties across 6 scored). Magistral Small leads overall.

  • Reasoning0:2
  • Coding0:1
  • Pricing1:2
  • Speed1:1
  • Specs3:0

Verdict

Magistral Small leads coding (widest gap: +11.0 on LiveCode); Devstral 2 offers ~2.0x larger context (256K vs 128K); Devstral 2 allows ~1.6x more max output (64K vs 40K).

  • Magistral Small leads coding (widest gap: +11.0 on LiveCode)
  • Devstral 2 offers ~2.0x larger context (256K vs 128K)
  • Devstral 2 allows ~1.6x more max output (64K vs 40K)

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Devstral 2
$0.90
Magistral Small
$0.88

Magistral Small is about 1.0x cheaper on this workload.

Price per 1M tokens

Full comparison

Organization

Mistral

Mistral

Family

Mistral

Mistral

License

Apache 2.0

Apache 2.0

Open weights

Yes

Yes

Release

Dec 1, 2025

Jun 10, 2025

Knowledge cutoff

-

-

API / provider

Mistral

Mistral

Modalities

text → text

text, image → text

Specs

Context window

256K

128K

A +128K

Max output

64K

40K

A +24K

Parameters

123B

24B

A +99

Pricing

Input $/1M

$0.40

$0.50

A +$0.10

Output $/1M

$2

$1.50

B +$0.50

Blended $/1M (3∶1)

$0.80

$0.75

B +$0.05

Speed

tok/s

85

90

B +5.00

TTFT (s)

0.35

0.55

A +0.20

Reasoning

MMLU-Pro

76.2

—

—

GPQA Diamond

59.4

68.2

B +8.8 pts

Humanity's Last Exam

3.6

—

—

AIME 2025

36.7

62.8

B +26.1 pts

MATH-500

—

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

20.8

—

—

AA-LCR v1.1

32.3

—

—

CritPt

—

—

—

MMMU-Pro

—

—

—

IFBench

38.1

—

—

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

—

—

—

SWE-bench Pro

—

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

44.8

55.8

B +11.0 pts

Terminal-Bench 2.1

30.3

—

—

Aider Polyglot

—

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

—

—

—

SciCode

32.8

—

—

CursorBench

—

—

—

SWE-Rebench

42.0

—

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

1,194

—

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

—

—

—

Devstral 2

Context
256K / 64K out
Parameters
123B
Price
$0.40 / $2
Speed
85 tok/s · 0.35s TTFT
Modalities
text → text
License
Apache 2.0

Open-weight agentic coding model for autonomous software engineering (successor path: Medium 3.5).

Magistral Small

Context
128K / 40K out
Parameters
24B
Price
$0.50 / $1.50
Speed
90 tok/s · 0.55s TTFT
Modalities
text, image → text
License
Apache 2.0

Open-weight 24B Magistral reasoning model (Apache 2.0); deprecated on Mistral API in favor of Small 4 / Medium 3.5 reasoning modes.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Reasoning & knowledge

GPQA: B +8.8AIME: B +26.1

Coding

LiveCode: B +11.0

Pick a different pair · Back to catalog