LLMcompare

Search

Search for a command to run...

A · open · Mistral

Devstral Small

Mistral

B · open · Mistral

Mistral Medium 3.5

Mistral

0:9

overall capability wins (0 ties across 9 scored). Mistral Medium 3.5 leads overall.

  • Reasoning0:5
  • Coding0:1
  • Pricing3:0
  • Speed2:0
  • Specs0:3

Verdict

Mistral Medium 3.5 leads coding (widest gap: +15.9 on SciCode); Mistral Medium 3.5 offers ~2.0x larger context (256K vs 128K); Mistral Medium 3.5 allows ~7.8x more max output (64K vs 8K).

  • Mistral Medium 3.5 leads coding (widest gap: +15.9 on SciCode)
  • Mistral Medium 3.5 offers ~2.0x larger context (256K vs 128K)
  • Mistral Medium 3.5 allows ~7.8x more max output (64K vs 8K)
  • Devstral Small is ~24.5x cheaper on a blended token basis than Mistral Medium 3.5

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Devstral Small
$0.14
Mistral Medium 3.5
$3.38

Devstral Small is about 24.1x cheaper on this workload.

Price per 1M tokens

Full comparison

Organization

Mistral

Mistral

Family

Mistral

Mistral

License

Apache 2.0

Modified MIT

Open weights

Yes

Yes

Release

May 21, 2025

Apr 22, 2026

Knowledge cutoff

-

-

API / provider

Mistral

Mistral

Modalities

text → text

text, image → text

Specs

Context window

128K

256K

B +128K

Max output

8K

64K

B +56K

Parameters

24B

128B

B +104

Pricing

Input $/1M

$0.07

$1.50

A +$1.43

Output $/1M

$0.28

$7.50

A +$7.22

Blended $/1M (3∶1)

$0.12

$3

A +$2.88

Speed

tok/s

100

80

A +20

TTFT (s)

0.28

0.4

A +0.12

Reasoning

MMLU-Pro

—

—

—

GPQA Diamond

41.4

74.8

B +33.4 pts

Humanity's Last Exam

3.8

13.8

B +10.0 pts

AIME 2025

—

—

—

MATH-500

—

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

14.7

24.7

B +10.0 pts

AA-LCR v1.1

18.7

69.3

B +50.6 pts

CritPt

—

—

—

MMMU-Pro

—

64.9

—

IFBench

34.6

68.8

B +34.2 pts

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

46.8

—

—

SWE-bench Pro

—

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

—

—

—

Terminal-Bench 2.1

—

50.6

—

Aider Polyglot

—

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

—

—

—

SciCode

24.3

40.2

B +15.9 pts

CursorBench

—

—

—

SWE-Rebench

14.6

—

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

—

1,265

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

—

1,426

—

Devstral Small

Context
128K / 8K out
Parameters
24B
Price
$0.07 / $0.28
Speed
100 tok/s · 0.28s TTFT
Modalities
text → text
License
Apache 2.0

Open coding agent model from Mistral — lighter sibling to Devstral 2 for IDE workflows.

Mistral Medium 3.5

Context
256K / 64K out
Parameters
128B
Price
$1.50 / $7.50
Speed
80 tok/s · 0.4s TTFT
Modalities
text, image → text
License
Modified MIT

Mistral's April 2026 frontier multimodal model (open weights, Modified MIT) powering Vibe remote agents at $1.50/$7.50.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Reasoning & knowledge

GPQA: B +33.4HLE: B +10.0AA-LCR: B +50.6Omniscience Acc.: B +10.0IFBench: B +34.2

Coding

SciCode: B +15.9

Pick a different pair · Back to catalog