vs
8:4
overall capability wins (1 ties across 13 scored). Devstral 2 leads overall.
- Reasoning2:4
- Coding3:0
- Tool use1:0
- Composite indices0:1
- Speed0:2
- Specs2:0
Verdict
Devstral 2 leads coding (widest gap: +16.4 on TermBench); Mistral Medium 3.1 edges reasoning & knowledge; Devstral 2 offers ~2.0x larger context (256K vs 128K).
- Devstral 2 leads coding (widest gap: +16.4 on TermBench)
- Mistral Medium 3.1 edges reasoning & knowledge
- Devstral 2 offers ~2.0x larger context (256K vs 128K)
- Devstral 2 allows ~2.0x more max output (64K vs 33K)
- Devstral 2 ships open weights (Apache 2.0)
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Devstral 2
- $0.90
- Mistral Medium 3.1
- $0.90
Price per 1M tokens
Full comparison
Organization
Mistral
Mistral
Family
Mistral
Mistral
License
Apache 2.0
Proprietary
Open weights
Yes
No
Release
Dec 1, 2025
Aug 1, 2025
Knowledge cutoff
-
-
API / provider
Mistral
Mistral
Modalities
text → text
text, image → text
Specs
Context window
256K
128K
Max output
64K
33K
Parameters
123B
—
Pricing
Input $/1M
$0.40
$0.40
Output $/1M
$2
$2
Blended $/1M (3∶1)
$0.80
$0.80
Speed
tok/s
85
100
TTFT (s)
0.35
0.3
Reasoning
MMLU-Pro
76.2
68.3
GPQA Diamond
59.4
58.8
Humanity's Last Exam
3.6
4.7
AIME 2025
36.7
38.3
MATH-500
—
—
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
20.8
20.8
AA-LCR v1.1
32.3
42.7
CritPt
—
—
MMMU-Pro
—
54.2
IFBench
38.1
39.8
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
44.8
40.6
Terminal-Bench 2.1
30.3
13.9
Aider Polyglot
—
—
Terminal-Bench 3
—
—
BigCodeBench
—
—
SciCode
32.8
32.4
CursorBench
—
—
SWE-Rebench
42.0
—
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
1,194
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
—
—
| Metric | Devstral 2 | Mistral Medium 3.1 | Delta |
|---|---|---|---|
| Identity | |||
| Organization | Mistral | Mistral | — |
| Family | Mistral | Mistral | — |
| License | Apache 2.0 | Proprietary | — |
| Open weights | Yes | No | — |
| Release | Dec 1, 2025 | Aug 1, 2025 | — |
| Knowledge cutoff | - | - | — |
| API / provider | Mistral | Mistral | — |
| Modalities | text → text | text, image → text | — |
| Specs | |||
| Context window | 256K | 128K | A +128K |
| Max output | 64K | 33K | A +31K |
| Parameters | 123B | — | — |
| Pricing | |||
| Input $/1M | $0.40 | $0.40 | tie |
| Output $/1M | $2 | $2 | tie |
| Blended $/1M (3∶1) | $0.80 | $0.80 | tie |
| Speed | |||
| tok/s | 85 | 100 | B +15 |
| TTFT (s) | 0.35 | 0.3 | B +0.05 |
| Reasoning | |||
| MMLU-Pro | 76.2 | 68.3 | A +7.9 pts |
| GPQA Diamond | 59.4 | 58.8 | A +0.6 pts |
| Humanity's Last Exam | 3.6 | 4.7 | B +1.1 pts |
| AIME 2025 | 36.7 | 38.3 | B +1.6 pts |
| MATH-500 | — | — | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | 20.8 | 20.8 | tie |
| AA-LCR v1.1 | 32.3 | 42.7 | B +10.4 pts |
| CritPt | — | — | — |
| MMMU-Pro | — | 54.2 | — |
| IFBench | 38.1 | 39.8 | B +1.7 pts |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | 44.8 | 40.6 | A +4.2 pts |
| Terminal-Bench 2.1 | 30.3 | 13.9 | A +16.4 pts |
| Aider Polyglot | — | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | — | — | — |
| SciCode | 32.8 | 32.4 | A +0.4 pts |
| CursorBench | — | — | — |
| SWE-Rebench | 42.0 | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | 1,194 | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | — | — | — |
Devstral 2
- Context
- 256K / 64K out
- Parameters
- 123B
- Price
- $0.40 / $2
- Speed
- 85 tok/s · 0.35s TTFT
- Modalities
- text → text
- License
- Apache 2.0
Open-weight agentic coding model for autonomous software engineering (successor path: Medium 3.5).
Mistral Medium 3.1
- Context
- 128K / 33K out
- Parameters
- —
- Price
- $0.40 / $2
- Speed
- 100 tok/s · 0.3s TTFT
- Modalities
- text, image → text
- License
- Proprietary
Cost-efficient Mistral mid-tier for enterprise chat and document tasks.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.