vs
9:3
overall capability wins (0 ties across 12 scored). Phi-4 leads overall.
- Reasoning6:1
- Coding2:0
- Pricing3:0
- Speed2:0
- Specs1:2
Verdict
Phi-4 leads coding (widest gap: +15.2 on SciCode); Phi-4-mini offers ~8.0x larger context (131K vs 16K); Phi-4-mini allows ~4.0x more max output (16K vs 4K).
- Phi-4 leads coding (widest gap: +15.2 on SciCode)
- Phi-4-mini offers ~8.0x larger context (131K vs 16K)
- Phi-4-mini allows ~4.0x more max output (16K vs 4K)
- Phi-4 is ~1.5x cheaper on a blended token basis than Phi-4-mini
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Phi-4
- $0.11
- Phi-4-mini
- $0.15
Phi-4 is about 1.4x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
Microsoft
Microsoft
Family
Phi
Phi
License
MIT
MIT
Open weights
Yes
Yes
Release
Dec 12, 2024
Feb 1, 2025
Knowledge cutoff
-
-
API / provider
Azure / self-host
Azure AI Foundry
Modalities
text → text
text → text
Specs
Context window
16K
131K
Max output
4K
16K
Parameters
14B
3.8B
Pricing
Input $/1M
$0.07
$0.07
Output $/1M
$0.14
$0.30
Blended $/1M (3∶1)
$0.09
$0.13
Speed
tok/s
150
140
TTFT (s)
0.15
0.18
Reasoning
MMLU-Pro
70.4
52.8
GPQA Diamond
57.5
33.1
Humanity's Last Exam
3.8
4.5
AIME 2025
18.0
6.7
MATH-500
81.0
69.6
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
14.1
9.5
AA-LCR v1.1
—
15.3
CritPt
—
—
MMMU-Pro
—
—
IFBench
23.5
21.1
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
23.1
12.6
Terminal-Bench 2.1
—
0.4
Aider Polyglot
—
—
Terminal-Bench 3
—
—
BigCodeBench
45.5
—
SciCode
26.0
10.8
CursorBench
—
—
SWE-Rebench
—
—
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,256
—
| Metric | Phi-4 | Phi-4-mini | Delta |
|---|---|---|---|
| Identity | |||
| Organization | Microsoft | Microsoft | — |
| Family | Phi | Phi | — |
| License | MIT | MIT | — |
| Open weights | Yes | Yes | — |
| Release | Dec 12, 2024 | Feb 1, 2025 | — |
| Knowledge cutoff | - | - | — |
| API / provider | Azure / self-host | Azure AI Foundry | — |
| Modalities | text → text | text → text | — |
| Specs | |||
| Context window | 16K | 131K | B +115K |
| Max output | 4K | 16K | B +12K |
| Parameters | 14B | 3.8B | A +10 |
| Pricing | |||
| Input $/1M | $0.07 | $0.07 | A +$0.005 |
| Output $/1M | $0.14 | $0.30 | A +$0.16 |
| Blended $/1M (3∶1) | $0.09 | $0.13 | A +$0.04 |
| Speed | |||
| tok/s | 150 | 140 | A +10 |
| TTFT (s) | 0.15 | 0.18 | A +0.03 |
| Reasoning | |||
| MMLU-Pro | 70.4 | 52.8 | A +17.6 pts |
| GPQA Diamond | 57.5 | 33.1 | A +24.4 pts |
| Humanity's Last Exam | 3.8 | 4.5 | B +0.7 pts |
| AIME 2025 | 18.0 | 6.7 | A +11.3 pts |
| MATH-500 | 81.0 | 69.6 | A +11.4 pts |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | 14.1 | 9.5 | A +4.6 pts |
| AA-LCR v1.1 | — | 15.3 | — |
| CritPt | — | — | — |
| MMMU-Pro | — | — | — |
| IFBench | 23.5 | 21.1 | A +2.4 pts |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | 23.1 | 12.6 | A +10.5 pts |
| Terminal-Bench 2.1 | — | 0.4 | — |
| Aider Polyglot | — | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | 45.5 | — | — |
| SciCode | 26.0 | 10.8 | A +15.2 pts |
| CursorBench | — | — | — |
| SWE-Rebench | — | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,256 | — | — |
Phi-4
- Context
- 16K / 4K out
- Parameters
- 14B
- Price
- $0.07 / $0.14
- Speed
- 150 tok/s · 0.15s TTFT
- Modalities
- text → text
- License
- MIT
Small high-quality dense model from Microsoft - punches above its size on STEM.
Phi-4-mini
- Context
- 131K / 16K out
- Parameters
- 3.8B
- Price
- $0.07 / $0.30
- Speed
- 140 tok/s · 0.18s TTFT
- Modalities
- text → text
- License
- MIT
Next-gen Microsoft SLM with grouped-query attention and built-in function calling — strong edge and mobile deployment choice.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.