vs
1:4
overall capability wins (0 ties across 5 scored). Phi-4 Reasoning leads overall.
- Reasoning0:2
- Coding0:1
- Pricing0:3
- Speed2:0
- Specs1:1
Verdict
Phi-4 Reasoning leads coding (widest gap: +40.7 on LiveCode); Phi-4-multimodal offers ~4.0x larger context (131K vs 33K); Phi-4 Reasoning allows ~4.0x more max output (16K vs 4K).
- Phi-4 Reasoning leads coding (widest gap: +40.7 on LiveCode)
- Phi-4-multimodal offers ~4.0x larger context (131K vs 33K)
- Phi-4 Reasoning allows ~4.0x more max output (16K vs 4K)
- Phi-4 Reasoning is ~1.6x cheaper on a blended token basis than Phi-4-multimodal
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Phi-4-multimodal
- $0.16
- Phi-4 Reasoning
- $0.11
Phi-4 Reasoning is about 1.5x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
Microsoft
Microsoft
Family
Phi
Phi
License
MIT
MIT
Open weights
Yes
Yes
Release
Feb 1, 2025
Apr 30, 2025
Knowledge cutoff
-
-
API / provider
Azure AI Foundry
Azure / self-host
Modalities
text, image, audio → text
text → text
Specs
Context window
131K
33K
Max output
4K
16K
Parameters
—
14B
Pricing
Input $/1M
$0.08
$0.07
Output $/1M
$0.32
$0.14
Blended $/1M (3∶1)
$0.14
$0.09
Speed
tok/s
90
80
TTFT (s)
0.35
0.5
Reasoning
MMLU-Pro
48.5
74.3
GPQA Diamond
31.5
65.8
Humanity's Last Exam
5.0
—
AIME 2025
—
62.9
MATH-500
69.3
—
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
—
—
AA-LCR v1.1
—
—
CritPt
—
—
MMMU-Pro
14.5
—
IFBench
—
—
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
13.1
53.8
Terminal-Bench 2.1
—
—
Aider Polyglot
—
—
Terminal-Bench 3
—
—
BigCodeBench
—
—
SciCode
11.0
—
CursorBench
—
—
SWE-Rebench
—
—
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
—
—
| Metric | Phi-4-multimodal | Phi-4 Reasoning | Delta |
|---|---|---|---|
| Identity | |||
| Organization | Microsoft | Microsoft | — |
| Family | Phi | Phi | — |
| License | MIT | MIT | — |
| Open weights | Yes | Yes | — |
| Release | Feb 1, 2025 | Apr 30, 2025 | — |
| Knowledge cutoff | - | - | — |
| API / provider | Azure AI Foundry | Azure / self-host | — |
| Modalities | text, image, audio → text | text → text | — |
| Specs | |||
| Context window | 131K | 33K | A +98K |
| Max output | 4K | 16K | B +12K |
| Parameters | — | 14B | — |
| Pricing | |||
| Input $/1M | $0.08 | $0.07 | B +$0.010 |
| Output $/1M | $0.32 | $0.14 | B +$0.18 |
| Blended $/1M (3∶1) | $0.14 | $0.09 | B +$0.05 |
| Speed | |||
| tok/s | 90 | 80 | A +10 |
| TTFT (s) | 0.35 | 0.5 | A +0.15 |
| Reasoning | |||
| MMLU-Pro | 48.5 | 74.3 | B +25.8 pts |
| GPQA Diamond | 31.5 | 65.8 | B +34.3 pts |
| Humanity's Last Exam | 5.0 | — | — |
| AIME 2025 | — | 62.9 | — |
| MATH-500 | 69.3 | — | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | — | — | — |
| AA-LCR v1.1 | — | — | — |
| CritPt | — | — | — |
| MMMU-Pro | 14.5 | — | — |
| IFBench | — | — | — |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | 13.1 | 53.8 | B +40.7 pts |
| Terminal-Bench 2.1 | — | — | — |
| Aider Polyglot | — | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | — | — | — |
| SciCode | 11.0 | — | — |
| CursorBench | — | — | — |
| SWE-Rebench | — | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | — | — | — |
Phi-4-multimodal
- Context
- 131K / 4K out
- Parameters
- —
- Price
- $0.08 / $0.32
- Speed
- 90 tok/s · 0.35s TTFT
- Modalities
- text, image, audio → text
- License
- MIT
First multimodal Phi — unified text, vision, and speech inputs for on-device assistants and accessibility apps.
Phi-4 Reasoning
- Context
- 33K / 16K out
- Parameters
- 14B
- Price
- $0.07 / $0.14
- Speed
- 80 tok/s · 0.5s TTFT
- Modalities
- text → text
- License
- MIT
Reasoning-tuned Phi-4 variant for math and science on constrained hardware.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.