vs
3:0
overall capability wins (2 ties across 5 scored). Phi-3 Medium 14B leads overall.
- Coding1:0
- Arena1:0
- Pricing0:3
- Speed0:2
- Specs1:0
Verdict
Phi-3 Medium 14B leads coding (widest gap: +8.0 on BigCodeBench); Phi-3 Medium 14B ranks higher on LMArena (+70 Elo); Phi-3 Mini 3.8B is ~1.3x cheaper on a blended token basis than Phi-3 Medium 14B.
- Phi-3 Medium 14B leads coding (widest gap: +8.0 on BigCodeBench)
- Phi-3 Medium 14B ranks higher on LMArena (+70 Elo)
- Phi-3 Mini 3.8B is ~1.3x cheaper on a blended token basis than Phi-3 Medium 14B
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Phi-3 Medium 14B
- $0.34
- Phi-3 Mini 3.8B
- $0.26
Phi-3 Mini 3.8B is about 1.3x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
Microsoft
Microsoft
Family
Phi
Phi
License
MIT
MIT
Open weights
Yes
Yes
Release
May 21, 2024
Apr 23, 2024
Knowledge cutoff
-
-
API / provider
Azure AI Foundry
Azure AI Foundry
Modalities
text → text
text → text
Specs
Context window
128K
128K
Max output
4K
4K
Parameters
14B
3.8B
Pricing
Input $/1M
$0.17
$0.13
Output $/1M
$0.68
$0.52
Blended $/1M (3∶1)
$0.30
$0.23
Speed
tok/s
90
140
TTFT (s)
0.28
0.18
Reasoning
MMLU-Pro
—
43.5
GPQA Diamond
—
31.9
Humanity's Last Exam
—
5.0
AIME 2025
—
0.3
MATH-500
—
45.7
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
—
—
AA-LCR v1.1
—
—
CritPt
—
—
MMMU-Pro
—
—
IFBench
—
23.9
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
—
11.6
Terminal-Bench 2.1
—
—
Aider Polyglot
—
—
Terminal-Bench 3
—
—
BigCodeBench
37.6
29.6
SciCode
—
9.0
CursorBench
—
—
SWE-Rebench
—
—
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,198
1,128
| Metric | Phi-3 Medium 14B | Phi-3 Mini 3.8B | Delta |
|---|---|---|---|
| Identity | |||
| Organization | Microsoft | Microsoft | — |
| Family | Phi | Phi | — |
| License | MIT | MIT | — |
| Open weights | Yes | Yes | — |
| Release | May 21, 2024 | Apr 23, 2024 | — |
| Knowledge cutoff | - | - | — |
| API / provider | Azure AI Foundry | Azure AI Foundry | — |
| Modalities | text → text | text → text | — |
| Specs | |||
| Context window | 128K | 128K | tie |
| Max output | 4K | 4K | tie |
| Parameters | 14B | 3.8B | A +10 |
| Pricing | |||
| Input $/1M | $0.17 | $0.13 | B +$0.04 |
| Output $/1M | $0.68 | $0.52 | B +$0.16 |
| Blended $/1M (3∶1) | $0.30 | $0.23 | B +$0.07 |
| Speed | |||
| tok/s | 90 | 140 | B +50 |
| TTFT (s) | 0.28 | 0.18 | B +0.10 |
| Reasoning | |||
| MMLU-Pro | — | 43.5 | — |
| GPQA Diamond | — | 31.9 | — |
| Humanity's Last Exam | — | 5.0 | — |
| AIME 2025 | — | 0.3 | — |
| MATH-500 | — | 45.7 | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | — | — | — |
| AA-LCR v1.1 | — | — | — |
| CritPt | — | — | — |
| MMMU-Pro | — | — | — |
| IFBench | — | 23.9 | — |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | — | 11.6 | — |
| Terminal-Bench 2.1 | — | — | — |
| Aider Polyglot | — | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | 37.6 | 29.6 | A +8.0 pts |
| SciCode | — | 9.0 | — |
| CursorBench | — | — | — |
| SWE-Rebench | — | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,198 | 1,128 | A +70 Elo |
Phi-3 Medium 14B
- Context
- 128K / 4K out
- Parameters
- 14B
- Price
- $0.17 / $0.68
- Speed
- 90 tok/s · 0.28s TTFT
- Modalities
- text → text
- License
- MIT
Phi-3 Medium 14B instruct — Microsoft's mid-size SLM with long context before Phi-3.5 / Phi-4.
Phi-3 Mini 3.8B
- Context
- 128K / 4K out
- Parameters
- 3.8B
- Price
- $0.13 / $0.52
- Speed
- 140 tok/s · 0.18s TTFT
- Modalities
- text → text
- License
- MIT
Original Phi-3 Mini instruct — compact Azure / edge SLM that popularized Microsoft's open Phi line.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.