LLMcompare

Search

Search for a command to run...

A · open · Phi

Phi-3.5-mini

Microsoft

B · open · Phi

Phi-4 Reasoning

Microsoft

1:2

overall capability wins (0 ties across 3 scored). Phi-4 Reasoning leads overall.

  • Pricing0:3
  • Speed2:0
  • Specs1:2

Verdict

Phi-3.5-mini offers ~4.0x larger context (131K vs 33K); Phi-4 Reasoning allows ~4.0x more max output (16K vs 4K); Phi-4 Reasoning is ~2.6x cheaper on a blended token basis than Phi-3.5-mini.

  • Phi-3.5-mini offers ~4.0x larger context (131K vs 33K)
  • Phi-4 Reasoning allows ~4.0x more max output (16K vs 4K)
  • Phi-4 Reasoning is ~2.6x cheaper on a blended token basis than Phi-3.5-mini

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Phi-3.5-mini
$0.26
Phi-4 Reasoning
$0.11

Phi-4 Reasoning is about 2.5x cheaper on this workload.

Price per 1M tokens

Full comparison

Organization

Microsoft

Microsoft

Family

Phi

Phi

License

MIT

MIT

Open weights

Yes

Yes

Release

Aug 21, 2024

Apr 30, 2025

Knowledge cutoff

-

-

API / provider

Azure AI Foundry

Azure / self-host

Modalities

text → text

text → text

Specs

Context window

131K

33K

A +98K

Max output

4K

16K

B +12K

Parameters

3.8B

14B

B +10

Pricing

Input $/1M

$0.13

$0.07

B +$0.06

Output $/1M

$0.52

$0.14

B +$0.38

Blended $/1M (3∶1)

$0.23

$0.09

B +$0.14

Speed

tok/s

130

80

A +50

TTFT (s)

0.2

0.5

A +0.30

Reasoning

MMLU-Pro

—

74.3

—

GPQA Diamond

—

65.8

—

Humanity's Last Exam

—

—

—

AIME 2025

—

62.9

—

MATH-500

—

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

—

—

—

AA-LCR v1.1

—

—

—

CritPt

—

—

—

MMMU-Pro

—

—

—

IFBench

—

—

—

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

—

—

—

SWE-bench Pro

—

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

—

53.8

—

Terminal-Bench 2.1

—

—

—

Aider Polyglot

—

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

—

—

—

SciCode

—

—

—

CursorBench

—

—

—

SWE-Rebench

—

—

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

—

—

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

—

—

—

Phi-3.5-mini

Context
131K / 4K out
Parameters
3.8B
Price
$0.13 / $0.52
Speed
130 tok/s · 0.2s TTFT
Modalities
text → text
License
MIT

Prior Phi SLM generation — still common on Azure for low-cost classification before the Phi-4 refresh.

Phi-4 Reasoning

Context
33K / 16K out
Parameters
14B
Price
$0.07 / $0.14
Speed
80 tok/s · 0.5s TTFT
Modalities
text → text
License
MIT

Reasoning-tuned Phi-4 variant for math and science on constrained hardware.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

These two models have no overlapping published benchmarks in our dataset. Compare specs and pricing instead.

Pick a different pair · Back to catalog