vs
0:9
overall capability wins (0 ties across 9 scored). o3 leads overall.
- Reasoning0:4
- Coding0:2
- Arena0:1
- Pricing0:3
- Speed2:0
- Specs0:2
Verdict
o3 leads coding (widest gap: +47.4 on LiveCode); o3 ranks higher on LMArena (+86 Elo); o3 offers ~1.6x larger context (200K vs 128K).
- o3 leads coding (widest gap: +47.4 on LiveCode)
- o3 ranks higher on LMArena (+86 Elo)
- o3 offers ~1.6x larger context (200K vs 128K)
- o3 allows ~24.4x more max output (100K vs 4K)
- o3 is ~2.1x cheaper on a blended token basis than GPT-4o (May 2024)
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- GPT-4o (May 2024)
- $8.75
- o3
- $4
o3 is about 2.2x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
OpenAI
OpenAI
Family
GPT-4 / o-series
GPT-4 / o-series
License
Proprietary
Proprietary
Open weights
No
No
Release
May 13, 2024
Apr 16, 2025
Knowledge cutoff
2023-10
-
API / provider
OpenAI
OpenAI
Modalities
text, image → text
text, image → text
Specs
Context window
128K
200K
Max output
4K
100K
Parameters
—
—
Pricing
Input $/1M
$5
$2
Output $/1M
$15
$8
Blended $/1M (3∶1)
$7.50
$3.50
Speed
tok/s
100
55
TTFT (s)
0.35
1.2
Reasoning
MMLU-Pro
74.0
85.3
GPQA Diamond
52.6
82.7
Humanity's Last Exam
1.8
20.1
AIME 2025
—
88.9
MATH-500
79.1
99.2
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
—
38.6
AA-LCR v1.1
—
74.7
CritPt
—
1.1
MMMU-Pro
—
70.1
IFBench
—
71.4
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
58.4
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
33.4
80.8
Terminal-Bench 2.1
—
—
Aider Polyglot
—
81.3
Terminal-Bench 3
—
—
BigCodeBench
51.1
—
SciCode
30.9
41.0
CursorBench
—
—
SWE-Rebench
—
38.1
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,346
1,432
| Metric | GPT-4o (May 2024) | o3 | Delta |
|---|---|---|---|
| Identity | |||
| Organization | OpenAI | OpenAI | — |
| Family | GPT-4 / o-series | GPT-4 / o-series | — |
| License | Proprietary | Proprietary | — |
| Open weights | No | No | — |
| Release | May 13, 2024 | Apr 16, 2025 | — |
| Knowledge cutoff | 2023-10 | - | — |
| API / provider | OpenAI | OpenAI | — |
| Modalities | text, image → text | text, image → text | — |
| Specs | |||
| Context window | 128K | 200K | B +72K |
| Max output | 4K | 100K | B +96K |
| Parameters | — | — | — |
| Pricing | |||
| Input $/1M | $5 | $2 | B +$3 |
| Output $/1M | $15 | $8 | B +$7 |
| Blended $/1M (3∶1) | $7.50 | $3.50 | B +$4 |
| Speed | |||
| tok/s | 100 | 55 | A +45 |
| TTFT (s) | 0.35 | 1.2 | A +0.85 |
| Reasoning | |||
| MMLU-Pro | 74.0 | 85.3 | B +11.3 pts |
| GPQA Diamond | 52.6 | 82.7 | B +30.1 pts |
| Humanity's Last Exam | 1.8 | 20.1 | B +18.3 pts |
| AIME 2025 | — | 88.9 | — |
| MATH-500 | 79.1 | 99.2 | B +20.1 pts |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | — | 38.6 | — |
| AA-LCR v1.1 | — | 74.7 | — |
| CritPt | — | 1.1 | — |
| MMMU-Pro | — | 70.1 | — |
| IFBench | — | 71.4 | — |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | 58.4 | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | 33.4 | 80.8 | B +47.4 pts |
| Terminal-Bench 2.1 | — | — | — |
| Aider Polyglot | — | 81.3 | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | 51.1 | — | — |
| SciCode | 30.9 | 41.0 | B +10.1 pts |
| CursorBench | — | — | — |
| SWE-Rebench | — | 38.1 | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,346 | 1,432 | B +86 Elo |
GPT-4o (May 2024)
- Context
- 128K / 4K out
- Parameters
- —
- Price
- $5 / $15
- Speed
- 100 tok/s · 0.35s TTFT
- Modalities
- text, image → text
- License
- Proprietary
Original gpt-4o-2024-05-13 launch snapshot — higher list rates than later GPT-4o aliases; kept for pinned-version reproducibility.
o3
- Context
- 200K / 100K out
- Parameters
- —
- Price
- $2 / $8
- Speed
- 55 tok/s · 1.2s TTFT
- Modalities
- text, image → text
- License
- Proprietary
OpenAI reasoning model from the o-series; strong on STEM and agentic coding with deliberate chain-of-thought.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.