vs
9:0
overall capability wins (0 ties across 9 scored). GPT-4.1 leads overall.
- Reasoning4:0
- Coding2:0
- Arena1:0
- Pricing3:0
- Speed0:1
- Specs2:0
Verdict
GPT-4.1 leads coding (widest gap: +12.3 on LiveCode); GPT-4.1 ranks higher on LMArena (+69 Elo); GPT-4.1 offers ~7.8x larger context (1M vs 128K).
- GPT-4.1 leads coding (widest gap: +12.3 on LiveCode)
- GPT-4.1 ranks higher on LMArena (+69 Elo)
- GPT-4.1 offers ~7.8x larger context (1M vs 128K)
- GPT-4.1 allows ~8.0x more max output (33K vs 4K)
- GPT-4.1 is ~2.1x cheaper on a blended token basis than GPT-4o (May 2024)
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- GPT-4.1
- $4
- GPT-4o (May 2024)
- $8.75
GPT-4.1 is about 2.2x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
OpenAI
OpenAI
Family
GPT-4 / o-series
GPT-4 / o-series
License
Proprietary
Proprietary
Open weights
No
No
Release
Apr 14, 2025
May 13, 2024
Knowledge cutoff
2024-06
2023-10
API / provider
OpenAI
OpenAI
Modalities
text, image → text
text, image → text
Specs
Context window
1M
128K
Max output
33K
4K
Parameters
—
—
Pricing
Input $/1M
$2
$5
Output $/1M
$8
$15
Blended $/1M (3∶1)
$3.50
$7.50
Speed
tok/s
95
100
TTFT (s)
0.35
0.35
Reasoning
MMLU-Pro
80.6
74.0
GPQA Diamond
66.6
52.6
Humanity's Last Exam
4.2
1.8
AIME 2025
46.4
—
MATH-500
91.3
79.1
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
27.8
—
AA-LCR v1.1
68.3
—
CritPt
—
—
MMMU-Pro
61.2
—
IFBench
43.0
—
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
39.6
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
45.7
33.4
Terminal-Bench 2.1
—
—
Aider Polyglot
52.4
—
Terminal-Bench 3
—
—
BigCodeBench
—
51.1
SciCode
38.1
30.9
CursorBench
—
—
SWE-Rebench
30.1
—
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,415
1,346
| Metric | GPT-4.1 | GPT-4o (May 2024) | Delta |
|---|---|---|---|
| Identity | |||
| Organization | OpenAI | OpenAI | — |
| Family | GPT-4 / o-series | GPT-4 / o-series | — |
| License | Proprietary | Proprietary | — |
| Open weights | No | No | — |
| Release | Apr 14, 2025 | May 13, 2024 | — |
| Knowledge cutoff | 2024-06 | 2023-10 | — |
| API / provider | OpenAI | OpenAI | — |
| Modalities | text, image → text | text, image → text | — |
| Specs | |||
| Context window | 1M | 128K | A +872K |
| Max output | 33K | 4K | A +29K |
| Parameters | — | — | — |
| Pricing | |||
| Input $/1M | $2 | $5 | A +$3 |
| Output $/1M | $8 | $15 | A +$7 |
| Blended $/1M (3∶1) | $3.50 | $7.50 | A +$4 |
| Speed | |||
| tok/s | 95 | 100 | B +5.00 |
| TTFT (s) | 0.35 | 0.35 | tie |
| Reasoning | |||
| MMLU-Pro | 80.6 | 74.0 | A +6.6 pts |
| GPQA Diamond | 66.6 | 52.6 | A +14.0 pts |
| Humanity's Last Exam | 4.2 | 1.8 | A +2.4 pts |
| AIME 2025 | 46.4 | — | — |
| MATH-500 | 91.3 | 79.1 | A +12.2 pts |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | 27.8 | — | — |
| AA-LCR v1.1 | 68.3 | — | — |
| CritPt | — | — | — |
| MMMU-Pro | 61.2 | — | — |
| IFBench | 43.0 | — | — |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | 39.6 | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | 45.7 | 33.4 | A +12.3 pts |
| Terminal-Bench 2.1 | — | — | — |
| Aider Polyglot | 52.4 | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | — | 51.1 | — |
| SciCode | 38.1 | 30.9 | A +7.2 pts |
| CursorBench | — | — | — |
| SWE-Rebench | 30.1 | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,415 | 1,346 | A +69 Elo |
GPT-4.1
- Context
- 1M / 33K out
- Parameters
- —
- Price
- $2 / $8
- Speed
- 95 tok/s · 0.35s TTFT
- Modalities
- text, image → text
- License
- Proprietary
Previous-gen OpenAI instruction model with 1M context; still useful for long-document workloads.
GPT-4o (May 2024)
- Context
- 128K / 4K out
- Parameters
- —
- Price
- $5 / $15
- Speed
- 100 tok/s · 0.35s TTFT
- Modalities
- text, image → text
- License
- Proprietary
Original gpt-4o-2024-05-13 launch snapshot — higher list rates than later GPT-4o aliases; kept for pinned-version reproducibility.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.