vs
2:4
overall capability wins (1 ties across 7 scored). o1 Preview leads overall.
- Reasoning0:4
- Arena1:0
- Pricing3:0
- Speed2:0
- Specs1:0
Verdict
o1 Preview edges reasoning & knowledge; GPT-4.1 ranks higher on LMArena (+26 Elo); GPT-4.1 offers ~7.8x larger context (1M vs 128K).
- o1 Preview edges reasoning & knowledge
- GPT-4.1 ranks higher on LMArena (+26 Elo)
- GPT-4.1 offers ~7.8x larger context (1M vs 128K)
- GPT-4.1 is ~7.5x cheaper on a blended token basis than o1 Preview
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- GPT-4.1
- $4
- o1 Preview
- $30
GPT-4.1 is about 7.5x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
OpenAI
OpenAI
Family
GPT-4 / o-series
GPT-4 / o-series
License
Proprietary
Proprietary
Open weights
No
No
Release
Apr 14, 2025
Sep 12, 2024
Knowledge cutoff
2024-06
-
API / provider
OpenAI
OpenAI
Modalities
text, image → text
text → text
Specs
Context window
1M
128K
Max output
33K
33K
Parameters
—
—
Pricing
Input $/1M
$2
$15
Output $/1M
$8
$60
Blended $/1M (3∶1)
$3.50
$26.25
Speed
tok/s
95
40
TTFT (s)
0.35
4
Reasoning
MMLU-Pro
80.6
84.8
GPQA Diamond
66.6
76.5
Humanity's Last Exam
4.2
—
AIME 2025
46.4
79.3
MATH-500
91.3
92.4
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
27.8
—
AA-LCR v1.1
68.3
—
CritPt
—
—
MMMU-Pro
61.2
—
IFBench
43.0
—
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
39.6
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
45.7
—
Terminal-Bench 2.1
—
—
Aider Polyglot
52.4
—
Terminal-Bench 3
—
—
BigCodeBench
—
—
SciCode
38.1
—
CursorBench
—
—
SWE-Rebench
30.1
—
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,415
1,388
| Metric | GPT-4.1 | o1 Preview | Delta |
|---|---|---|---|
| Identity | |||
| Organization | OpenAI | OpenAI | — |
| Family | GPT-4 / o-series | GPT-4 / o-series | — |
| License | Proprietary | Proprietary | — |
| Open weights | No | No | — |
| Release | Apr 14, 2025 | Sep 12, 2024 | — |
| Knowledge cutoff | 2024-06 | - | — |
| API / provider | OpenAI | OpenAI | — |
| Modalities | text, image → text | text → text | — |
| Specs | |||
| Context window | 1M | 128K | A +872K |
| Max output | 33K | 33K | tie |
| Parameters | — | — | — |
| Pricing | |||
| Input $/1M | $2 | $15 | A +$13 |
| Output $/1M | $8 | $60 | A +$52 |
| Blended $/1M (3∶1) | $3.50 | $26.25 | A +$22.75 |
| Speed | |||
| tok/s | 95 | 40 | A +55 |
| TTFT (s) | 0.35 | 4 | A +3.65 |
| Reasoning | |||
| MMLU-Pro | 80.6 | 84.8 | B +4.2 pts |
| GPQA Diamond | 66.6 | 76.5 | B +9.9 pts |
| Humanity's Last Exam | 4.2 | — | — |
| AIME 2025 | 46.4 | 79.3 | B +32.9 pts |
| MATH-500 | 91.3 | 92.4 | B +1.1 pts |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | 27.8 | — | — |
| AA-LCR v1.1 | 68.3 | — | — |
| CritPt | — | — | — |
| MMMU-Pro | 61.2 | — | — |
| IFBench | 43.0 | — | — |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | 39.6 | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | 45.7 | — | — |
| Terminal-Bench 2.1 | — | — | — |
| Aider Polyglot | 52.4 | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | — | — | — |
| SciCode | 38.1 | — | — |
| CursorBench | — | — | — |
| SWE-Rebench | 30.1 | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,415 | 1,388 | A +26 Elo |
GPT-4.1
- Context
- 1M / 33K out
- Parameters
- —
- Price
- $2 / $8
- Speed
- 95 tok/s · 0.35s TTFT
- Modalities
- text, image → text
- License
- Proprietary
Previous-gen OpenAI instruction model with 1M context; still useful for long-document workloads.
o1 Preview
- Context
- 128K / 33K out
- Parameters
- —
- Price
- $15 / $60
- Speed
- 40 tok/s · 4s TTFT
- Modalities
- text → text
- License
- Proprietary
First public o-series preview that introduced chain-of-thought reasoning to the OpenAI API.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.