vs
1:6
overall capability wins (1 ties across 8 scored). Gemma 4 26B leads overall.
- Reasoning0:3
- Coding0:1
- Arena0:1
- Pricing3:0
- Speed0:1
- Specs1:1
Verdict
Gemma 4 26B leads coding (widest gap: +47.4 on LiveCode); Gemma 4 26B ranks higher on LMArena (+73 Elo); Gemma 4 26B offers ~2.0x larger context (256K vs 128K).
- Gemma 4 26B leads coding (widest gap: +47.4 on LiveCode)
- Gemma 4 26B ranks higher on LMArena (+73 Elo)
- Gemma 4 26B offers ~2.0x larger context (256K vs 128K)
- Gemma 3 27B is ~1.7x cheaper on a blended token basis than Gemma 4 26B
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Gemma 3 27B
- $0.17
- Gemma 4 26B
- $0.30
Gemma 3 27B is about 1.7x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
Family
Gemma
Gemma
License
Gemma
Apache 2.0
Open weights
Yes
Yes
Release
Mar 12, 2025
Apr 8, 2026
Knowledge cutoff
-
-
API / provider
Google AI / self-host
Google AI / self-host
Modalities
text, image → text
text, image → text
Specs
Context window
128K
256K
Max output
8K
8K
Parameters
27B
26B (3.8B act.)
Pricing
Input $/1M
$0.10
$0.15
Output $/1M
$0.30
$0.60
Blended $/1M (3∶1)
$0.15
$0.26
Speed
tok/s
90
95
TTFT (s)
0.28
0.28
Reasoning
MMLU-Pro
67.5
82.6
GPQA Diamond
42.8
82.3
Humanity's Last Exam
4.4
8.7
AIME 2025
20.7
—
MATH-500
88.3
—
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
13.0
—
AA-LCR v1.1
7.3
—
CritPt
—
—
MMMU-Pro
48.0
—
IFBench
31.8
—
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
—
SWE-bench Pro
11.4
—
SWE-bench Multilingual
—
—
LiveCodeBench
29.7
77.1
Terminal-Bench 2.1
4.5
—
Aider Polyglot
4.9
—
Terminal-Bench 3
—
—
BigCodeBench
—
—
SciCode
23.3
—
CursorBench
—
—
SWE-Rebench
5.4
—
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
1,362
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,365
1,438
| Metric | Gemma 3 27B | Gemma 4 26B | Delta |
|---|---|---|---|
| Identity | |||
| Organization | — | ||
| Family | Gemma | Gemma | — |
| License | Gemma | Apache 2.0 | — |
| Open weights | Yes | Yes | — |
| Release | Mar 12, 2025 | Apr 8, 2026 | — |
| Knowledge cutoff | - | - | — |
| API / provider | Google AI / self-host | Google AI / self-host | — |
| Modalities | text, image → text | text, image → text | — |
| Specs | |||
| Context window | 128K | 256K | B +128K |
| Max output | 8K | 8K | tie |
| Parameters | 27B | 26B (3.8B act.) | A +1.00 |
| Pricing | |||
| Input $/1M | $0.10 | $0.15 | A +$0.05 |
| Output $/1M | $0.30 | $0.60 | A +$0.30 |
| Blended $/1M (3∶1) | $0.15 | $0.26 | A +$0.11 |
| Speed | |||
| tok/s | 90 | 95 | B +5.00 |
| TTFT (s) | 0.28 | 0.28 | tie |
| Reasoning | |||
| MMLU-Pro | 67.5 | 82.6 | B +15.1 pts |
| GPQA Diamond | 42.8 | 82.3 | B +39.5 pts |
| Humanity's Last Exam | 4.4 | 8.7 | B +4.3 pts |
| AIME 2025 | 20.7 | — | — |
| MATH-500 | 88.3 | — | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | 13.0 | — | — |
| AA-LCR v1.1 | 7.3 | — | — |
| CritPt | — | — | — |
| MMMU-Pro | 48.0 | — | — |
| IFBench | 31.8 | — | — |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | — | — |
| SWE-bench Pro | 11.4 | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | 29.7 | 77.1 | B +47.4 pts |
| Terminal-Bench 2.1 | 4.5 | — | — |
| Aider Polyglot | 4.9 | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | — | — | — |
| SciCode | 23.3 | — | — |
| CursorBench | — | — | — |
| SWE-Rebench | 5.4 | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | 1,362 | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,365 | 1,438 | B +73 Elo |
Gemma 3 27B
- Context
- 128K / 8K out
- Parameters
- 27B
- Price
- $0.10 / $0.30
- Speed
- 90 tok/s · 0.28s TTFT
- Modalities
- text, image → text
- License
- Gemma
Open multimodal Gemma 3 mid-size - strong preference Elo for its parameter count.
Gemma 4 26B
- Context
- 256K / 8K out
- Parameters
- 26B (3.8B act.)
- Price
- $0.15 / $0.60
- Speed
- 95 tok/s · 0.28s TTFT
- Modalities
- text, image → text
- License
- Apache 2.0
Open Gemma 4 mid-size instruct model available via Google Cloud Agent Platform and self-host.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.