vs
0:14
overall capability wins (1 ties across 15 scored). Gemma 4 31B leads overall.
- Reasoning0:7
- Coding0:3
- Arena0:1
- Tool use0:1
- Pricing3:0
- Speed2:0
- Specs0:2
Verdict
Gemma 4 31B leads coding (widest gap: +67.4 on LiveCode); Gemma 4 31B ranks higher on LMArena (+148 Elo); Gemma 4 31B offers ~2.0x larger context (256K vs 128K).
- Gemma 4 31B leads coding (widest gap: +67.4 on LiveCode)
- Gemma 4 31B ranks higher on LMArena (+148 Elo)
- Gemma 4 31B offers ~2.0x larger context (256K vs 128K)
- Gemma 3 4B is ~3.0x cheaper on a blended token basis than Gemma 4 31B
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Gemma 3 4B
- $0.06
- Gemma 4 31B
- $0.17
Gemma 3 4B is about 2.9x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
Family
Gemma
Gemma
License
Gemma
Apache 2.0
Open weights
Yes
Yes
Release
Mar 12, 2025
Apr 8, 2026
Knowledge cutoff
-
-
API / provider
Together / Fireworks (ref.)
Google AI / self-host
Modalities
text, image → text
text, image → text
Specs
Context window
128K
256K
Max output
8K
8K
Parameters
4B
31B
Pricing
Input $/1M
$0.04
$0.10
Output $/1M
$0.08
$0.30
Blended $/1M (3∶1)
$0.05
$0.15
Speed
tok/s
160
85
TTFT (s)
0.18
0.3
Reasoning
MMLU-Pro
43.6
85.2
GPQA Diamond
29.1
85.7
Humanity's Last Exam
5.3
23.6
AIME 2025
12.7
—
MATH-500
76.6
—
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
7.7
20.0
AA-LCR v1.1
6.7
69.7
CritPt
—
1.4
MMMU-Pro
29.9
73.4
IFBench
28.3
75.6
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
12.6
80.0
Terminal-Bench 2.1
0.4
43.4
Aider Polyglot
—
—
Terminal-Bench 3
—
—
BigCodeBench
—
—
SciCode
7.3
45.5
CursorBench
—
—
SWE-Rebench
—
25.1
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
1,364
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,303
1,451
| Metric | Gemma 3 4B | Gemma 4 31B | Delta |
|---|---|---|---|
| Identity | |||
| Organization | — | ||
| Family | Gemma | Gemma | — |
| License | Gemma | Apache 2.0 | — |
| Open weights | Yes | Yes | — |
| Release | Mar 12, 2025 | Apr 8, 2026 | — |
| Knowledge cutoff | - | - | — |
| API / provider | Together / Fireworks (ref.) | Google AI / self-host | — |
| Modalities | text, image → text | text, image → text | — |
| Specs | |||
| Context window | 128K | 256K | B +128K |
| Max output | 8K | 8K | tie |
| Parameters | 4B | 31B | B +27 |
| Pricing | |||
| Input $/1M | $0.04 | $0.10 | A +$0.06 |
| Output $/1M | $0.08 | $0.30 | A +$0.22 |
| Blended $/1M (3∶1) | $0.05 | $0.15 | A +$0.10 |
| Speed | |||
| tok/s | 160 | 85 | A +75 |
| TTFT (s) | 0.18 | 0.3 | A +0.12 |
| Reasoning | |||
| MMLU-Pro | 43.6 | 85.2 | B +41.6 pts |
| GPQA Diamond | 29.1 | 85.7 | B +56.6 pts |
| Humanity's Last Exam | 5.3 | 23.6 | B +18.3 pts |
| AIME 2025 | 12.7 | — | — |
| MATH-500 | 76.6 | — | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | 7.7 | 20.0 | B +12.3 pts |
| AA-LCR v1.1 | 6.7 | 69.7 | B +63.0 pts |
| CritPt | — | 1.4 | — |
| MMMU-Pro | 29.9 | 73.4 | B +43.5 pts |
| IFBench | 28.3 | 75.6 | B +47.3 pts |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | 12.6 | 80.0 | B +67.4 pts |
| Terminal-Bench 2.1 | 0.4 | 43.4 | B +43.0 pts |
| Aider Polyglot | — | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | — | — | — |
| SciCode | 7.3 | 45.5 | B +38.2 pts |
| CursorBench | — | — | — |
| SWE-Rebench | — | 25.1 | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | 1,364 | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,303 | 1,451 | B +148 Elo |
Gemma 3 4B
- Context
- 128K / 8K out
- Parameters
- 4B
- Price
- $0.04 / $0.08
- Speed
- 160 tok/s · 0.18s TTFT
- Modalities
- text, image → text
- License
- Gemma
Small multimodal Gemma 3 with long context — strong on-device and edge deployment option.
Gemma 4 31B
- Context
- 256K / 8K out
- Parameters
- 31B
- Price
- $0.10 / $0.30
- Speed
- 85 tok/s · 0.3s TTFT
- Modalities
- text, image → text
- License
- Apache 2.0
Open-weight Gemma 4 instruction model - strong mid-size open alternative under Apache 2.0.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.