vs
0:2
overall capability wins (2 ties across 4 scored). Gemma 2 9B leads overall.
- Arena0:1
- Pricing3:0
- Speed2:0
- Specs0:1
Verdict
Gemma 2 9B ranks higher on LMArena (+67 Elo); Gemma 2 2B is ~2.0x cheaper on a blended token basis than Gemma 2 9B.
- Gemma 2 9B ranks higher on LMArena (+67 Elo)
- Gemma 2 2B is ~2.0x cheaper on a blended token basis than Gemma 2 9B
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Gemma 2 2B
- $0.05
- Gemma 2 9B
- $0.10
Gemma 2 2B is about 2.0x cheaper on this workload.
Price per 1M tokens
Full comparison
Organization
Family
Gemma
Gemma
License
Gemma
Gemma
Open weights
Yes
Yes
Release
Jul 31, 2024
Jun 27, 2024
Knowledge cutoff
-
-
API / provider
Groq / Together (ref.)
Groq / Together (ref.)
Modalities
text → text
text → text
Specs
Context window
8K
8K
Max output
8K
8K
Parameters
2B
9B
Pricing
Input $/1M
$0.04
$0.08
Output $/1M
$0.04
$0.08
Blended $/1M (3∶1)
$0.04
$0.08
Speed
tok/s
200
140
TTFT (s)
0.12
0.2
Reasoning
MMLU-Pro
—
—
GPQA Diamond
—
—
Humanity's Last Exam
—
—
AIME 2025
—
—
MATH-500
—
—
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
—
—
AA-LCR v1.1
—
—
CritPt
—
—
MMMU-Pro
—
—
IFBench
—
—
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
—
—
Terminal-Bench 2.1
—
—
Aider Polyglot
—
—
Terminal-Bench 3
—
—
BigCodeBench
—
34.7
SciCode
—
—
CursorBench
—
—
SWE-Rebench
—
—
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
1,200
1,267
| Metric | Gemma 2 2B | Gemma 2 9B | Delta |
|---|---|---|---|
| Identity | |||
| Organization | — | ||
| Family | Gemma | Gemma | — |
| License | Gemma | Gemma | — |
| Open weights | Yes | Yes | — |
| Release | Jul 31, 2024 | Jun 27, 2024 | — |
| Knowledge cutoff | - | - | — |
| API / provider | Groq / Together (ref.) | Groq / Together (ref.) | — |
| Modalities | text → text | text → text | — |
| Specs | |||
| Context window | 8K | 8K | tie |
| Max output | 8K | 8K | tie |
| Parameters | 2B | 9B | B +7.00 |
| Pricing | |||
| Input $/1M | $0.04 | $0.08 | A +$0.04 |
| Output $/1M | $0.04 | $0.08 | A +$0.04 |
| Blended $/1M (3∶1) | $0.04 | $0.08 | A +$0.04 |
| Speed | |||
| tok/s | 200 | 140 | A +60 |
| TTFT (s) | 0.12 | 0.2 | A +0.08 |
| Reasoning | |||
| MMLU-Pro | — | — | — |
| GPQA Diamond | — | — | — |
| Humanity's Last Exam | — | — | — |
| AIME 2025 | — | — | — |
| MATH-500 | — | — | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | — | — | — |
| AA-LCR v1.1 | — | — | — |
| CritPt | — | — | — |
| MMMU-Pro | — | — | — |
| IFBench | — | — | — |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | — | — | — |
| Terminal-Bench 2.1 | — | — | — |
| Aider Polyglot | — | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | — | 34.7 | — |
| SciCode | — | — | — |
| CursorBench | — | — | — |
| SWE-Rebench | — | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | 1,200 | 1,267 | B +67 Elo |
Gemma 2 2B
- Context
- 8K / 8K out
- Parameters
- 2B
- Price
- $0.04 / $0.04
- Speed
- 200 tok/s · 0.12s TTFT
- Modalities
- text → text
- License
- Gemma
Tiny open Gemma 2 instruct — ultra-cheap edge and high-throughput classification baseline.
Gemma 2 9B
- Context
- 8K / 8K out
- Parameters
- 9B
- Price
- $0.08 / $0.08
- Speed
- 140 tok/s · 0.2s TTFT
- Modalities
- text → text
- License
- Gemma
Efficient open 9B Gemma 2 instruct — popular local and edge chat baseline.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.