LLMcompare

Search

Search for a command to run...

A · open · Gemma

Gemma 2 27B

Google

B · open · Gemma

Gemma 4 26B

Google

1:2

overall capability wins (1 ties across 4 scored). Gemma 4 26B leads overall.

  • Arena0:1
  • Pricing1:2
  • Speed0:2
  • Specs1:1

Verdict

Gemma 4 26B ranks higher on LMArena (+149 Elo); Gemma 4 26B offers ~31.3x larger context (256K vs 8K).

  • Gemma 4 26B ranks higher on LMArena (+149 Elo)
  • Gemma 4 26B offers ~31.3x larger context (256K vs 8K)

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Gemma 2 27B
$0.34
Gemma 4 26B
$0.30

Gemma 4 26B is about 1.1x cheaper on this workload.

Price per 1M tokens

Full comparison

Organization

Google

Google

Family

Gemma

Gemma

License

Gemma

Apache 2.0

Open weights

Yes

Yes

Release

Jun 27, 2024

Apr 8, 2026

Knowledge cutoff

-

-

API / provider

Groq / Together (ref.)

Google AI / self-host

Modalities

text → text

text, image → text

Specs

Context window

8K

256K

B +248K

Max output

8K

8K

tie

Parameters

27B

26B (3.8B act.)

A +1.00

Pricing

Input $/1M

$0.27

$0.15

B +$0.12

Output $/1M

$0.27

$0.60

A +$0.33

Blended $/1M (3∶1)

$0.27

$0.26

B +$0.008

Speed

tok/s

80

95

B +15

TTFT (s)

0.35

0.28

B +0.07

Reasoning

MMLU-Pro

—

82.6

—

GPQA Diamond

—

82.3

—

Humanity's Last Exam

—

8.7

—

AIME 2025

—

—

—

MATH-500

—

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

—

—

—

AA-LCR v1.1

—

—

—

CritPt

—

—

—

MMMU-Pro

—

—

—

IFBench

—

—

—

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

—

—

—

SWE-bench Pro

—

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

—

77.1

—

Terminal-Bench 2.1

—

—

—

Aider Polyglot

—

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

42.8

—

—

SciCode

—

—

—

CursorBench

—

—

—

SWE-Rebench

—

—

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

—

1,362

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

1,289

1,438

B +149 Elo

Gemma 2 27B

Context
8K / 8K out
Parameters
27B
Price
$0.27 / $0.27
Speed
80 tok/s · 0.35s TTFT
Modalities
text → text
License
Gemma

Google's open 27B instruct model — strong small-model quality before Gemma 3 / 4.

Gemma 4 26B

Context
256K / 8K out
Parameters
26B (3.8B act.)
Price
$0.15 / $0.60
Speed
95 tok/s · 0.28s TTFT
Modalities
text, image → text
License
Apache 2.0

Open Gemma 4 mid-size instruct model available via Google Cloud Agent Platform and self-host.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Arena

Arena Elo: B +149

Pick a different pair · Back to catalog