LLMcompare

Search

Search for a command to run...

A · closed · Gemini

Gemini 2.5 Pro

Google

B · closed · Gemini

Gemini 3.8 Flash

Google

0:12

overall capability wins (1 ties across 13 scored). Gemini 3.8 Flash leads overall.

  • Reasoning0:6
  • Coding0:3
  • Arena0:1
  • Tool use0:1
  • Composite indices0:2
  • Pricing0:3
  • Specs0:1

Verdict

Gemini 3.8 Flash leads coding (widest gap: +341.3 on WebDev Elo); Gemini 3.8 Flash ranks higher on LMArena (+48 Elo); Gemini 3.8 Flash offers larger context (1.0M vs 1M).

  • Gemini 3.8 Flash leads coding (widest gap: +341.3 on WebDev Elo)
  • Gemini 3.8 Flash ranks higher on LMArena (+48 Elo)
  • Gemini 3.8 Flash offers larger context (1.0M vs 1M)
  • Gemini 3.8 Flash is ~2.3x cheaper on a blended token basis than Gemini 2.5 Pro

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Gemini 2.5 Pro
$3.75
Gemini 3.8 Flash
$1.69

Gemini 3.8 Flash is about 2.2x cheaper on this workload.

Price per 1M tokens

Full comparison

Organization

Google

Google

Family

Gemini

Gemini

License

Proprietary

Proprietary

Open weights

No

No

Release

Mar 25, 2025

Sep 2, 2026

Knowledge cutoff

-

2026-03

API / provider

Google

Google

Modalities

text, image, audio, video → text

text, image, audio, video → text

Specs

Context window

1M

1.0M

B +49K

Max output

66K

66K

tie

Parameters

—

—

—

Pricing

Input $/1M

$1.25

$0.75

B +$0.50

Output $/1M

$10

$3.75

B +$6.25

Blended $/1M (3∶1)

$3.44

$1.50

B +$1.94

Speed

tok/s

100

-

—

TTFT (s)

0.45

-

—

Reasoning

MMLU-Pro

86.2

—

—

GPQA Diamond

84.4

95.3

B +10.9 pts

Humanity's Last Exam

22.5

47.8

B +25.3 pts

AIME 2025

87.7

—

—

MATH-500

96.7

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

39.1

54.6

B +15.5 pts

AA-LCR v1.1

69.0

81.3

B +12.3 pts

CritPt

2.6

18.3

B +15.7 pts

MMMU-Pro

74.9

85.6

B +10.7 pts

IFBench

48.7

—

—

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

53.6

—

—

SWE-bench Pro

—

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

80.1

—

—

Terminal-Bench 2.1

28.5

87.6

B +59.1 pts

Aider Polyglot

79.1

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

—

—

—

SciCode

46.3

56.6

B +10.3 pts

CursorBench

—

69.2

—

SWE-Rebench

23.5

—

—

NL2Repo-Bench

—

—

—

DeepSWE

—

73.7

—

WebDev Arena

1,226

1,567

B +341 Elo

Terminal-Bench 4.0

—

19.1

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

1,446

1,493

B +48 Elo

Gemini 2.5 Pro

Context
1M / 66K out
Parameters
—
Price
$1.25 / $10
Speed
100 tok/s · 0.45s TTFT
Modalities
text, image, audio, video → text
License
Proprietary

Previous-gen Google Pro model; still a capable long-context multimodal option at competitive rates.

Gemini 3.8 Flash

Context
1.0M / 66K out
Parameters
—
Price
$0.75 / $3.75
Speed
—
Modalities
text, image, audio, video → text
License
Proprietary

Google's Sep 2, 2026 Flash update over 3.7 Flash - gains on long-horizon software engineering, agentic knowledge work, and computer use; introductory $0.75/$3.75 through Dec 31, 2026 (then $1.50/$7.50).

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Reasoning & knowledge

GPQA: B +10.9HLE: B +25.3CritPt: B +15.7AA-LCR: B +12.3Omniscience Acc.: B +15.5MMMU-Pro: B +10.7

Coding

TermBench: B +59.1SciCode: B +10.3WebDev Elo: B +341

Tool use & function calling

τ³-Banking: B +35.2

Arena

Arena Elo: B +48

Composite indices

AA Index: B +30.4AA Index v4.3: B +24.5

Pick a different pair · Back to catalog