LLMcompare

Search

Search for a command to run...

A · closed · Other

Mercury 2

Inception Labs

B · open · Other

Olmo 3 7B Instruct

Ai2

5:0

overall capability wins (0 ties across 5 scored). Mercury 2 leads overall.

  • Reasoning4:0
  • Pricing0:3
  • Specs1:0

Verdict

Mercury 2 edges reasoning & knowledge; Mercury 2 offers ~2.0x larger context (128K vs 66K); Olmo 3 7B Instruct ships open weights (Apache 2.0).

  • Mercury 2 edges reasoning & knowledge
  • Mercury 2 offers ~2.0x larger context (128K vs 66K)
  • Olmo 3 7B Instruct ships open weights (Apache 2.0)
  • Olmo 3 7B Instruct is ~3.0x cheaper on a blended token basis than Mercury 2

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Mercury 2
$0.44
Olmo 3 7B Instruct
$0.15

Olmo 3 7B Instruct is about 2.9x cheaper on this workload.

Price per 1M tokens

Full comparison

Organization

Inception Labs

Ai2

Family

Other

Other

License

Proprietary

Apache 2.0

Open weights

No

Yes

Release

Sep 1, 2026

Nov 20, 2025

Knowledge cutoff

-

-

API / provider

Inception Labs

Parasail

Modalities

text → text

text → text

Specs

Context window

128K

66K

A +62K

Max output

-

-

—

Parameters

—

7B

—

Pricing

Input $/1M

$0.25

$0.10

B +$0.15

Output $/1M

$0.75

$0.20

B +$0.55

Blended $/1M (3∶1)

$0.38

$0.13

B +$0.25

Speed

tok/s

-

-

—

TTFT (s)

-

-

—

Reasoning

MMLU-Pro

—

—

—

GPQA Diamond

77.0

40.0

A +37.0 pts

Humanity's Last Exam

17.1

5.8

A +11.3 pts

AIME 2025

—

—

—

MATH-500

—

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

21.2

7.4

A +13.8 pts

AA-LCR v1.1

43.7

—

—

CritPt

0.8

—

—

MMMU-Pro

—

—

—

IFBench

69.8

32.8

A +37.0 pts

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

—

—

—

SWE-bench Pro

—

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

—

—

—

Terminal-Bench 2.1

27.3

—

—

Aider Polyglot

—

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

—

—

—

SciCode

37.7

—

—

CursorBench

—

—

—

SWE-Rebench

—

—

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

1,167

—

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

—

—

—

Mercury 2

Context
128K
Parameters
—
Price
$0.25 / $0.75
Speed
—
Modalities
text → text
License
Proprietary

Inception Labs' diffusion-based (non-autoregressive) reasoning LLM, API-only with a 128K context window and high-throughput inference on Blackwell GPUs.

Olmo 3 7B Instruct

Context
66K
Parameters
7B
Price
$0.10 / $0.20
Speed
—
Modalities
text → text
License
Apache 2.0

Ai2's fully open 7B instruct model from the Olmo 3 family, built on the Dolma 3 pretraining corpus with fully released data, code, and checkpoints.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Reasoning & knowledge

GPQA: A +37.0HLE: A +11.3Omniscience Acc.: A +13.8IFBench: A +37.0

Pick a different pair · Back to catalog