LLMcompare

Search

Search for a command to run...

A · closed · Other

Mercury 2

Inception Labs

B · open · Other

Olmo 3.1 32B Instruct

Ai2

5:0

overall capability wins (0 ties across 5 scored). Mercury 2 leads overall.

  • Reasoning4:0
  • Specs1:0

Verdict

Mercury 2 edges reasoning & knowledge; Mercury 2 offers ~2.0x larger context (128K vs 66K); Olmo 3.1 32B Instruct ships open weights (Apache 2.0).

  • Mercury 2 edges reasoning & knowledge
  • Mercury 2 offers ~2.0x larger context (128K vs 66K)
  • Olmo 3.1 32B Instruct ships open weights (Apache 2.0)

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Mercury 2
$0.44
Olmo 3.1 32B Instruct
-

Price per 1M tokens

Full comparison

Organization

Inception Labs

Ai2

Family

Other

Other

License

Proprietary

Apache 2.0

Open weights

No

Yes

Release

Sep 1, 2026

Dec 11, 2025

Knowledge cutoff

-

-

API / provider

Inception Labs

No primary API price listed

Modalities

text → text

text → text

Specs

Context window

128K

66K

A +62K

Max output

-

-

—

Parameters

—

32B

—

Pricing

Input $/1M

$0.25

—

—

Output $/1M

$0.75

—

—

Blended $/1M (3∶1)

$0.38

-

—

Speed

tok/s

-

-

—

TTFT (s)

-

-

—

Reasoning

MMLU-Pro

—

—

—

GPQA Diamond

77.0

53.9

A +23.1 pts

Humanity's Last Exam

17.1

5.0

A +12.1 pts

AIME 2025

—

—

—

MATH-500

—

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

21.2

12.0

A +9.2 pts

AA-LCR v1.1

43.7

—

—

CritPt

0.8

—

—

MMMU-Pro

—

—

—

IFBench

69.8

39.2

A +30.6 pts

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

—

—

—

SWE-bench Pro

—

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

—

—

—

Terminal-Bench 2.1

27.3

—

—

Aider Polyglot

—

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

—

—

—

SciCode

37.7

—

—

CursorBench

—

—

—

SWE-Rebench

—

—

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

1,167

—

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

—

—

—

Mercury 2

Context
128K
Parameters
—
Price
$0.25 / $0.75
Speed
—
Modalities
text → text
License
Proprietary

Inception Labs' diffusion-based (non-autoregressive) reasoning LLM, API-only with a 128K context window and high-throughput inference on Blackwell GPUs.

Olmo 3.1 32B Instruct

Context
66K
Parameters
32B
Price
—
Speed
—
Modalities
text → text
License
Apache 2.0

Ai2's strongest fully open 32B-scale instruct model, applying the Olmo 3 Instruct post-training recipe to a larger base; no hosted API yet.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Reasoning & knowledge

GPQA: A +23.1HLE: A +12.1Omniscience Acc.: A +9.2IFBench: A +30.6

Pick a different pair · Back to catalog