LLMcompare

Search

Search for a command to run...

A · open · Granite

Granite 3.1 8B Instruct

IBM

B · open · Granite

Granite 4.1 8B

IBM

0:2

overall capability wins (2 ties across 4 scored). Granite 4.1 8B leads overall.

  • Arena0:1
  • Speed0:2
  • Specs0:1

Verdict

Granite 4.1 8B ranks higher on LMArena (+98 Elo); Granite 4.1 8B offers larger context (131K vs 128K).

  • Granite 4.1 8B ranks higher on LMArena (+98 Elo)
  • Granite 4.1 8B offers larger context (131K vs 128K)

Cost for 1M in + 250K out

Illustrative chat workload at primary-provider list prices.

Granite 3.1 8B Instruct
$0.08
Granite 4.1 8B
$0.08

Price per 1M tokens

Full comparison

Organization

IBM

IBM

Family

Granite

Granite

License

Apache 2.0

Apache 2.0

Open weights

Yes

Yes

Release

Dec 18, 2024

Apr 30, 2026

Knowledge cutoff

-

-

API / provider

IBM watsonx

IBM watsonx

Modalities

text → text

text → text

Specs

Context window

128K

131K

B +3K

Max output

8K

8K

tie

Parameters

8B

8B

tie

Pricing

Input $/1M

$0.05

$0.05

tie

Output $/1M

$0.10

$0.10

tie

Blended $/1M (3∶1)

$0.06

$0.06

tie

Speed

tok/s

110

117

B +7.00

TTFT (s)

0.15

0.13

B +0.02

Reasoning

MMLU-Pro

—

—

—

GPQA Diamond

—

43.3

—

Humanity's Last Exam

—

3.8

—

AIME 2025

—

—

—

MATH-500

—

—

—

Humanity's Last Exam (with tools)

—

—

—

AA-Omniscience Accuracy

—

12.3

—

AA-LCR v1.1

—

13.3

—

CritPt

—

—

—

MMMU-Pro

—

—

—

IFBench

—

38.6

—

Chartography

—

—

—

Chartography (With Tools)

—

—

—

Coding

SWE-bench Verified

—

—

—

SWE-bench Pro

—

—

—

SWE-bench Multilingual

—

—

—

LiveCodeBench

—

—

—

Terminal-Bench 2.1

—

3.4

—

Aider Polyglot

—

—

—

Terminal-Bench 3

—

—

—

BigCodeBench

—

—

—

SciCode

—

21.8

—

CursorBench

—

—

—

SWE-Rebench

—

—

—

NL2Repo-Bench

—

—

—

DeepSWE

—

—

—

WebDev Arena

—

1,192

—

Terminal-Bench 4.0

—

—

—

CursorBench 4.0

—

—

—

FrontierCode v1.1 (Main)

—

—

—

Arena

LMArena Elo

1,208

1,306

B +98 Elo

Granite 3.1 8B Instruct

Context
128K / 8K out
Parameters
8B
Price
$0.05 / $0.10
Speed
110 tok/s · 0.15s TTFT
Modalities
text → text
License
Apache 2.0

Prior-gen IBM Granite 3.1 8B instruct — enterprise RAG and tool-calling baseline on watsonx before Granite 4.

Granite 4.1 8B

Context
131K / 8K out
Parameters
8B
Price
$0.05 / $0.10
Speed
117 tok/s · 0.13s TTFT
Modalities
text → text
License
Apache 2.0

Token-efficient IBM enterprise 8B with tool calling and fill-in-the-middle code support under Apache 2.0.

Benchmark charts

Winner bars are emphasized. Per-benchmark deltas sit above each chart.

Arena

Arena Elo: B +98

Pick a different pair · Back to catalog