vs
5:0
overall capability wins (0 ties across 5 scored). Agnes-3.0-Flash Preview leads overall.
- Reasoning3:0
- Specs2:0
Verdict
Agnes-3.0-Flash Preview edges reasoning & knowledge; Agnes-3.0-Flash Preview offers ~4.0x larger context (262K vs 66K).
- Agnes-3.0-Flash Preview edges reasoning & knowledge
- Agnes-3.0-Flash Preview offers ~4.0x larger context (262K vs 66K)
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Agnes-3.0-Flash Preview
- -
- Olmo 3.1 32B Instruct
- -
Price per 1M tokens
Full comparison
Organization
Agnes AI
Ai2
Family
Other
Other
License
Apache 2.0
Apache 2.0
Open weights
Yes
Yes
Release
Sep 13, 2026
Dec 11, 2025
Knowledge cutoff
-
-
API / provider
No primary API price listed
No primary API price listed
Modalities
text, image, video → text
text → text
Specs
Context window
262K
66K
Max output
-
-
Parameters
33B
32B
Pricing
Input $/1M
—
—
Output $/1M
—
—
Blended $/1M (3∶1)
-
-
Speed
tok/s
-
-
TTFT (s)
-
-
Reasoning
MMLU-Pro
—
—
GPQA Diamond
85.0
53.9
Humanity's Last Exam
—
5.0
AIME 2025
—
—
MATH-500
—
—
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
23.0
12.0
AA-LCR v1.1
68.3
—
CritPt
—
—
MMMU-Pro
—
—
IFBench
74.2
39.2
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
—
—
Terminal-Bench 2.1
—
—
Aider Polyglot
—
—
Terminal-Bench 3
—
—
BigCodeBench
—
—
SciCode
38.1
—
CursorBench
—
—
SWE-Rebench
—
—
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
—
—
| Metric | Agnes-3.0-Flash Preview | Olmo 3.1 32B Instruct | Delta |
|---|---|---|---|
| Identity | |||
| Organization | Agnes AI | Ai2 | — |
| Family | Other | Other | — |
| License | Apache 2.0 | Apache 2.0 | — |
| Open weights | Yes | Yes | — |
| Release | Sep 13, 2026 | Dec 11, 2025 | — |
| Knowledge cutoff | - | - | — |
| API / provider | No primary API price listed | No primary API price listed | — |
| Modalities | text, image, video → text | text → text | — |
| Specs | |||
| Context window | 262K | 66K | A +197K |
| Max output | - | - | — |
| Parameters | 33B | 32B | A +1.00 |
| Pricing | |||
| Input $/1M | — | — | — |
| Output $/1M | — | — | — |
| Blended $/1M (3∶1) | - | - | — |
| Speed | |||
| tok/s | - | - | — |
| TTFT (s) | - | - | — |
| Reasoning | |||
| MMLU-Pro | — | — | — |
| GPQA Diamond | 85.0 | 53.9 | A +31.1 pts |
| Humanity's Last Exam | — | 5.0 | — |
| AIME 2025 | — | — | — |
| MATH-500 | — | — | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | 23.0 | 12.0 | A +11.0 pts |
| AA-LCR v1.1 | 68.3 | — | — |
| CritPt | — | — | — |
| MMMU-Pro | — | — | — |
| IFBench | 74.2 | 39.2 | A +35.0 pts |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | — | — | — |
| Terminal-Bench 2.1 | — | — | — |
| Aider Polyglot | — | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | — | — | — |
| SciCode | 38.1 | — | — |
| CursorBench | — | — | — |
| SWE-Rebench | — | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | — | — | — |
Agnes-3.0-Flash Preview
- Context
- 262K
- Parameters
- 33B
- Price
- —
- Speed
- —
- Modalities
- text, image, video → text
- License
- Apache 2.0
Agnes AI's (Sapiens AI, Singapore) first open-weight release: a 33B-parameter hybrid-attention model (54 gated delta-rule recurrent layers alternating with 18 global-attention layers, 3:1) under Apache 2.0, with a 262K-token context window and text/image/video input. This open-weight Preview checkpoint is distinct from Agnes AI's production "Agnes 3.0 Flash" API model, which runs a different checkpoint and is not open-weight; the two should not be conflated.
Olmo 3.1 32B Instruct
- Context
- 66K
- Parameters
- 32B
- Price
- —
- Speed
- —
- Modalities
- text → text
- License
- Apache 2.0
Ai2's strongest fully open 32B-scale instruct model, applying the Olmo 3 Instruct post-training recipe to a larger base; no hosted API yet.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.