vs
5:0
overall capability wins (0 ties across 5 scored). Agnes-3.0-Flash Preview leads overall.
- Reasoning2:0
- Coding1:0
- Specs2:0
Verdict
Agnes-3.0-Flash Preview leads coding (widest gap: +30.1 on SciCode); Agnes-3.0-Flash Preview offers ~64.0x larger context (262K vs 4K).
- Agnes-3.0-Flash Preview leads coding (widest gap: +30.1 on SciCode)
- Agnes-3.0-Flash Preview offers ~64.0x larger context (262K vs 4K)
Cost for 1M in + 250K out
Illustrative chat workload at primary-provider list prices.
- Agnes-3.0-Flash Preview
- -
- OLMo 2 32B
- $0.50
Price per 1M tokens
Full comparison
Organization
Agnes AI
Ai2
Family
Other
Other
License
Apache 2.0
Apache 2.0
Open weights
Yes
Yes
Release
Sep 13, 2026
Jan 7, 2025
Knowledge cutoff
-
-
API / provider
No primary API price listed
Together / Fireworks (ref.)
Modalities
text, image, video → text
text → text
Specs
Context window
262K
4K
Max output
-
4K
Parameters
33B
32B
Pricing
Input $/1M
—
$0.40
Output $/1M
—
$0.40
Blended $/1M (3∶1)
-
$0.40
Speed
tok/s
-
55
TTFT (s)
-
0.45
Reasoning
MMLU-Pro
—
51.1
GPQA Diamond
85.0
32.8
Humanity's Last Exam
—
3.6
AIME 2025
—
3.3
MATH-500
—
—
Humanity's Last Exam (with tools)
—
—
AA-Omniscience Accuracy
23.0
—
AA-LCR v1.1
68.3
—
CritPt
—
—
MMMU-Pro
—
—
IFBench
74.2
38.1
Chartography
—
—
Chartography (With Tools)
—
—
Coding
SWE-bench Verified
—
—
SWE-bench Pro
—
—
SWE-bench Multilingual
—
—
LiveCodeBench
—
6.8
Terminal-Bench 2.1
—
—
Aider Polyglot
—
—
Terminal-Bench 3
—
—
BigCodeBench
—
—
SciCode
38.1
8.0
CursorBench
—
—
SWE-Rebench
—
—
NL2Repo-Bench
—
—
DeepSWE
—
—
WebDev Arena
—
—
Terminal-Bench 4.0
—
—
CursorBench 4.0
—
—
FrontierCode v1.1 (Main)
—
—
Arena
LMArena Elo
—
—
| Metric | Agnes-3.0-Flash Preview | OLMo 2 32B | Delta |
|---|---|---|---|
| Identity | |||
| Organization | Agnes AI | Ai2 | — |
| Family | Other | Other | — |
| License | Apache 2.0 | Apache 2.0 | — |
| Open weights | Yes | Yes | — |
| Release | Sep 13, 2026 | Jan 7, 2025 | — |
| Knowledge cutoff | - | - | — |
| API / provider | No primary API price listed | Together / Fireworks (ref.) | — |
| Modalities | text, image, video → text | text → text | — |
| Specs | |||
| Context window | 262K | 4K | A +258K |
| Max output | - | 4K | — |
| Parameters | 33B | 32B | A +1.00 |
| Pricing | |||
| Input $/1M | — | $0.40 | — |
| Output $/1M | — | $0.40 | — |
| Blended $/1M (3∶1) | - | $0.40 | — |
| Speed | |||
| tok/s | - | 55 | — |
| TTFT (s) | - | 0.45 | — |
| Reasoning | |||
| MMLU-Pro | — | 51.1 | — |
| GPQA Diamond | 85.0 | 32.8 | A +52.3 pts |
| Humanity's Last Exam | — | 3.6 | — |
| AIME 2025 | — | 3.3 | — |
| MATH-500 | — | — | — |
| Humanity's Last Exam (with tools) | — | — | — |
| AA-Omniscience Accuracy | 23.0 | — | — |
| AA-LCR v1.1 | 68.3 | — | — |
| CritPt | — | — | — |
| MMMU-Pro | — | — | — |
| IFBench | 74.2 | 38.1 | A +36.1 pts |
| Chartography | — | — | — |
| Chartography (With Tools) | — | — | — |
| Coding | |||
| SWE-bench Verified | — | — | — |
| SWE-bench Pro | — | — | — |
| SWE-bench Multilingual | — | — | — |
| LiveCodeBench | — | 6.8 | — |
| Terminal-Bench 2.1 | — | — | — |
| Aider Polyglot | — | — | — |
| Terminal-Bench 3 | — | — | — |
| BigCodeBench | — | — | — |
| SciCode | 38.1 | 8.0 | A +30.1 pts |
| CursorBench | — | — | — |
| SWE-Rebench | — | — | — |
| NL2Repo-Bench | — | — | — |
| DeepSWE | — | — | — |
| WebDev Arena | — | — | — |
| Terminal-Bench 4.0 | — | — | — |
| CursorBench 4.0 | — | — | — |
| FrontierCode v1.1 (Main) | — | — | — |
| Arena | |||
| LMArena Elo | — | — | — |
Agnes-3.0-Flash Preview
- Context
- 262K
- Parameters
- 33B
- Price
- —
- Speed
- —
- Modalities
- text, image, video → text
- License
- Apache 2.0
Agnes AI's (Sapiens AI, Singapore) first open-weight release: a 33B-parameter hybrid-attention model (54 gated delta-rule recurrent layers alternating with 18 global-attention layers, 3:1) under Apache 2.0, with a 262K-token context window and text/image/video input. This open-weight Preview checkpoint is distinct from Agnes AI's production "Agnes 3.0 Flash" API model, which runs a different checkpoint and is not open-weight; the two should not be conflated.
OLMo 2 32B
- Context
- 4K / 4K out
- Parameters
- 32B
- Price
- $0.40 / $0.40
- Speed
- 55 tok/s · 0.45s TTFT
- Modalities
- text → text
- License
- Apache 2.0
Fully open Ai2 OLMo 2 instruct — transparent training data and evals before OLMo 3.
Benchmark charts
Winner bars are emphasized. Per-benchmark deltas sit above each chart.