LLMcompare only
LLMcompare Index
A single derived ranking across the 25well-covered benchmarks in this catalog. This is not a published benchmark score, has no external leaderboard, and exists only here — it's computed from the sourced scores on this site.
Methodology
Each eligible benchmark's scores are z-score normalized against models released in the past 12 months (since 2025-09-29), not against the full catalog. That stops older models from farming the index by beating a long tail of retired systems on saturated exams. The index is a shrunken mean of published z-scores: sum(z) / (n + 6), where 6 dummy average results pull incomplete coverage toward the peer mean without treating every missing bench as exactly average. A short brochure set still cannot outrank a broader evaluation. Saturated benches and benches scored on fewer than ten peer models are excluded. Lower-is-better benches are inverted so a higher index is always better.
A model needs published scores on at least 3 eligible benchmarks to receive an index at all. The benchmark count is shown next to every model, and every contributing score is listed so nothing is hidden behind the index number. The index also inherits each benchmark's own caveats: several are agent-system evaluations rather than model-only measurements.
- Metric
- Shrunken mean z-score (k=6)sum(published z) / (n + k); k dummy average results shrink thin coverage toward 0
- Direction
- Higher is better
- Peer set
- Models released since 2025-09-2912-month window vs catalog snapshot
- Benchmarks included
- MMLU-Pro, GPQA, HLE, AIME, SWE-Pro, LiveCode, TermBench, TermBench 3, SciCode, CursorBench, SWE-Rebench, DeepSWE, Toolathlon V., ALE, AutoBench, WebDev Elo, Arena Elo, TermBench 4, TB-Science, GDPval-AA, Omniscience Acc., AA-LCR, CritPt, τ³-Banking, IFBench
- Min. coverage
- 3 of 25 benchmarks
- Coverage
- 224 / 318Models in this catalog with enough published scores for an index
- Updated
- Catalog snapshot date
Index ranking
- GPQA: 93.7%
- HLE: 59.0%
- TermBench: 91.4%
- SciCode: 63.0%
- CursorBench: 73.4%
- DeepSWE: 67.4%
- AutoBench: 31.4%
- WebDev Elo: 1,758
- Arena Elo: 1,499
- TermBench 4: 57.9%
- TB-Science: 52.6%
- GDPval-AA: 1,853
- Omniscience Acc.: 67.2%
- AA-LCR: 83.0%
- CritPt: 29.7%
- τ³-Banking: 47.2%
- GPQA: 96.1%
- HLE: 55.0%
- TermBench: 88.4%
- SciCode: 56.0%
- DeepSWE: 74.1%
- ALE: 59.3%
- AutoBench: 41.4%
- TermBench 4: 58.2%
- TB-Science: 64.6%
- Omniscience Acc.: 62.6%
- AA-LCR: 81.0%
- CritPt: 31.7%
- τ³-Banking: 41.4%
- GPQA: 93.2%
- HLE: 54.9%
- TermBench: 89.1%
- TermBench 3: 42.7%
- SciCode: 56.4%
- CursorBench: 70.0%
- SWE-Rebench: 63.4%
- DeepSWE: 73.7%
- ALE: 55.5%
- AutoBench: 26.9%
- WebDev Elo: 1,687
- Arena Elo: 1,493
- TermBench 4: 51.8%
- TB-Science: 30.0%
- GDPval-AA: 1,824
- Omniscience Acc.: 60.9%
- AA-LCR: 79.3%
- CritPt: 29.1%
- τ³-Banking: 42.1%
- GPQA: 92.6%
- HLE: 55.5%
- SWE-Pro: 80.0%
- TermBench: 84.6%
- TermBench 3: 34.1%
- SciCode: 61.0%
- CursorBench: 70.5%
- SWE-Rebench: 64.5%
- DeepSWE: 69.9%
- ALE: 48.7%
- AutoBench: 17.4%
- WebDev Elo: 1,628
- Arena Elo: 1,506
- TermBench 4: 44.6%
- TB-Science: 21.4%
- Omniscience Acc.: 65.4%
- AA-LCR: 82.3%
- CritPt: 28.6%
- τ³-Banking: 38.1%
- IFBench: 63.5%
- HLE: 61.4%
- SciCode: 66.9%
- AutoBench: 40.0%
- TermBench 4: 66.4%
- TB-Science: 58.7%
- GPQA: 93.5%
- HLE: 48.7%
- TermBench: 85.8%
- SciCode: 58.8%
- GDPval-AA: 1,754
- Omniscience Acc.: 43.6%
- AA-LCR: 83.0%
- CritPt: 24.9%
- τ³-Banking: 50.5%
- GPQA: 94.1%
- HLE: 49.5%
- SWE-Pro: 64.6%
- TermBench: 88.0%
- TermBench 3: 34.6%
- SciCode: 57.1%
- CursorBench: 67.2%
- SWE-Rebench: 62.3%
- DeepSWE: 72.7%
- ALE: 53.6%
- AutoBench: 18.1%
- WebDev Elo: 1,617
- Arena Elo: 1,484
- TermBench 4: 37.3%
- TB-Science: 22.4%
- GDPval-AA: 1,710
- Omniscience Acc.: 59.4%
- AA-LCR: 84.0%
- CritPt: 32.3%
- τ³-Banking: 44.3%
- IFBench: 72.7%
- GPQA: 93.5%
- HLE: 46.9%
- TermBench: 85.0%
- SciCode: 59.5%
- CursorBench: 60.8%
- DeepSWE: 69.0%
- Toolathlon V.: 76.5%
- WebDev Elo: 1,674
- Arena Elo: 1,485
- TB-Science: 7.1%
- GDPval-AA: 1,668
- Omniscience Acc.: 47.6%
- AA-LCR: 88.7%
- CritPt: 23.4%
- τ³-Banking: 46.0%
- GPQA: 92.6%
- HLE: 32.5%
- AIME: 97.0%
- SWE-Pro: 80.0%
- LiveCode: 88.1%
- TermBench: 83.8%
- TermBench 3: 34.1%
- CursorBench: 70.5%
- GPQA: 89.8%
- HLE: 46.2%
- TermBench: 77.9%
- SciCode: 58.8%
- Toolathlon V.: 75.6%
- WebDev Elo: 1,542
- Arena Elo: 1,493
- Omniscience Acc.: 52.1%
- AA-LCR: 77.7%
- CritPt: 15.1%
- τ³-Banking: 31.8%
- GPQA: 93.5%
- HLE: 45.8%
- SWE-Pro: 58.6%
- TermBench: 84.3%
- SciCode: 55.8%
- CursorBench: 58.4%
- SWE-Rebench: 62.7%
- DeepSWE: 67.0%
- Toolathlon V.: 73.5%
- WebDev Elo: 1,510
- Arena Elo: 1,476
- GDPval-AA: 1,482
- Omniscience Acc.: 58.0%
- AA-LCR: 84.3%
- CritPt: 27.1%
- τ³-Banking: 39.0%
- IFBench: 75.9%
- GPQA: 91.2%
- HLE: 39.9%
- TermBench: 84.3%
- SciCode: 51.6%
- DeepSWE: 63.0%
- Toolathlon V.: 78.4%
- WebDev Elo: 1,607
- Arena Elo: 1,475
- GDPval-AA: 1,765
- Omniscience Acc.: 27.5%
- AA-LCR: 80.0%
- CritPt: 15.4%
- τ³-Banking: 47.2%
- GPQA: 91.7%
- HLE: 42.3%
- TermBench: 83.9%
- TermBench 3: 28.3%
- SciCode: 59.0%
- DeepSWE: 66.9%
- Toolathlon V.: 73.0%
- ALE: 28.5%
- AutoBench: 48.2%
- WebDev Elo: 1,614
- Arena Elo: 1,483
- TermBench 4: 41.8%
- TB-Science: 8.1%
- GDPval-AA: 1,758
- Omniscience Acc.: 33.9%
- AA-LCR: 79.7%
- CritPt: 19.1%
- τ³-Banking: 50.3%
- GPQA: 92.8%
- HLE: 43.1%
- SWE-Pro: 67.7%
- TermBench: 81.3%
- SciCode: 52.1%
- DeepSWE: 56.6%
- Toolathlon V.: 72.5%
- AutoBench: 27.3%
- WebDev Elo: 1,671
- Arena Elo: 1,481
- GDPval-AA: 1,721
- Omniscience Acc.: 31.7%
- AA-LCR: 80.3%
- CritPt: 17.7%
- τ³-Banking: 47.8%
- GPQA: 94.9%
- HLE: 42.9%
- TermBench: 88.4%
- TermBench 3: 26.5%
- SciCode: 56.5%
- CursorBench: 70.8%
- DeepSWE: 67.0%
- WebDev Elo: 1,618
- Arena Elo: 1,456
- TermBench 4: 20.3%
- TB-Science: 7.1%
- GDPval-AA: 1,755
- Omniscience Acc.: 48.2%
- AA-LCR: 80.3%
- CritPt: 17.1%
- τ³-Banking: 50.7%
- GPQA: 92.0%
- HLE: 43.7%
- SWE-Pro: 57.7%
- TermBench: 78.3%
- SciCode: 56.6%
- SWE-Rebench: 57.6%
- WebDev Elo: 1,387
- Arena Elo: 1,466
- Omniscience Acc.: 50.8%
- AA-LCR: 82.0%
- CritPt: 23.4%
- τ³-Banking: 39.6%
- IFBench: 73.9%
- GPQA: 95.3%
- HLE: 47.8%
- TermBench: 87.6%
- SciCode: 56.6%
- CursorBench: 69.2%
- DeepSWE: 73.7%
- WebDev Elo: 1,567
- Arena Elo: 1,493
- TermBench 4: 19.1%
- TB-Science: 12.4%
- GDPval-AA: 1,545
- Omniscience Acc.: 54.6%
- AA-LCR: 81.3%
- CritPt: 18.3%
- τ³-Banking: 44.9%
- GPQA: 90.4%
- HLE: 45.5%
- TermBench: 80.1%
- SciCode: 57.4%
- DeepSWE: 55.0%
- Toolathlon V.: 75.9%
- WebDev Elo: 1,535
- Arena Elo: 1,500
- GDPval-AA: 1,615
- Omniscience Acc.: 45.4%
- AA-LCR: 79.0%
- CritPt: 17.7%
- τ³-Banking: 34.8%
- GPQA: 92.3%
- HLE: 38.0%
- TermBench: 86.1%
- SciCode: 50.6%
- WebDev Elo: 1,635
- GDPval-AA: 1,743
- Omniscience Acc.: 24.5%
- AA-LCR: 79.7%
- CritPt: 11.1%
- τ³-Banking: 45.4%
- HLE: 43.0%
- SciCode: 57.0%
- AutoBench: 66.0%
- TermBench 4: 26.0%
- AA-LCR: 77.0%
- CritPt: 18.0%
- GPQA: 92.3%
- SWE-Pro: 65.7%
- TermBench: 85.4%
- DeepSWE: 64.3%
- Toolathlon V.: 74.1%
- WebDev Elo: 1,624
- HLE: 48.0%
- SciCode: 58.0%
- DeepSWE: 68.8%
- ALE: 56.4%
- AutoBench: 33.2%
- TermBench 4: 44.0%
- AA-LCR: 84.0%
- HLE: 39.2%
- SciCode: 51.9%
- WebDev Elo: 1,620
- Omniscience Acc.: 46.4%
- AA-LCR: 84.0%
- CritPt: 14.3%
- GPQA: 92.5%
- HLE: 42.9%
- SWE-Pro: 63.4%
- TermBench: 88.0%
- TermBench 3: 20.8%
- SciCode: 55.0%
- CursorBench: 64.9%
- WebDev Elo: 1,521
- Arena Elo: 1,466
- TermBench 4: 21.5%
- TB-Science: 8.6%
- GDPval-AA: 1,566
- Omniscience Acc.: 46.8%
- AA-LCR: 83.0%
- CritPt: 30.0%
- τ³-Banking: 40.2%
- IFBench: 71.2%
- GPQA: 91.4%
- HLE: 42.3%
- SWE-Pro: 64.3%
- TermBench: 83.1%
- SciCode: 54.5%
- SWE-Rebench: 53.1%
- WebDev Elo: 1,557
- Arena Elo: 1,494
- GDPval-AA: 1,483
- Omniscience Acc.: 48.9%
- AA-LCR: 78.7%
- CritPt: 12.0%
- τ³-Banking: 34.6%
- IFBench: 58.6%
- GPQA: 92.0%
- HLE: 48.7%
- SWE-Pro: 69.2%
- TermBench: 84.6%
- TermBench 3: 21.1%
- SciCode: 54.4%
- CursorBench: 62.3%
- SWE-Rebench: 56.5%
- DeepSWE: 59.0%
- Toolathlon V.: 76.2%
- WebDev Elo: 1,539
- Arena Elo: 1,473
- TermBench 4: 23.6%
- TB-Science: 10.5%
- GDPval-AA: 1,578
- Omniscience Acc.: 48.8%
- AA-LCR: 77.7%
- CritPt: 20.9%
- τ³-Banking: 34.2%
- IFBench: 62.2%
- GPQA: 93.1%
- HLE: 42.7%
- TermBench: 81.6%
- TermBench 3: 15.7%
- SciCode: 55.0%
- SWE-Rebench: 63.8%
- WebDev Elo: 1,555
- Arena Elo: 1,468
- TermBench 4: 12.4%
- GDPval-AA: 1,518
- Omniscience Acc.: 51.6%
- AA-LCR: 79.3%
- CritPt: 15.4%
- τ³-Banking: 42.1%
- GPQA: 92.8%
- HLE: 41.0%
- TermBench: 78.7%
- SciCode: 51.0%
- DeepSWE: 62.7%
- Toolathlon V.: 74.1%
- ALE: 25.7%
- AutoBench: 31.8%
- GDPval-AA: 1,577
- Omniscience Acc.: 49.1%
- AA-LCR: 80.3%
- CritPt: 18.0%
- τ³-Banking: 39.6%
- SWE-Pro: 59.6%
- AutoBench: 53.8%
- τ³-Banking: 41.2%
- GPQA: 89.6%
- HLE: 39.9%
- SciCode: 51.9%
- SWE-Rebench: 53.3%
- WebDev Elo: 1,537
- Arena Elo: 1,497
- Omniscience Acc.: 47.0%
- AA-LCR: 78.0%
- CritPt: 12.6%
- IFBench: 53.1%
- DeepSWE: 75.2%
- AutoBench: 36.1%
- TB-Science: 57.0%
- GPQA: 92.3%
- HLE: 40.5%
- TermBench: 74.5%
- SciCode: 49.5%
- WebDev Elo: 1,517
- Arena Elo: 1,473
- Omniscience Acc.: 31.1%
- AA-LCR: 79.0%
- CritPt: 13.4%
- τ³-Banking: 11.8%
- IFBench: 80.5%
- GPQA: 94.5%
- HLE: 47.9%
- TermBench: 85.8%
- TermBench 3: 14.9%
- SciCode: 57.2%
- CursorBench: 61.6%
- DeepSWE: 65.3%
- WebDev Elo: 1,588
- Arena Elo: 1,490
- TermBench 4: 11.2%
- TB-Science: 5.7%
- GDPval-AA: 1,516
- Omniscience Acc.: 55.3%
- AA-LCR: 81.7%
- CritPt: 14.3%
- τ³-Banking: 32.8%
- GPQA: 92.8%
- HLE: 40.8%
- TermBench: 77.5%
- SciCode: 53.4%
- CursorBench: 53.5%
- DeepSWE: 47.0%
- WebDev Elo: 1,537
- Arena Elo: 1,480
- Omniscience Acc.: 50.0%
- AA-LCR: 80.0%
- CritPt: 10.6%
- τ³-Banking: 29.9%
- GPQA: 94.3%
- HLE: 44.4%
- SWE-Pro: 54.2%
- TermBench: 70.7%
- SWE-Rebench: 54.9%
- Toolathlon V.: 61.1%
- WebDev Elo: 1,447
- Arena Elo: 1,487
- GPQA: 91.1%
- HLE: 41.3%
- TermBench: 80.5%
- TermBench 3: 14.6%
- SciCode: 54.3%
- CursorBench: 61.5%
- SWE-Rebench: 56.8%
- DeepSWE: 54.0%
- Toolathlon V.: 71.6%
- WebDev Elo: 1,537
- Arena Elo: 1,461
- TermBench 4: 12.4%
- GDPval-AA: 1,584
- Omniscience Acc.: 40.1%
- AA-LCR: 82.0%
- CritPt: 16.9%
- τ³-Banking: 37.3%
- GPQA: 87.5%
- HLE: 33.6%
- TermBench: 71.2%
- SciCode: 50.1%
- SWE-Rebench: 54.5%
- WebDev Elo: 1,521
- Arena Elo: 1,473
- Omniscience Acc.: 40.9%
- AA-LCR: 80.0%
- CritPt: 3.1%
- τ³-Banking: 34.4%
- IFBench: 56.6%
- GPQA: 91.9%
- HLE: 37.5%
- TermBench: 73.9%
- SWE-Rebench: 50.7%
- WebDev Elo: 1,439
- Arena Elo: 1,486
- GPQA: 92.2%
- HLE: 42.7%
- TermBench: 78.7%
- SciCode: 53.9%
- CursorBench: 48.8%
- SWE-Rebench: 49.5%
- DeepSWE: 36.0%
- Toolathlon V.: 67.3%
- WebDev Elo: 1,492
- Arena Elo: 1,478
- Omniscience Acc.: 51.4%
- AA-LCR: 73.3%
- CritPt: 13.1%
- τ³-Banking: 32.2%
- IFBench: 76.3%
- GPQA: 90.8%
- HLE: 38.6%
- TermBench: 78.7%
- SciCode: 50.3%
- DeepSWE: 54.4%
- Toolathlon V.: 70.3%
- ALE: 25.2%
- AutoBench: 25.1%
- GDPval-AA: 1,547
- Omniscience Acc.: 40.4%
- AA-LCR: 79.7%
- CritPt: 16.6%
- τ³-Banking: 39.4%
- GPQA: 91.1%
- HLE: 37.5%
- TermBench: 65.9%
- SciCode: 51.5%
- SWE-Rebench: 46.5%
- Toolathlon V.: 58.0%
- WebDev Elo: 1,509
- Arena Elo: 1,460
- Omniscience Acc.: 32.6%
- AA-LCR: 81.0%
- CritPt: 8.0%
- τ³-Banking: 23.3%
- IFBench: 76.0%
- GPQA: 90.5%
- HLE: 33.9%
- SWE-Pro: 61.7%
- LiveCode: 90.3%
- TermBench: 79.8%
- SciCode: 46.6%
- DeepSWE: 42.2%
- WebDev Elo: 1,593
- Arena Elo: 1,437
- GDPval-AA: 1,543
- Omniscience Acc.: 15.6%
- AA-LCR: 82.0%
- CritPt: 5.4%
- τ³-Banking: 48.0%
- GPQA: 89.8%
- HLE: 36.6%
- SWE-Pro: 34.6%
- WebDev Elo: 1,438
- Arena Elo: 1,474
- Omniscience Acc.: 53.4%
- AA-LCR: 78.0%
- CritPt: 8.6%
- τ³-Banking: 20.8%
- IFBench: 78.0%
- HLE: 39.0%
- SciCode: 55.0%
- DeepSWE: 66.6%
- TermBench 4: 13.0%
- AA-LCR: 83.0%
- GPQA: 91.1%
- HLE: 39.5%
- SWE-Pro: 62.7%
- TermBench: 80.9%
- TermBench 3: 14.3%
- SciCode: 53.6%
- CursorBench: 61.1%
- SWE-Rebench: 43.6%
- DeepSWE: 67.0%
- WebDev Elo: 1,519
- Arena Elo: 1,453
- TermBench 4: 17.3%
- TB-Science: 3.3%
- GDPval-AA: 1,569
- Omniscience Acc.: 42.7%
- AA-LCR: 83.7%
- CritPt: 20.6%
- τ³-Banking: 31.1%
- GPQA: 89.7%
- HLE: 33.5%
- TermBench: 64.4%
- SciCode: 48.6%
- WebDev Elo: 1,513
- Arena Elo: 1,456
- Omniscience Acc.: 32.0%
- AA-LCR: 79.0%
- CritPt: 4.9%
- τ³-Banking: 22.9%
- GPQA: 87.5%
- HLE: 28.1%
- SWE-Pro: 54.4%
- TermBench: 59.2%
- SciCode: 52.1%
- WebDev Elo: 1,397
- Arena Elo: 1,448
- Omniscience Acc.: 37.5%
- AA-LCR: 77.0%
- CritPt: 10.0%
- τ³-Banking: 25.6%
- IFBench: 73.3%
- GPQA: 89.5%
- HLE: 41.1%
- TermBench: 77.9%
- TermBench 3: 4.6%
- SciCode: 51.2%
- CursorBench: 55.0%
- SWE-Rebench: 57.0%
- DeepSWE: 44.0%
- Toolathlon V.: 59.9%
- WebDev Elo: 1,592
- Arena Elo: 1,472
- GDPval-AA: 1,498
- Omniscience Acc.: 24.3%
- AA-LCR: 78.3%
- CritPt: 20.9%
- τ³-Banking: 34.6%
- IFBench: 73.3%
- GPQA: 86.6%
- HLE: 30.1%
- SWE-Pro: 45.9%
- SciCode: 49.5%
- SWE-Rebench: 53.1%
- WebDev Elo: 1,468
- Arena Elo: 1,470
- Omniscience Acc.: 46.6%
- AA-LCR: 77.3%
- CritPt: 4.6%
- IFBench: 58.0%
- GPQA: 90.0%
- HLE: 35.6%
- TermBench: 61.0%
- SciCode: 46.1%
- Arena Elo: 1,456
- Omniscience Acc.: 22.5%
- AA-LCR: 73.0%
- CritPt: 9.1%
- τ³-Banking: 17.5%
- IFBench: 78.0%
- GPQA: 92.9%
- HLE: 39.0%
- SWE-Pro: 59.0%
- TermBench: 65.2%
- SciCode: 47.1%
- SWE-Rebench: 46.4%
- WebDev Elo: 1,487
- Arena Elo: 1,441
- Omniscience Acc.: 16.7%
- AA-LCR: 83.0%
- CritPt: 3.7%
- τ³-Banking: 15.3%
- IFBench: 82.9%
- GPQA: 87.3%
- HLE: 32.0%
- TermBench: 71.9%
- SciCode: 42.9%
- Omniscience Acc.: 18.2%
- AA-LCR: 80.0%
- CritPt: 4.6%
- τ³-Banking: 34.2%
- GPQA: 86.6%
- HLE: 35.7%
- TermBench: 65.2%
- SciCode: 50.6%
- SWE-Rebench: 44.4%
- WebDev Elo: 1,475
- Arena Elo: 1,467
- Omniscience Acc.: 22.4%
- AA-LCR: 79.7%
- CritPt: 4.0%
- τ³-Banking: 9.9%
- IFBench: 79.9%
- GPQA: 86.8%
- HLE: 30.1%
- TermBench: 61.8%
- SciCode: 44.8%
- WebDev Elo: 1,508
- Arena Elo: 1,466
- Omniscience Acc.: 23.7%
- AA-LCR: 73.7%
- CritPt: 4.6%
- τ³-Banking: 13.6%
- IFBench: 76.3%
- GPQA: 88.9%
- HLE: 32.4%
- SWE-Pro: 46.9%
- MMLU-Pro: 87.1%
- GPQA: 87.9%
- HLE: 30.7%
- AIME: 96.1%
- SWE-Pro: 50.7%
- LiveCode: 85.0%
- TermBench: 45.7%
- SciCode: 49.0%
- SWE-Rebench: 49.0%
- Toolathlon V.: 33.0%
- Omniscience Acc.: 35.2%
- AA-LCR: 78.0%
- CritPt: 3.1%
- τ³-Banking: 14.2%
- IFBench: 70.2%
- MMLU-Pro: 78.3%
- HLE: 10.6%
- AIME: 89.1%
- LiveCode: 68.3%
- GPQA: 89.6%
- HLE: 35.0%
- TermBench: 67.4%
- SciCode: 47.8%
- CursorBench: 49.7%
- Toolathlon V.: 58.0%
- WebDev Elo: 1,473
- Omniscience Acc.: 39.6%
- AA-LCR: 79.3%
- CritPt: 10.0%
- τ³-Banking: 20.2%
- IFBench: 63.1%
- MMLU-Pro: 85.3%
- GPQA: 82.7%
- HLE: 20.1%
- AIME: 88.9%
- LiveCode: 80.8%
- SciCode: 41.0%
- SWE-Rebench: 38.1%
- Arena Elo: 1,432
- Omniscience Acc.: 38.6%
- AA-LCR: 74.7%
- CritPt: 1.1%
- IFBench: 71.4%
- GPQA: 82.0%
- HLE: 29.3%
- SciCode: 46.2%
- SWE-Rebench: 53.3%
- WebDev Elo: 1,436
- Arena Elo: 1,458
- Omniscience Acc.: 26.3%
- AA-LCR: 75.7%
- CritPt: 2.0%
- IFBench: 72.3%
- GPQA: 90.1%
- HLE: 37.2%
- TermBench: 39.7%
- SciCode: 48.3%
- WebDev Elo: 1,357
- Arena Elo: 1,443
- Omniscience Acc.: 34.8%
- AA-LCR: 73.0%
- CritPt: 8.0%
- τ³-Banking: 12.4%
- IFBench: 81.3%
- GPQA: 85.4%
- HLE: 28.5%
- AIME: 94.6%
- SWE-Pro: 41.8%
- TermBench: 35.2%
- SciCode: 42.9%
- Arena Elo: 1,435
- Omniscience Acc.: 40.3%
- AA-LCR: 78.2%
- CritPt: 5.7%
- τ³-Banking: 22.1%
- IFBench: 73.1%
- GPQA: 81.7%
- HLE: 28.3%
- SWE-Pro: 52.4%
- TermBench: 60.7%
- SciCode: 47.2%
- Arena Elo: 1,402
- Omniscience Acc.: 25.7%
- AA-LCR: 76.7%
- CritPt: 9.3%
- τ³-Banking: 27.4%
- IFBench: 75.9%
- MMLU-Pro: 86.6%
- GPQA: 87.7%
- HLE: 26.7%
- AIME: 92.7%
- LiveCode: 81.9%
- SciCode: 45.7%
- SWE-Rebench: 38.3%
- Arena Elo: 1,411
- Omniscience Acc.: 40.5%
- AA-LCR: 68.0%
- CritPt: 2.0%
- IFBench: 53.7%
- GPQA: 88.2%
- HLE: 27.8%
- TermBench: 61.4%
- SciCode: 40.7%
- WebDev Elo: 1,461
- Arena Elo: 1,443
- Omniscience Acc.: 26.4%
- AA-LCR: 78.3%
- CritPt: 2.9%
- τ³-Banking: 20.8%
- IFBench: 75.2%
- GPQA: 85.0%
- SciCode: 38.1%
- Omniscience Acc.: 23.0%
- AA-LCR: 68.3%
- IFBench: 74.2%
- GPQA: 87.2%
- HLE: 31.9%
- SWE-Pro: 54.3%
- TermBench: 55.1%
- SciCode: 47.0%
- Toolathlon V.: 45.5%
- WebDev Elo: 1,410
- Arena Elo: 1,440
- Omniscience Acc.: 41.6%
- AA-LCR: 77.3%
- CritPt: 5.4%
- τ³-Banking: 29.1%
- MMLU-Pro: 86.8%
- GPQA: 86.7%
- HLE: 28.4%
- LiveCode: 89.0%
- TermBench: 56.4%
- SciCode: 40.3%
- Toolathlon V.: 34.3%
- Omniscience Acc.: 22.6%
- AA-LCR: 79.3%
- CritPt: 3.1%
- τ³-Banking: 14.2%
- IFBench: 81.4%
- MMLU-Pro: 84.8%
- GPQA: 76.5%
- AIME: 79.3%
- Arena Elo: 1,388
- GPQA: 89.5%
- HLE: 33.3%
- SWE-Pro: 55.9%
- TermBench: 55.1%
- SciCode: 49.7%
- Toolathlon V.: 54.4%
- WebDev Elo: 1,407
- Arena Elo: 1,405
- Omniscience Acc.: 33.2%
- AA-LCR: 75.7%
- CritPt: 8.3%
- τ³-Banking: 18.8%
- GPQA: 89.3%
- HLE: 29.0%
- TermBench: 51.3%
- SciCode: 44.8%
- SWE-Rebench: 59.9%
- Toolathlon V.: 40.7%
- WebDev Elo: 1,399
- Arena Elo: 1,442
- Omniscience Acc.: 30.8%
- AA-LCR: 77.3%
- CritPt: 1.7%
- τ³-Banking: 13.4%
- IFBench: 78.8%
- HLE: 6.5%
- AIME: 72.1%
- LiveCode: 71.1%
- GPQA: 83.5%
- HLE: 22.1%
- Omniscience Acc.: 19.8%
- AA-LCR: 71.3%
- CritPt: 2.9%
- IFBench: 71.8%
- MMLU-Pro: 82.6%
- GPQA: 82.3%
- HLE: 8.7%
- LiveCode: 77.1%
- WebDev Elo: 1,362
- Arena Elo: 1,438
- GPQA: 83.8%
- HLE: 18.8%
- TermBench: 53.6%
- SciCode: 41.3%
- Toolathlon V.: 57.1%
- WebDev Elo: 1,447
- Arena Elo: 1,456
- Omniscience Acc.: 29.5%
- AA-LCR: 76.0%
- τ³-Banking: 17.5%
- SWE-Pro: 43.6%
- SWE-Rebench: 52.4%
- WebDev Elo: 1,386
- Arena Elo: 1,455
- GPQA: 85.5%
- HLE: 23.7%
- SWE-Pro: 56.6%
- TermBench: 55.4%
- SciCode: 42.0%
- Omniscience Acc.: 18.2%
- AA-LCR: 73.0%
- CritPt: 1.7%
- τ³-Banking: 27.2%
- GPQA: 88.8%
- HLE: 37.5%
- TermBench: 64.0%
- SciCode: 50.8%
- SWE-Rebench: 41.4%
- DeepSWE: 12.8%
- Toolathlon V.: 55.9%
- ALE: 16.5%
- AutoBench: 12.8%
- WebDev Elo: 1,446
- Arena Elo: 1,457
- Omniscience Acc.: 43.0%
- AA-LCR: 74.7%
- CritPt: 12.9%
- τ³-Banking: 30.1%
- IFBench: 76.5%
- GPQA: 68.2%
- AIME: 62.8%
- LiveCode: 55.8%
- GPQA: 87.4%
- HLE: 29.6%
- SWE-Pro: 56.2%
- TermBench: 55.4%
- SciCode: 50.1%
- SWE-Rebench: 51.9%
- Toolathlon V.: 47.5%
- WebDev Elo: 1,398
- Arena Elo: 1,415
- Omniscience Acc.: 26.8%
- AA-LCR: 78.3%
- CritPt: 0.6%
- τ³-Banking: 9.9%
- IFBench: 75.7%
- GPQA: 84.2%
- HLE: 23.1%
- TermBench: 60.7%
- SciCode: 42.8%
- Omniscience Acc.: 19.6%
- AA-LCR: 77.3%
- CritPt: 1.1%
- τ³-Banking: 16.7%
- IFBench: 67.6%
- MMLU-Pro: 74.3%
- GPQA: 65.8%
- AIME: 62.9%
- LiveCode: 53.8%
- GPQA: 83.5%
- HLE: 22.0%
- SWE-Pro: 51.2%
- TermBench: 51.7%
- SciCode: 44.9%
- WebDev Elo: 1,360
- Arena Elo: 1,427
- Omniscience Acc.: 27.0%
- AA-LCR: 83.3%
- CritPt: 2.6%
- τ³-Banking: 23.5%
- GPQA: 84.9%
- HLE: 27.2%
- TermBench: 63.7%
- SciCode: 43.9%
- WebDev Elo: 1,437
- Arena Elo: 1,434
- Omniscience Acc.: 16.8%
- AA-LCR: 73.0%
- CritPt: 3.7%
- τ³-Banking: 8.7%
- IFBench: 67.1%
- GPQA: 85.9%
- HLE: 27.4%
- TermBench: 45.3%
- SciCode: 45.1%
- SWE-Rebench: 45.5%
- WebDev Elo: 1,435
- Arena Elo: 1,442
- Omniscience Acc.: 29.3%
- AA-LCR: 71.0%
- CritPt: 1.7%
- τ³-Banking: 12.2%
- IFBench: 67.9%
- MMLU-Pro: 86.2%
- GPQA: 84.0%
- HLE: 24.6%
- AIME: 92.0%
- SWE-Pro: 15.6%
- LiveCode: 86.2%
- TermBench: 46.8%
- SciCode: 38.9%
- SWE-Rebench: 48.9%
- WebDev Elo: 1,325
- Arena Elo: 1,425
- Omniscience Acc.: 33.0%
- AA-LCR: 73.3%
- CritPt: 2.9%
- IFBench: 60.7%
- SWE-Rebench: 43.5%
- WebDev Elo: 1,389
- Arena Elo: 1,448
- GPQA: 84.7%
- HLE: 19.1%
- SciCode: 44.2%
- Omniscience Acc.: 22.8%
- AA-LCR: 73.7%
- CritPt: 2.9%
- IFBench: 50.5%
- GPQA: 86.7%
- HLE: 27.8%
- SciCode: 41.2%
- Toolathlon V.: 56.8%
- WebDev Elo: 1,356
- Arena Elo: 1,413
- Omniscience Acc.: 27.9%
- AA-LCR: 64.7%
- CritPt: 4.6%
- IFBench: 63.1%
- MMLU-Pro: 84.1%
- GPQA: 76.4%
- HLE: 11.9%
- AIME: 80.7%
- LiveCode: 76.7%
- SciCode: 38.3%
- Arena Elo: 1,424
- Omniscience Acc.: 24.4%
- AA-LCR: 50.0%
- IFBench: 44.1%
- GPQA: 89.1%
- HLE: 29.2%
- TermBench: 57.3%
- SciCode: 44.6%
- WebDev Elo: 1,372
- Arena Elo: 1,376
- Omniscience Acc.: 18.9%
- AA-LCR: 74.0%
- CritPt: 5.4%
- τ³-Banking: 23.3%
- MMLU-Pro: 84.1%
- GPQA: 74.7%
- HLE: 7.0%
- LiveCode: 67.9%
- SciCode: 35.8%
- Arena Elo: 1,402
- Omniscience Acc.: 34.5%
- AA-LCR: 65.0%
- CritPt: 0.3%
- IFBench: 70.3%
- MMLU-Pro: 85.2%
- GPQA: 85.7%
- HLE: 23.6%
- LiveCode: 80.0%
- TermBench: 43.4%
- SciCode: 45.5%
- SWE-Rebench: 25.1%
- WebDev Elo: 1,364
- Arena Elo: 1,451
- Omniscience Acc.: 20.0%
- AA-LCR: 69.7%
- CritPt: 1.4%
- τ³-Banking: 14.8%
- IFBench: 75.6%
- GPQA: 78.0%
- HLE: 33.7%
- TermBench: 50.2%
- SciCode: 36.3%
- Omniscience Acc.: 29.6%
- AA-LCR: 65.0%
- CritPt: 2.6%
- τ³-Banking: 13.2%
- GPQA: 84.8%
- HLE: 20.5%
- SciCode: 42.6%
- SWE-Rebench: 47.7%
- WebDev Elo: 1,384
- Arena Elo: 1,390
- Omniscience Acc.: 26.2%
- AA-LCR: 73.3%
- CritPt: 1.1%
- IFBench: 71.6%
- GPQA: 89.4%
- HLE: 34.8%
- TermBench: 61.8%
- SciCode: 45.3%
- SWE-Rebench: 38.4%
- DeepSWE: 7.3%
- Toolathlon V.: 49.7%
- ALE: 15.8%
- AutoBench: 10.8%
- WebDev Elo: 1,580
- Arena Elo: 1,436
- Omniscience Acc.: 36.8%
- AA-LCR: 74.3%
- CritPt: 7.1%
- τ³-Banking: 30.9%
- IFBench: 79.2%
- GPQA: 83.1%
- HLE: 21.1%
- SciCode: 40.4%
- SWE-Rebench: 59.6%
- Arena Elo: 1,394
- Omniscience Acc.: 23.6%
- AA-LCR: 50.0%
- CritPt: 2.5%
- IFBench: 64.6%
- GPQA: 82.8%
- HLE: 21.5%
- AIME: 91.1%
- TermBench: 3.7%
- SciCode: 39.0%
- Arena Elo: 1,390
- Omniscience Acc.: 25.0%
- AA-LCR: 72.3%
- τ³-Banking: 15.5%
- IFBench: 75.4%
- GPQA: 85.7%
- HLE: 21.6%
- TermBench: 43.1%
- SciCode: 45.0%
- Omniscience Acc.: 25.7%
- AA-LCR: 70.0%
- CritPt: 3.7%
- τ³-Banking: 17.9%
- IFBench: 44.6%
- GPQA: 82.2%
- HLE: 17.2%
- TermBench: 31.1%
- SciCode: 43.4%
- WebDev Elo: 1,254
- Arena Elo: 1,432
- Omniscience Acc.: 36.3%
- AA-LCR: 74.3%
- CritPt: 1.1%
- τ³-Banking: 9.7%
- IFBench: 77.2%
- GPQA: 84.1%
- HLE: 22.2%
- TermBench: 44.9%
- SciCode: 36.6%
- Omniscience Acc.: 18.8%
- AA-LCR: 71.7%
- CritPt: 0.3%
- τ³-Banking: 9.3%
- IFBench: 64.4%
- MMLU-Pro: 86.2%
- GPQA: 84.4%
- HLE: 22.5%
- AIME: 87.7%
- LiveCode: 80.1%
- TermBench: 28.5%
- SciCode: 46.3%
- SWE-Rebench: 23.5%
- WebDev Elo: 1,226
- Arena Elo: 1,446
- Omniscience Acc.: 39.1%
- AA-LCR: 69.0%
- CritPt: 2.6%
- τ³-Banking: 9.7%
- IFBench: 48.7%
- SWE-Pro: 42.7%
- LiveCode: 59.4%
- SWE-Rebench: 44.6%
- Arena Elo: 1,391
- GPQA: 74.8%
- HLE: 13.8%
- TermBench: 50.6%
- SciCode: 40.2%
- WebDev Elo: 1,265
- Arena Elo: 1,426
- Omniscience Acc.: 24.7%
- AA-LCR: 69.3%
- τ³-Banking: 15.1%
- IFBench: 68.8%
- MMLU-Pro: 85.0%
- GPQA: 81.3%
- HLE: 15.8%
- AIME: 87.5%
- LiveCode: 84.4%
- SciCode: 40.3%
- SWE-Rebench: 22.3%
- Arena Elo: 1,421
- Omniscience Acc.: 30.5%
- AA-LCR: 55.7%
- CritPt: 1.4%
- IFBench: 39.6%
- SWE-Pro: 39.5%
- WebDev Elo: 1,329
- Arena Elo: 1,415
- MMLU-Pro: 84.8%
- GPQA: 77.9%
- HLE: 14.3%
- AIME: 88.4%
- LiveCode: 74.8%
- SciCode: 39.1%
- SWE-Rebench: 28.0%
- Arena Elo: 1,417
- Omniscience Acc.: 29.0%
- AA-LCR: 56.7%
- CritPt: 2.0%
- IFBench: 41.5%
- MMLU-Pro: 79.1%
- GPQA: 74.8%
- HLE: 7.9%
- LiveCode: 71.7%
- SciCode: 39.9%
- Arena Elo: 1,348
- GPQA: 78.4%
- HLE: 16.5%
- AIME: 92.7%
- SciCode: 46.5%
- SWE-Rebench: 27.5%
- Arena Elo: 1,391
- Omniscience Acc.: 24.8%
- AA-LCR: 61.0%
- CritPt: 0.6%
- IFBench: 68.7%
- MMLU-Pro: 79.9%
- GPQA: 69.3%
- HLE: 4.1%
- AIME: 58.0%
- LiveCode: 42.5%
- SciCode: 36.8%
- Arena Elo: 1,412
- Omniscience Acc.: 28.9%
- AA-LCR: 58.0%
- IFBench: 46.9%
- GPQA: 72.6%
- HLE: 9.9%
- Omniscience Acc.: 18.2%
- AA-LCR: 61.3%
- IFBench: 41.9%
- GPQA: 71.3%
- HLE: 10.1%
- TermBench: 15.0%
- Omniscience Acc.: 18.0%
- AA-LCR: 57.0%
- IFBench: 62.8%
- GPQA: 77.2%
- HLE: 9.7%
- SciCode: 40.3%
- Arena Elo: 1,372
- Omniscience Acc.: 28.0%
- CritPt: 0.9%
- IFBench: 48.3%
- GPQA: 75.2%
- HLE: 8.7%
- SciCode: 37.0%
- Omniscience Acc.: 21.9%
- AA-LCR: 41.7%
- CritPt: 0.3%
- IFBench: 56.9%
- MMLU-Pro: 77.6%
- GPQA: 64.4%
- HLE: 11.2%
- AIME: 89.2%
- SWE-Pro: 33.3%
- LiveCode: 75.8%
- TermBench: 26.6%
- SciCode: 37.8%
- Omniscience Acc.: 10.1%
- AA-LCR: 49.0%
- CritPt: 0.3%
- τ³-Banking: 14.4%
- GPQA: 67.6%
- HLE: 9.5%
- AIME: 85.2%
- SciCode: 36.6%
- Arena Elo: 1,338
- Omniscience Acc.: 19.1%
- AA-LCR: 45.0%
- IFBench: 67.6%
- MMLU-Pro: 84.0%
- GPQA: 70.8%
- HLE: 8.5%
- AIME: 70.0%
- TermBench: 19.1%
- SciCode: 38.3%
- Arena Elo: 1,398
- Omniscience Acc.: 30.5%
- AA-LCR: 57.7%
- CritPt: 0.6%
- τ³-Banking: 6.4%
- IFBench: 39.0%
- GPQA: 79.0%
- HLE: 12.1%
- LiveCode: 75.1%
- SciCode: 39.4%
- SWE-Rebench: 19.9%
- Arena Elo: 1,410
- Omniscience Acc.: 26.0%
- AA-LCR: 65.3%
- CritPt: 1.1%
- IFBench: 50.3%
- GPQA: 58.9%
- HLE: 4.6%
- SciCode: 29.5%
- MMLU-Pro: 80.6%
- GPQA: 66.6%
- HLE: 4.2%
- AIME: 46.4%
- LiveCode: 45.7%
- SciCode: 38.1%
- SWE-Rebench: 30.1%
- Arena Elo: 1,415
- Omniscience Acc.: 27.8%
- AA-LCR: 68.3%
- IFBench: 43.0%
- MMLU-Pro: 77.2%
- GPQA: 59.9%
- HLE: 3.7%
- LiveCode: 48.7%
- SciCode: 36.6%
- Arena Elo: 1,374
- MMLU-Pro: 81.1%
- GPQA: 76.6%
- HLE: 7.4%
- AIME: 49.5%
- SWE-Pro: 27.7%
- LiveCode: 53.7%
- SciCode: 34.5%
- SWE-Rebench: 34.6%
- Omniscience Acc.: 27.4%
- AA-LCR: 53.0%
- IFBench: 41.5%
- GPQA: 74.3%
- HLE: 10.6%
- TermBench: 24.3%
- SciCode: 32.1%
- Omniscience Acc.: 14.4%
- AA-LCR: 60.3%
- τ³-Banking: 8.9%
- GPQA: 73.4%
- HLE: 9.3%
- TermBench: 27.7%
- SciCode: 24.2%
- Omniscience Acc.: 8.5%
- AA-LCR: 60.3%
- τ³-Banking: 20.8%
- GPQA: 77.0%
- HLE: 17.1%
- TermBench: 27.3%
- SciCode: 37.7%
- WebDev Elo: 1,167
- Omniscience Acc.: 21.2%
- AA-LCR: 43.7%
- CritPt: 0.8%
- τ³-Banking: 9.5%
- IFBench: 69.8%
- MMLU-Pro: 80.6%
- GPQA: 75.9%
- HLE: 12.6%
- AIME: 69.5%
- LiveCode: 56.6%
- TermBench: 6.7%
- SciCode: 38.8%
- SWE-Rebench: 20.1%
- Arena Elo: 1,399
- Omniscience Acc.: 19.0%
- AA-LCR: 63.7%
- τ³-Banking: 6.2%
- IFBench: 60.7%
- GPQA: 76.9%
- HLE: 9.9%
- TermBench: 21.0%
- SciCode: 38.8%
- Omniscience Acc.: 21.7%
- AA-LCR: 49.7%
- CritPt: 0.3%
- τ³-Banking: 4.9%
- IFBench: 48.2%
- MMLU-Pro: 75.5%
- GPQA: 57.8%
- HLE: 6.6%
- LiveCode: 27.5%
- SciCode: 22.6%
- GPQA: 53.5%
- HLE: 3.4%
- SciCode: 25.0%
- GPQA: 62.0%
- HLE: 4.6%
- Omniscience Acc.: 14.3%
- IFBench: 31.2%
- MMLU-Pro: 75.9%
- GPQA: 61.0%
- HLE: 6.4%
- AIME: 73.7%
- LiveCode: 67.2%
- SciCode: 28.6%
- Arena Elo: 1,307
- Omniscience Acc.: 14.9%
- IFBench: 49.1%
- MMLU-Pro: 74.2%
- GPQA: 60.3%
- HLE: 3.6%
- LiveCode: 57.6%
- SciCode: 32.3%
- Arena Elo: 1,337
- GPQA: 62.5%
- HLE: 6.8%
- SciCode: 19.3%
- Omniscience Acc.: 17.9%
- AA-LCR: 55.7%
- IFBench: 49.9%
- GPQA: 53.9%
- HLE: 5.0%
- Omniscience Acc.: 12.0%
- IFBench: 39.2%
- GPQA: 72.4%
- HLE: 10.3%
- TermBench: 12.0%
- SciCode: 25.5%
- Omniscience Acc.: 18.5%
- AA-LCR: 32.3%
- τ³-Banking: 8.7%
- IFBench: 71.2%
- GPQA: 46.3%
- HLE: 3.2%
- SciCode: 26.7%
- MMLU-Pro: 74.0%
- GPQA: 63.1%
- HLE: 9.7%
- AIME: 86.7%
- SWE-Pro: 19.1%
- LiveCode: 73.2%
- TermBench: 18.4%
- SciCode: 31.5%
- Omniscience Acc.: 11.2%
- AA-LCR: 45.0%
- CritPt: 0.3%
- τ³-Banking: 7.6%
- MMLU-Pro: 76.4%
- GPQA: 59.3%
- HLE: 7.4%
- AIME: 69.5%
- LiveCode: 63.4%
- SciCode: 35.8%
- Arena Elo: 1,336
- AA-LCR: 26.7%
- IFBench: 38.8%
- GPQA: 78.2%
- HLE: 19.6%
- AIME: 92.5%
- SWE-Pro: 16.2%
- TermBench: 26.2%
- SciCode: 34.0%
- SWE-Rebench: 27.3%
- Arena Elo: 1,352
- Omniscience Acc.: 21.8%
- AA-LCR: 52.0%
- CritPt: 1.1%
- τ³-Banking: 12.8%
- IFBench: 69.0%
- MMLU-Pro: 78.8%
- GPQA: 61.8%
- HLE: 4.5%
- AIME: 39.3%
- SWE-Pro: 38.7%
- LiveCode: 58.5%
- SciCode: 35.9%
- SWE-Rebench: 36.3%
- Arena Elo: 1,388
- Omniscience Acc.: 15.7%
- AA-LCR: 45.7%
- IFBench: 40.5%
- MMLU-Pro: 69.4%
- HLE: 3.1%
- LiveCode: 37.3%
- SciCode: 31.9%
- Arena Elo: 1,324
- GPQA: 76.1%
- HLE: 13.1%
- Arena Elo: 1,356
- Omniscience Acc.: 19.6%
- AA-LCR: 39.7%
- CritPt: 0.3%
- IFBench: 34.0%
- MMLU-Pro: 73.9%
- GPQA: 61.5%
- HLE: 4.6%
- AIME: 63.0%
- LiveCode: 57.2%
- SciCode: 37.6%
- AA-LCR: 8.7%
- IFBench: 22.9%
- GPQA: 70.0%
- HLE: 11.0%
- AIME: 81.5%
- SWE-Pro: 21.4%
- LiveCode: 80.4%
- SciCode: 39.9%
- SWE-Rebench: 18.5%
- Arena Elo: 1,375
- Omniscience Acc.: 18.5%
- IFBench: 38.7%
- GPQA: 75.2%
- HLE: 15.8%
- TermBench: 20.6%
- SciCode: 40.6%
- WebDev Elo: 1,237
- Arena Elo: 1,369
- Omniscience Acc.: 22.5%
- AA-LCR: 38.0%
- CritPt: 0.9%
- τ³-Banking: 5.8%
- IFBench: 56.3%
- MMLU-Pro: 68.9%
- GPQA: 47.1%
- HLE: 4.9%
- LiveCode: 29.5%
- SciCode: 22.9%
- MMLU-Pro: 75.1%
- GPQA: 59.9%
- HLE: 3.7%
- LiveCode: 48.7%
- SciCode: 36.6%
- SWE-Rebench: 30.3%
- Arena Elo: 1,343
- GPQA: 48.6%
- HLE: 3.3%
- SciCode: 29.2%
- Omniscience Acc.: 19.9%
- IFBench: 31.2%
- MMLU-Pro: 74.0%
- GPQA: 52.6%
- HLE: 1.8%
- LiveCode: 33.4%
- SciCode: 30.9%
- Arena Elo: 1,346
- MMLU-Pro: 80.7%
- GPQA: 68.0%
- HLE: 4.2%
- AIME: 38.0%
- LiveCode: 46.5%
- TermBench: 12.0%
- SciCode: 36.6%
- WebDev Elo: 1,230
- Arena Elo: 1,413
- Omniscience Acc.: 25.0%
- AA-LCR: 36.0%
- τ³-Banking: 5.8%
- IFBench: 36.2%
- GPQA: 32.6%
- HLE: 6.7%
- Omniscience Acc.: 7.0%
- IFBench: 43.8%
- MMLU-Pro: 68.3%
- GPQA: 58.8%
- HLE: 4.7%
- AIME: 38.3%
- LiveCode: 40.6%
- TermBench: 13.9%
- SciCode: 32.4%
- Omniscience Acc.: 20.8%
- AA-LCR: 42.7%
- τ³-Banking: 8.2%
- IFBench: 39.8%
- MMLU-Pro: 66.9%
- GPQA: 52.9%
- HLE: 4.4%
- AIME: 33.7%
- LiveCode: 43.5%
- SciCode: 26.7%
- Omniscience Acc.: 13.7%
- IFBench: 30.4%
- GPQA: 40.0%
- HLE: 5.8%
- Omniscience Acc.: 7.4%
- IFBench: 32.8%
- GPQA: 59.3%
- HLE: 6.3%
- TermBench: 24.3%
- SciCode: 27.1%
- Omniscience Acc.: 15.6%
- AA-LCR: 31.3%
- τ³-Banking: 2.9%
- IFBench: 57.4%
- MMLU-Pro: 79.5%
- GPQA: 40.2%
- HLE: 5.1%
- AIME: 53.7%
- LiveCode: 57.5%
- SciCode: 31.3%
- Omniscience Acc.: 19.2%
- AA-LCR: 10.0%
- IFBench: 27.6%
- GPQA: 51.3%
- HLE: 6.9%
- SciCode: 7.8%
- Omniscience Acc.: 9.3%
- IFBench: 55.6%
- GPQA: 51.0%
- HLE: 3.1%
- SciCode: 28.5%
- Arena Elo: 1,336
- GPQA: 58.1%
- HLE: 7.6%
- SciCode: 33.7%
- SWE-Rebench: 30.1%
- Arena Elo: 1,366
- Omniscience Acc.: 16.2%
- AA-LCR: 41.7%
- CritPt: 0.3%
- IFBench: 60.8%
- MMLU-Pro: 76.2%
- GPQA: 59.4%
- HLE: 3.6%
- AIME: 36.7%
- LiveCode: 44.8%
- TermBench: 30.3%
- SciCode: 32.8%
- SWE-Rebench: 42.0%
- WebDev Elo: 1,194
- Omniscience Acc.: 20.8%
- AA-LCR: 32.3%
- τ³-Banking: 10.5%
- IFBench: 38.1%
- MMLU-Pro: 78.1%
- GPQA: 66.4%
- HLE: 5.0%
- AIME: 40.2%
- LiveCode: 48.3%
- TermBench: 10.1%
- SciCode: 40.4%
- SWE-Rebench: 25.5%
- Arena Elo: 1,383
- Omniscience Acc.: 20.3%
- AA-LCR: 44.0%
- τ³-Banking: 5.4%
- IFBench: 38.3%
- MMLU-Pro: 70.1%
- GPQA: 50.5%
- HLE: 2.8%
- AIME: 2.3%
- LiveCode: 26.1%
- SciCode: 29.2%
- IFBench: 34.5%
- MMLU-Pro: 74.0%
- GPQA: 48.4%
- HLE: 4.1%
- AIME: 55.7%
- LiveCode: 53.1%
- SciCode: 23.9%
- AA-LCR: 10.3%
- IFBench: 22.1%
- GPQA: 27.2%
- HLE: 5.5%
- Omniscience Acc.: 11.6%
- IFBench: 25.9%
- GPQA: 41.2%
- HLE: 2.5%
- AA-LCR: 28.0%
- IFBench: 28.1%
- MMLU-Pro: 69.6%
- GPQA: 48.9%
- HLE: 2.8%
- LiveCode: 27.9%
- SciCode: 23.3%
- Arena Elo: 1,322
- GPQA: 68.8%
- HLE: 11.0%
- AIME: 91.7%
- TermBench: 13.9%
- SciCode: 38.9%
- SWE-Rebench: 8.1%
- Arena Elo: 1,317
- Omniscience Acc.: 16.0%
- AA-LCR: 34.7%
- CritPt: 1.4%
- τ³-Banking: 7.0%
- IFBench: 65.1%
- GPQA: 55.9%
- HLE: 6.6%
- TermBench: 13.9%
- SciCode: 25.3%
- Omniscience Acc.: 9.2%
- AA-LCR: 24.3%
- τ³-Banking: 5.6%
- GPQA: 25.6%
- HLE: 5.0%
- Omniscience Acc.: 9.7%
- IFBench: 22.4%
- MMLU-Pro: 48.6%
- GPQA: 34.4%
- LiveCode: 17.1%
- SciCode: 19.4%
- GPQA: 66.8%
- HLE: 7.4%
- AIME: 72.9%
- LiveCode: 65.7%
- TermBench: 5.2%
- SciCode: 36.0%
- SWE-Rebench: 8.1%
- Arena Elo: 1,347
- Omniscience Acc.: 17.4%
- CritPt: 0.3%
- τ³-Banking: 5.4%
- IFBench: 36.3%
- MMLU-Pro: 69.3%
- GPQA: 57.2%
- HLE: 4.6%
- AIME: 30.0%
- LiveCode: 35.1%
- TermBench: 9.7%
- SciCode: 23.8%
- Omniscience Acc.: 13.6%
- AA-LCR: 26.3%
- τ³-Banking: 6.6%
- IFBench: 32.0%
- MMLU-Pro: 75.9%
- GPQA: 55.7%
- HLE: 2.9%
- AIME: 26.0%
- LiveCode: 49.6%
- TermBench: 16.9%
- SciCode: 35.8%
- SWE-Rebench: 23.3%
- Arena Elo: 1,358
- Omniscience Acc.: 25.5%
- AA-LCR: 29.3%
- τ³-Banking: 4.7%
- IFBench: 34.8%
- MMLU-Pro: 70.6%
- GPQA: 51.6%
- HLE: 3.8%
- AIME: 29.0%
- LiveCode: 40.3%
- SciCode: 27.8%
- SWE-Rebench: 21.6%
- Omniscience Acc.: 16.4%
- AA-LCR: 32.7%
- IFBench: 32.7%
- MMLU-Pro: 71.2%
- GPQA: 52.7%
- HLE: 4.0%
- AIME: 13.0%
- LiveCode: 28.7%
- SciCode: 28.1%
- Arena Elo: 1,354
- Omniscience Acc.: 16.4%
- AA-LCR: 21.3%
- IFBench: 36.5%
- MMLU-Pro: 56.2%
- GPQA: 34.9%
- Arena Elo: 1,288
- Omniscience Acc.: 21.0%
- IFBench: 33.2%
- MMLU-Pro: 69.1%
- GPQA: 50.5%
- HLE: 4.3%
- AIME: 27.0%
- LiveCode: 27.5%
- TermBench: 5.6%
- SciCode: 28.6%
- Omniscience Acc.: 14.8%
- AA-LCR: 20.3%
- τ³-Banking: 6.2%
- IFBench: 33.5%
- GPQA: 37.9%
- HLE: 4.5%
- Arena Elo: 1,276
- Omniscience Acc.: 17.7%
- IFBench: 37.1%
- MMLU-Pro: 63.4%
- GPQA: 40.8%
- HLE: 3.6%
- LiveCode: 31.4%
- TermBench: 10.1%
- SciCode: 27.4%
- Arena Elo: 1,324
- GPQA: 37.1%
- HLE: 3.7%
- Arena Elo: 1,262
- MMLU-Pro: 49.5%
- GPQA: 31.9%
- HLE: 3.9%
- LiveCode: 19.5%
- SciCode: 18.4%
- MMLU-Pro: 54.3%
- GPQA: 30.2%
- AIME: 41.3%
- LiveCode: 39.6%
- SciCode: 11.9%
- IFBench: 17.6%
- GPQA: 62.3%
- HLE: 4.3%
- SciCode: 33.3%
- SWE-Rebench: 9.1%
- Arena Elo: 1,360
- Omniscience Acc.: 23.5%
- AA-LCR: 31.3%
- IFBench: 40.2%
- GPQA: 22.1%
- HLE: 5.5%
- Omniscience Acc.: 10.6%
- AA-LCR: 12.7%
- IFBench: 30.4%
- MMLU-Pro: 71.1%
- GPQA: 49.1%
- HLE: 3.6%
- LiveCode: 55.5%
- SWE-Rebench: 10.1%
- Arena Elo: 1,303
- Omniscience Acc.: 17.5%
- IFBench: 36.9%
- MMLU-Pro: 73.3%
- GPQA: 51.5%
- HLE: 4.0%
- AIME: 3.0%
- SWE-Pro: 11.2%
- LiveCode: 27.7%
- SciCode: 29.9%
- Arena Elo: 1,335
- Omniscience Acc.: 23.2%
- AA-LCR: 25.3%
- IFBench: 39.0%
- MMLU-Pro: 66.4%
- GPQA: 40.9%
- HLE: 4.5%
- AIME: 4.0%
- LiveCode: 23.2%
- SciCode: 26.7%
- Arena Elo: 1,293
- Omniscience Acc.: 19.7%
- IFBench: 34.4%
- MMLU-Pro: 64.2%
- GPQA: 47.1%
- HLE: 4.3%
- AIME: 31.7%
- LiveCode: 30.3%
- TermBench: 4.1%
- SciCode: 20.7%
- Omniscience Acc.: 13.0%
- AA-LCR: 25.7%
- τ³-Banking: 3.7%
- IFBench: 29.1%
- MMLU-Pro: 52.9%
- GPQA: 38.1%
- HLE: 4.3%
- LiveCode: 14.1%
- SciCode: 15.6%
- Arena Elo: 1,357
- MMLU-Pro: 70.4%
- GPQA: 57.5%
- HLE: 3.8%
- AIME: 18.0%
- LiveCode: 23.1%
- SciCode: 26.0%
- Arena Elo: 1,256
- Omniscience Acc.: 14.1%
- IFBench: 23.5%
- MMLU-Pro: 48.5%
- GPQA: 31.5%
- HLE: 5.0%
- LiveCode: 13.1%
- SciCode: 11.0%
- MMLU-Pro: 42.9%
- GPQA: 31.9%
- HLE: 5.4%
- LiveCode: 15.8%
- SciCode: 13.9%
- MMLU-Pro: 80.5%
- GPQA: 67.1%
- HLE: 4.9%
- AIME: 19.3%
- SWE-Pro: 5.2%
- LiveCode: 43.4%
- TermBench: 7.9%
- SciCode: 31.7%
- SWE-Rebench: 11.0%
- Arena Elo: 1,327
- Omniscience Acc.: 24.9%
- AA-LCR: 50.0%
- τ³-Banking: 3.7%
- IFBench: 43.0%
- MMLU-Pro: 57.9%
- GPQA: 40.0%
- HLE: 3.6%
- LiveCode: 17.5%
- SciCode: 22.9%
- Arena Elo: 1,281
- MMLU-Pro: 64.8%
- GPQA: 42.6%
- HLE: 4.2%
- AIME: 14.7%
- LiveCode: 35.5%
- TermBench: 5.6%
- SciCode: 22.9%
- Arena Elo: 1,318
- τ³-Banking: 2.9%
- IFBench: 31.0%
- MMLU-Pro: 57.2%
- GPQA: 42.7%
- HLE: 4.1%
- LiveCode: 14.3%
- SciCode: 16.3%
- Arena Elo: 1,289
- MMLU-Pro: 43.1%
- GPQA: 27.7%
- HLE: 4.2%
- LiveCode: 11.6%
- SciCode: 11.7%
- MMLU-Pro: 56.9%
- GPQA: 35.9%
- HLE: 4.7%
- LiveCode: 21.7%
- SciCode: 22.9%
- Arena Elo: 1,259
- GPQA: 41.4%
- HLE: 3.8%
- SciCode: 24.3%
- SWE-Rebench: 14.6%
- Omniscience Acc.: 14.7%
- AA-LCR: 18.7%
- IFBench: 34.6%
- MMLU-Pro: 51.1%
- GPQA: 32.8%
- HLE: 3.6%
- AIME: 3.3%
- LiveCode: 6.8%
- SciCode: 8.0%
- IFBench: 38.1%
- MMLU-Pro: 69.0%
- GPQA: 46.5%
- HLE: 4.2%
- AIME: 11.0%
- LiveCode: 16.9%
- SciCode: 23.3%
- Arena Elo: 1,299
- Omniscience Acc.: 17.8%
- AA-LCR: 8.3%
- IFBench: 30.7%
- MMLU-Pro: 68.9%
- GPQA: 49.8%
- HLE: 3.6%
- LiveCode: 33.3%
- TermBench: 4.9%
- SWE-Rebench: 11.5%
- Arena Elo: 1,318
- Omniscience Acc.: 19.0%
- AA-LCR: 15.7%
- IFBench: 47.1%
- MMLU-Pro: 46.2%
- GPQA: 29.7%
- Arena Elo: 1,225
- GPQA: 37.4%
- HLE: 4.1%
- LiveCode: 22.5%
- SciCode: 18.6%
- Arena Elo: 1,261
- Omniscience Acc.: 17.6%
- AA-LCR: 27.7%
- IFBench: 36.1%
- GPQA: 29.6%
- HLE: 5.1%
- Arena Elo: 1,223
- Omniscience Acc.: 10.4%
- IFBench: 24.6%
- MMLU-Pro: 74.3%
- GPQA: 58.7%
- HLE: 3.8%
- AIME: 14.0%
- LiveCode: 32.8%
- TermBench: 3.7%
- SciCode: 21.3%
- SWE-Rebench: 6.6%
- Arena Elo: 1,322
- Omniscience Acc.: 15.2%
- AA-LCR: 27.7%
- τ³-Banking: 3.3%
- IFBench: 39.5%
- MMLU-Pro: 52.4%
- GPQA: 35.8%
- HLE: 5.4%
- AIME: 22.0%
- LiveCode: 24.7%
- TermBench: 0.0%
- SciCode: 15.3%
- Omniscience Acc.: 9.0%
- AA-LCR: 17.0%
- τ³-Banking: 4.7%
- IFBench: 26.8%
- MMLU-Pro: 51.5%
- GPQA: 35.1%
- HLE: 3.5%
- LiveCode: 17.8%
- SciCode: 20.8%
- Arena Elo: 1,242
- GPQA: 43.3%
- HLE: 3.8%
- TermBench: 3.4%
- SciCode: 21.8%
- WebDev Elo: 1,192
- Arena Elo: 1,306
- Omniscience Acc.: 12.3%
- AA-LCR: 13.3%
- IFBench: 38.6%
- MMLU-Pro: 60.6%
- GPQA: 34.9%
- HLE: 4.2%
- AIME: 18.3%
- LiveCode: 24.6%
- TermBench: 0.0%
- SciCode: 16.4%
- Arena Elo: 1,342
- Omniscience Acc.: 10.3%
- AA-LCR: 8.3%
- τ³-Banking: 0.8%
- IFBench: 36.7%
- MMLU-Pro: 53.7%
- GPQA: 33.2%
- HLE: 4.0%
- LiveCode: 14.8%
- SciCode: 18.8%
- Arena Elo: 1,229
- MMLU-Pro: 44.7%
- GPQA: 33.6%
- HLE: 5.0%
- AIME: 6.0%
- LiveCode: 18.0%
- SciCode: 11.9%
- Omniscience Acc.: 9.3%
- AA-LCR: 7.0%
- IFBench: 24.8%
- GPQA: 41.7%
- HLE: 3.5%
- SWE-Rebench: 3.1%
- Arena Elo: 1,271
- MMLU-Pro: 65.7%
- GPQA: 51.2%
- HLE: 3.8%
- AIME: 24.0%
- LiveCode: 32.6%
- TermBench: 3.7%
- SciCode: 25.9%
- SWE-Rebench: 0.3%
- Arena Elo: 1,322
- Omniscience Acc.: 13.7%
- AA-LCR: 20.3%
- τ³-Banking: 3.5%
- IFBench: 32.0%
- MMLU-Pro: 52.8%
- GPQA: 33.1%
- HLE: 4.5%
- AIME: 6.7%
- LiveCode: 12.6%
- TermBench: 0.4%
- SciCode: 10.8%
- Omniscience Acc.: 9.5%
- AA-LCR: 15.3%
- IFBench: 21.1%
- MMLU-Pro: 67.5%
- GPQA: 42.8%
- HLE: 4.4%
- AIME: 20.7%
- SWE-Pro: 11.4%
- LiveCode: 29.7%
- TermBench: 4.5%
- SciCode: 23.3%
- SWE-Rebench: 5.4%
- Arena Elo: 1,365
- Omniscience Acc.: 13.0%
- AA-LCR: 7.3%
- τ³-Banking: 0.8%
- IFBench: 31.8%
- MMLU-Pro: 39.7%
- GPQA: 33.1%
- HLE: 2.9%
- LiveCode: 9.3%
- SciCode: 11.8%
- Arena Elo: 1,195
- GPQA: 25.5%
- HLE: 5.4%
- Arena Elo: 1,167
- AA-LCR: 4.3%
- IFBench: 26.2%
- MMLU-Pro: 43.6%
- GPQA: 29.1%
- HLE: 5.3%
- AIME: 12.7%
- LiveCode: 12.6%
- TermBench: 0.4%
- SciCode: 7.3%
- Arena Elo: 1,303
- Omniscience Acc.: 7.7%
- AA-LCR: 6.7%
- τ³-Banking: 0.4%
- IFBench: 28.3%
- GPQA: 17.7%
- HLE: 4.6%
- Arena Elo: 1,110
- Omniscience Acc.: 9.0%
- IFBench: 19.9%
- MMLU-Pro: 48.3%
- GPQA: 25.9%
- HLE: 5.3%
- AIME: 4.3%
- LiveCode: 11.6%
- TermBench: 1.5%
- SciCode: 13.2%
- Arena Elo: 1,211
- Omniscience Acc.: 8.5%
- AA-LCR: 18.0%
- IFBench: 28.6%
- MMLU-Pro: 38.7%
- GPQA: 29.2%
- HLE: 4.7%
- LiveCode: 6.6%
- SciCode: 2.8%
- Arena Elo: 1,197
- GPQA: 19.6%
- HLE: 5.5%
- Arena Elo: 1,111
- Omniscience Acc.: 7.0%
- AA-LCR: 6.7%
- IFBench: 22.8%
- MMLU-Pro: 43.5%
- GPQA: 31.9%
- HLE: 5.0%
- AIME: 0.3%
- LiveCode: 11.6%
- SciCode: 9.0%
- Arena Elo: 1,128
- IFBench: 23.9%
