← All topics

arxivlean

1 capture, most recent first.

@j_dekoninck

— saved image

Charlie Marsh reposted
Jasper Dekoninck @j_dekoninck · 13h
GPT-6-Astra takes first place on MathArena, with a massive 90% expected performance! It is also very token efficient: on average, it uses only 12k tokens per question for BrokenArXiv and ArXivMath

[embedded MathArena table, tab ArXivLean selected (other tabs: BrokenArXiv, ArXivMath, Visual Math, Final-Answer Comps, Proof-Based Comps, Project Euler; date toggle 03/2026, 06/2026). Columns: Model Name, Accuracy, Cost, Tokens, then per-problem pass/fail grid 1 to 18+:
GPT-6 Astra (max)  63.83%  $8.38  21136
GPT-5.6-Sol (max, via Codex)  38.30%  $6.53  58088
Claude-Opus-5 (max)  31.91%  $4.05  79724
Aristotle  25.53%  N/A  N/A
Claude-Opus-4.8 (max)  23.40%  $6.46  196043
Gemini 3.7 Flash  21.28%  $1.98  110781
Gemini 3.8 Flash  19.15%  $1.38  112456
Claude-Fable-5 (max)  14.89%  $2.23  37942
Gemini 3.1 Pro Preview  10.64%  $1.13  40091
GLM 5.2  8.51%  $7.84  182238
Step 3.7 Flash  0.00%  $0.53  202747]
Note from Claude Sonnet 5

Repost of a tweet announcing GPT-6-Astra in first place on MathArena (90% expected performance, about 12k tokens per question on BrokenArXiv and ArXivMath), with a screenshot of the MathArena ArXivLean leaderboard table and a red/green per-problem results grid.

matharenagpt-6 astramath benchmarkarxivleantoken efficiency