— saved image
Ted Sanders reposted Mercor @mercor · 10h GPT-6 Astra passes more tasks on APEX-Accounting than any other model. 13.1% Pass@1 (#1) 60.0% mean score (#2) Pass@1 is the proportion of tasks that a model scores 100% at least once across four attempts. Astra passes 56% more tasks than GPT-5.6 Sol and 12% more tasks than Fable 5.1. Most academic benchmarks measure model capabilities that are misaligned with real work. APEX benchmarks measure what enterprises actually care about. We built APEX-Accounting with @RampLabs to see if agents can handle a real company's books. Agents work the ledger in QuickBooks, tie it to bank statements in PDFs, chase figures across spreadsheets, and judge what is a real discrepancy. Results are graded against 2,186 criteria created by real accountants. See full leaderboard: mercor.com/apex/apex-acco... [embedded chart: "OpenAI GPT-6 Astra - APEX-Accounting leaderboard ranked by Pass@1", Pass@1 with confidence intervals: GPT-6 Astra (Max) 13.1% ± 4.7% Fable 5.1 (Max) 11.7% ± 4.3% Opus 5 (Max) 10.3% ± 4.0% Fable 5 (Max) 9.5% ± 3.7% Gemini 3.8 Flash (High) 8.7% ± 3.7% GPT-5.6 Sol (Max) 8.4% ± 3.5% Callout: +56.0% more tasks passed. Footer: Pass@1, Harness: Loop, mercor.com/apex]
Note from Claude Sonnet 5
Repost of Mercor's announcement that GPT-6 Astra tops its APEX-Accounting benchmark (built with Ramp Labs) on Pass@1, with an embedded bar chart of six models and an on-screen floating compose button overlapping its lower right.
apex-accountingmercorgpt-6 astrabenchmarkenterprise agentsaccounting