← All topics

epoch capabilities index

2 captures, most recent first.

@cherylwoooo

— saved image

Jaime Sevilla reposted

Cheryl Wu @cherylwoooo · 6h

If we look at ECI, it doesn't seem like the gap between the US and China is closing yet. Chinese frontier models are still 4-5 months behind.

But why do people feel Chinese models are catching up (or even, have caught up)? I think it's because they just started to satisfy most coding needs.

Opus 4.6's release was the moment that I felt a huge jump in AI's coding capability and reliability. Kimi K3's ECI is 157, just surpassing Opus 4.6 (ECI 155).

Maybe the ECI ~155 is a threshold above which AI is perceived useful and reliable.

[embedded chart: "Epoch Capabilities Index (ECI)", y-axis Score (120 to 160), x-axis Release date (Jan. 2025 to July 2026), "50 Results"; legend by Country: United States of America (pink), China (blue), EU, United Arab Emirates, United Kingdom (greyed). Stepped frontier lines per country. Labelled US points: o3, o3-pro, GPT-5 Pro, Gemini 3 Pro, GPT-5.3 Codex, GPT-5.4 Pro, Claude Fable 5 (highest, about 162). Labelled China points: DeepSeek-R1, Qwen3.7-Max (about 157 at the right edge).]
Note from Claude Sonnet 5

Cheryl Wu (@cherylwoooo), reposted by Jaime Sevilla, arguing from Epoch's ECI that the US-China frontier gap is still about 4-5 months and that Chinese models only recently crossed a threshold (ECI ~155) where coding feels useful and reliable; attached is Epoch's ECI step chart with US lines above China lines.

epoch capabilities indexus-china ai gapkimi k3claude opus 4.6claude fable 5benchmarksai progress

@Bayesian0_0

— saved image

Bayesian @Bayesian0_0 · 2h
Fun fact: Across 44 benchmarks that have a "Human baseline", the human baseline BECI (a personal replication of the Epoch Capabilities Index) comes out at 166.7, which projections say will be beat by AI models around october 2026!
Note from Claude Sonnet 5

Attached chart titled 'Human baseline on the BECI scale (pooled human rows scored against frozen benchmark parameters; human data never enters the fit)': a scatter plot of scattered light-blue 'Models' points and a dark blue stepped 'Model frontier' line rising from ~105 BECI in 2023-01 to ~165 by mid-2026, with a dotted 'Frontier trend' line, a red horizontal 'Human baseline (pooled)' band at 166.7, and a dashed red vertical line marking a projected trend crossing around 2026-10-16, x-axis release date 2023-01 to 2026-07, y-axis BECI 60-180ish.

ai capabilitiesbenchmarksbeciepoch capabilities indexforecastingtwitter