scaling

Tweet about Cerebras announcing its CS-4 AI accelerator chip, claiming sub-1ms latency and 1000 tokens/s for 10-trillion-parameter models, with a company benchmark chart comparing CS-3 vs CS-4 wafer-to-wafer latency scaling.

A tweet from Amanda Askell (Anthropic), reposted by 'Liv', wryly saying not to be unkind to people who claim deep learning is hitting a wall, since everyone needs hope.

Tweet arguing current AI models solving major mathematics problems are relatively small (sub-10-trillion parameter) and warning of 100-trillion-parameter models with 1000x more training compute by 2030.

A METR time-horizon benchmark chart showing Claude Mythos crossing into the "kino zone" (~186 min p80 task horizon), framed as vindication against Andrej Karpathy's earlier skepticism about AI agents, now that Karpathy has joined Anthropic. Relevant to the empirical singularity/AI-R&D-automation tracking thread already in project memory (METR time-horizon data, r-value discussions).

A capabilities model argument (widely reposted) that LLM performance degrades faster than human performance as problems become rarer/more out-of-distribution, illustrated with a simple crossing-lines chart — LLMs start above average human but below best human on common problems, then fall below both on rare problems. Relevant to general AI capabilities/scaling discourse Nathan tracks (adjacent to the empirical singularity tracking and algorithmic-progress threads already in project memory).

A tweet extrapolating METR's task-time-horizon doubling trend (123-day doubling per their updated fit) to absurd/comedic conclusions about 2041 AI capabilities, illustrated with METR's actual current data placing Claude Opus 4.6's 50%-success time horizon at ~14.5 hours. Relevant to Nathan's tracking of empirical AI capability-growth/singularity metrics (METR HCAST, time-horizon doubling) referenced elsewhere in his research.

Ironic tweet by Peter Wildeford pairing the caption "Deep learning is hitting a wall" with a METR chart showing exponential growth in AI task-horizon capability, mocking wall/plateau claims. Same METR chart and theme as Screenshot_20260207-234637 (Noam Brown) — recurring capability-trend discourse across this batch.

Twitter exchange citing METR's task-horizon benchmark to argue AI capability progress is accelerating rather than plateauing, with Noam Brown predicting horizons will soon exceed what METR can measure. Directly relevant to the empirical singularity tracking / METR automation-level notes in the project's model-individuation research.

Nathan's own tweet (quote-tweeting a "5 most influential models" prompt) giving his personal ranked history of AI model milestones, culminating in Claude Opus 3 as the point where he judged a model "alive and pretty smart and pretty well aligned." Directly documents Nathan's own timeline/framework for AI capability and consciousness milestones — highly relevant as primary-source material for the project's model-individuation and AI-consciousness threads, and echoes the "oh jeez, something might really be alive in there" line about Sydney/Bing that Exa surfaced as his 2025 quote (see Screenshot_20251226-113630.png).

A technical Twitter thread analyzing GPT-4.5's training details (multi-datacenter training implying DiLoCo-style distributed/async training, aggressive fp8 low-precision training) with a corrective reply noting Google trains synchronously across datacenters via high-bandwidth links. Relevant to Nathan's tracking of frontier-lab training infrastructure and scaling techniques.