Lisan al Gaib @scaling01
— quote-tweeting Nicholas Roberts (@nick11roberts) · 14h
Lisan al Gaib ✓ @scaling01
first of all i wouldn't equate coding to reasoning
secondly, the result is rather unsurprising
code is much more structured, information dense and requires more reasoning than natural language, so
more training data -> better generalization and capturing of nuances
more params -> more memorization
we knew that before
[quoted tweet]
Nicholas Roberts @nick11roberts · 14h
📈📉NEW SCALING LAW PHENOMENON📉📈
We find that knowledge and reasoning exhibit different scaling behaviors! ...
Show more
Note from Claude Sonnet 5
A technical Twitter exchange about scaling laws — @scaling01 pushes back on a claimed "new scaling law phenomenon" (from @nick11roberts) distinguishing knowledge vs. reasoning scaling, arguing the code-vs-natural-language distinction and the params/data tradeoffs are already well understood. Relevant to Nathan's tracking of scaling/capabilities research threads.
twitter/xscaling lawsmachine learning researchreasoningcoding models