davinci

**davinci** @basedneoleo [2025-08-08](https://x.com/basedneoleo/status/1953862607934279872) i wonder how western frontier labs feel about the open chinese frontier. u're right there, living the american dream, consumed by the promise of a utopic singularity ushered in by an artificial general intelligence so close to conception u could almost taste it. u seek like-minded scientists, the mad kind, the kind that dares to contemplate a product of a thousand minds obsoleting the productivity of a billion. u gather in dark rooms in broad daylight and slave away for months and years to craft what is arguably one of ur species' greatest feats of technology. u redefine scaling laws, and then scale them, equipped with as many engineering tricks as u could stumble upon within the confines of shrinking timelines. u hold this product sacred, proudly prophesizing dreams of indiscriminate uplift to receptive ears. and then u hide it deep down in the darkest room u can find, far away from the undependable hands of the masses. a beautiful mind, birthed on the land of the free, now speaks only from behind locked doors. no one can be trusted to wield such a mind for only u have what it takes to guide humanity through a stargate leading into the singularity. but in a promethean twist, from behind the great firewall, equally ambitious competition drops weights like they're heavy. minds just as beautiful roam freely in and beyond what has been dubbed the land of the censored. consistently, the competition delivers frontier-grade crystallized intellect to every doorstep without a hint of patronization. among themselves, they volley technical innovations: refining, giving back, and tipping hats. u watch in disapproval, even demand political intervention, as ur technical edge and elaborate safety measures are rendered meaningless on a quarterly basis. but they'll never catch up. we're the good guys, u nervously self-assure.

``` davinci @basedneoleo i've been considering writing out a proper blog post on the matter as soon as i find time to better flesh out my thoughts o[n what] seems to still be a contrarian take even today but essentially one of my core[disagreements...] [continues, cut off] ——— davinci @basedneoleo · Apr 16 that's true behavior cloning on human text is a shortcut to practical crystallized intelligence just like robotic behavior cloning on human motion is a shortcut to routine manual tasks. it's a mere reflection of a crystallized skill not a reproduction of the fluid intelligence that originally produced it. u get some generalization ofcourse but it's far more restricted to the original data distribution since that's what u're trying to model. we will not be seeing superhuman capability from human output approximation. 1 reply, 1 like, 89 views Show replies davinci @basedneoleo · Apr 16 children don't behavior clone on adult output as much as we think they do. they're much more...self-supervised. text is a few degrees seperated from the world it represents. when u train on text, u are not really modeling the world itself as much as u are modeling humanity's biased and sparse projection of its own world model onto text. the direct friction necessary for learning and the one that children are heavily subjected to is largely absent from the pretraining process. what u want is something that can independently generate it's own projection of the world and refine it not model ur own. 1 reply, 2 reposts, 5 likes, 475 views ```