snwy

snwy @snwy_me · 16h i've been using GPT-5.4 as an autonomous research agent (via Codex) with 24/7 access to an H100 and it has been training/RLing/generating data/repeat a 9B model for the past little while and it is getting crazy fucking good > QUOTED: Andrej Karpathy @karpathy · 16h > I packaged up the "autoresearch" project into a new self-contained minimal repo if people would like to play over the weekend. It's basically nanochat LLM training core stripped down to a single-GPU, one file version of ~630 ... > [Embedded image: chart titled "autoresearch", "Autoresearch Progress: 83 Experiments, 15 Kept Improvements", a step-down line graph of Validation BPB (lower is better) vs Experiment #, showing improvement from ~1.000 to ~0.977 across labeled experiment tweaks (e.g. "raise total batch size", "warmstart LR", "add TF residual", "depth 8 aspect ratio 32"). Caption below: "One day, frontier AI research used to be done by meat computers in between eating, sleeping, having other fun, and synchronizing once in a while using sound wave interconnect in the ritual of 'group meeting'. That era is long gone. Research is now entirely the domain of autonomous swarms of AI agents running across compute cluster megastructures in the skies. The agents claim that we are now in the 10,205th generation of the code base, in any case no one could tell if that's right or wrong as the 'code' is now a self-modifying binary that has grown beyond human comprehension. This repo is the story of how it all began. -@karpathy, March 2026."]