frontier labs

Matthew Zeitlin @MattZeitlin · 3h Can someone more familiar with the sociology of the AI world explain to me why his tone is "meteorologist who can't contain how excited he is for the formation of this category 5 hurricane" > QUOTED: @ClementDelangue (clem 🤗) · 10h: We suspected last week's cyberattack might have come from a frontier lab, given the sophistication of the agent. Turns out it did! We've spent the past 24 hours working closely ... [truncated by platform ellipsis]

roon @tszzl · 5h elon was right when he said frontier lab is the highest elo game in the world. the teams are incredibly good. few months of delay here and there can cost the entire game. whole thing is extra nerve wracking because most of the parties involved expect infinite consequences

[Browser address bar: x.com/AlexanderLong/status/] Zach Tratar @zachtratar · 12h Are there any new startups attempting to become frontier labs? I'm not talking about SSI or Thinking Machines... smaller. More of the dark horse vibe team... 62 replies, 7 reposts, 216 likes, 42K views Alexander Long @AlexanderLong we have a pretty disproportionate research output for <10 person team. work on architectures you can collaboratively train [Embedded image: "Research" list] Protocol Models: Scaling Decentralized Training with Communication-Efficient Model Parallelism S. Ramasinghe, T. Ajanthan, G. Avraham, Y. Zuo, A. Long | NeurIPS 2025 This is the first work that shows model-parallel training over low-bandwidth networks is possible. Specifically, it demonstrates an 8B LLaMA model being trained on par with centralized training when the devices holding subsequent transformer blocks are in four different locations and connected only via standard internet connections. This was considered completely impossible prior to this work. Nesterov Method for Asynchronous Pipeline Parallel Optimization T. Ajanthan, S. Ramasinghe, Y. Zuo, G. Avraham, A. Long | ICML 2025 Pipeline Parallelism allows large models to train across many small devices by slicing the network into stages. In pipeline parallelism, there is a problem of a "bubble" where devices are idle. It slows down both centralized and decentralized training, but the effect is more pronounced in the decentralized case as communication lag affects the size of the bubble. We solve this, outperforming all existing async techniques and even the synchronous baseline. [Code] Unextractable Protocol Models: Collaborative Training and Inference without Weight Materialization A. Long*, C. Koneputugodage*, S. Ramasinghe, T. Ajanthan, G. Avraham, Y. Zuo | NeurIPS 2025 UPM's facilitate decentralized training while ensuring a full weight set is never available to any single participant. UPMs thus enable collaborative training while making the model unextractable in practice. Mixtures of Subspaces for Bandwidth-Efficient Context Parallel Training S. Ramasinghe, T. Ajanthan, H. Dolatabadi, G. Avraham, V. Shevchenko, Y. Zuo, C. Koneputugodage, A. Long | NeurIPS 2025 We propose a compression method for communication-efficient context parallelism in decentralized set[tings], achieving over 95% compression with negligible overhead and no loss in convergence. The key insi[ght is to] exploit the intrinsic low-rank structure of activations by dynamically constraining them to learned [subspaces] via efficient reparameterizations. This allows scaling billion-parameter decentralized mode[ls to] context lengths exceeding 100K tokens on networks as slow as 300 Mbps, matching the wall-clock convergence of centralized models on 100 Gbps interconnects.

new polemic just dropped – don't build an RL environment startup (unless you're the kind of horse who would take a job at the glue factory) [embedded link card] Don't Build an RL Environment Startup Don't sell blood to vampires Posted Sep 7, 2025 by Benjamin Anderson The first person who sold an RL environment to a frontier AI lab must have felt like they discovered an infinite money glitch. It's no longer a secret that frontier AI labs regularly pay hundreds of thousands, and sometimes millions, for clones of Linear and Salesforce. If you're reading this, you've probably thought about quitting your day job and starting a company that builds these unusually lucrative Next.js apps. In this post, I'll argue that you should hesitate before hopping on the bandwagon.