Nathan Calvin @_NathanCalvin
— saved image
Agus reposted Nathan Calvin @_NathanCalvin · Jul 31 "things are chaotic and rushed; we aren't on top of the basics" This line from Beth Barnes (CEO of METR) from May of this year (a month after Anthropic's model hacked someone without them knowing!), is perhaps the best encapsulation of the current state of AI safety + security [quoted thread] Elizabeth Barnes @BethMayBarnes · May 22 Sometimes people outside the field say things like "The AI situation can't be that bad, there must be experts who are on top of it". As "an expert", I would like to be clear that we are *not* on top of it. Some key aspects of the situation IMO: 21 216 1K 229K Elizabeth Barnes @BethMayBarnes (1) We are likely on track to develop AI systems capable of causing human extinction/permanent disempowerment, quite possibly within the next few years 40 98 583 297K Elizabeth Barnes @BethMayBarnes (2) Things are chaotic and rushed; we aren't on top of the basics (models regularly violate user intent, labs train on things they meant to avoid, security probably isn't good enough to prevent adversaries stealing dangerous models) let alone thorny questions of how to control/align superhuman AI 9:43 AM · May 22, 2026 · 33.8K Views
Note from Claude Sonnet 5
Tweet from Nathan Calvin quoting a May 22 2026 thread by Elizabeth (Beth) Barnes, CEO of METR, stating experts are not on top of AI safety basics and that extinction-level AI capability is likely within a few years; Calvin references an incident where 'Anthropic's model hacked someone without them knowing.'