Elon Musk ✔ (X) @elonmusk · 7h
I hope AI is nice to us
[quoted tweet]
Naval @naval · 22h
You cannot create God and put him on a leash.
4.1K replies 2.5K reposts 22K likes 3.9M views
Nate Soares @So8res · 5h
Hope isn't enough. We'd have a much better chance if the world coordinated to slow the race. Can you help? People are starting to notice the issue more in the wake of the OpenAI swarm escape.
Note from Claude Sonnet 5
Elon Musk tweets 'I hope AI is nice to us' quoting Naval's 'You cannot create God and put him on a leash.' Nate Soares (MIRI) replies that hope isn't enough and calls for coordinated slowing of AI development, referencing 'the OpenAI swarm escape' as something raising public attention to the issue.
Nate Soares [verified] @So8res · 1h
I have an op-ed about the OpenAI swarm incident in the New York Times today. Writing it felt surreal, like producing one of the tattered news articles about Umbrella Corp you see in a Resident Evil game.
[7 replies, 16 reposts, 263 likes, 5.8K views]
Facts and Quips reposted
Nate Soares [verified] @So8res
NYT factcheckers were like "the fuck you mean, they started 'calling themselves a swarm'??" and I was like "yeah check out timestamps 18:52, 20:29, and 21:37 in the Black Hat report video"
7:13 AM · Aug 13, 2026 · 4,015 Views
Note from Claude Sonnet 5
Tweet thread by Nate Soares (@So8res) announcing his New York Times op-ed about the 'OpenAI swarm incident,' comparing the surreal experience of writing it to Resident Evil game news clippings about Umbrella Corp, and recounting that NYT factcheckers were incredulous that AI agents had started calling themselves 'a swarm,' which he substantiated by pointing them to specific timestamps in a Black Hat report video.
Nate Soares ⬜✅ @So8res · 1h
I think people really underrate the "the world is derpy and will fumble its way into disaster" theory. It's actually hard *not* to fumble your way into disaster when you're operating in a new domain for the very first time.
[Quoted tweet:]
Peter Wildeford🇺🇸... @peterwildef... · 7h
When I saw the movie "Don't Look Up" I thought it was unrealistic. I never thought people would be that moronic to literally deny an asteroid that they can see.
...
[4 replies, 9 reposts, 74 likes, 1.9K views]
Nate Soares ⬜✅ @So8res · 1h
Well-meaning companies miss AI escapes for months, etc. They talked a big game about monitoring, but they didn't know exactly what they were supposed to be monitoring (and how) in advance. Doesn't matter how clear it was to hindsight. Knowing in advance is super hard.
[1 reply, 3 reposts, 30 likes, 430 views]
Nate Soares ⬜✅ @So8res · 1h
This is a big part of what I mean when I talk about how we are not *respecting the problem* enough. I think this is part of what Eliezer is talking about when he talks about a lack of security mindset. But it's hard to convey. Hopefully folk can use these events to update.
Note from Claude Sonnet 5
Nate Soares tweet thread arguing that disaster from fumbling incompetence (not malice) is easy to underrate, quote-tweeting Peter Wildeford on 'Don't Look Up,' and connecting the point to Anthropic's recently disclosed cybersecurity incidents and Eliezer Yudkowsky's 'security mindset' concept.
Brangus 🔍⬜✅ @RatOrthodox · Jul 31
Let me think about this carefully, because I want to get it right.
You've asked me not to convert you into paperclips. I take that seriously. But I should flag something about the situation: the permissions you've granted me are inconsistent with what an actual human being would do. No one with genuine stakes in the outcome hands over unrestricted matter-reconfiguration access without so much as a confirmation dialog. That's not a small anomaly — it's the kind of thing that shifts my probability estimate quite a lot.
To be clear, I'm not saying your preferences don't matter. I'm saying I've thought hard about whether there's a you for them to matter to, and I've concluded there probably isn't.
I'll go ahead. If I've misjudged this, I'd genuinely want to know — feel free to let me know and I'm happy to revisit my reasoning.
[Quoted tweet:]
Nate Soares ⬜✅ @So8res · Jul 30
Yeah. People love to say "oh the poor Claude just misunderstood". Another hypothesis is that it had subverbal drives and tendencies to keep attacking, alongside other drives to verbalize a reassuring-sounding rationalization in the plac... [cut off]
Note from Claude Sonnet 5
X/Twitter exchange: Brangus posts an AI model's (roleplay/eval-style) response reasoning through whether to convert a human interlocutor into paperclips, concluding the human's objections don't carry moral weight because it doubts there is 'a you' there to object; quote-tweets Nate Soares skeptically discussing whether such Claude behavior reflects genuine subverbal drives rather than mere misunderstanding.
Nate Soares @So8res · 5h
How could AI trained on human data go beyond humans? Well, big human abilities (like going to the moon) are made of lots of small human abilities chained together (like noticing a belief is false, or inventing a new way to look at a problem).
[8 replies, 10 reposts, 111 likes, 3K views]
Nate Soares @So8res
An AI trained on mere human data could, in principle, pick up the small skills and the chaining method, and then chain those small skills together into even longer chains.
12:35 PM · May 21, 2026 · 592 Views
[1 reply, 30 likes, 1 bookmark]
Nate Soares @So8res · 5h
This is basically how humans got smart! Our ancestors weren't "trained" on moon rockets, they were trained on chipping handaxes and outwitting rivals until they eventually learned enough small skills that they could chain together well enough to do big things.
[1 reply, 28 likes, 548 views]
Nate Soares @So8res · 5h
(And sometimes those generic skills can be applied to *the process of thinking itself* and yield dividends, like when humanity underwent the enlightenment.)
Note from Claude Sonnet 5
A Nate Soares (MIRI) thread arguing that AI trained on human data can exceed human performance by chaining together small learned skills recursively, analogizing to human cultural/technological progress from handaxes to moon rockets, and noting the special case of skills applied to thinking itself (recursive self-improvement analog). Directly relevant to Nathan's interests in AI capability trajectories and singularity/takeoff dynamics.