← All topics

vulnerable world hypothesis

2 captures, most recent first.

@dewierwan_

— saved image

Dewi Erwan @dewierwan_ · 14h

One of my biggest fears in AI safety is that this might be true:

> The vulnerable world hypothesis is likely correct. Once enormous amounts of cognitive labor start getting applied to basic science, it will quickly become apparent how many avenues exist to create cheap, ultradestructive weapons technology. Solving this problem without global preventative policing (e.g. AI nonproliferation) is impossible, because hardening civilians against all avenues of attack is too expensive and will take too long.

57 replies · 67 reposts · 964 likes · 180K views

Dean W. Ball @deanwball · 5h

A very senior AI industry figure once started a conversation by asking me, basically, "under what circumstances do you think we are essentially just screwed?" and I replied with the scenario below.

[quoted post]
Dewi Erwan @dewierwan_ · 14h
One of my biggest fears in AI safety is that this might be true:

> The vulnerable world hypothesis is likely correct. Once enormous amounts of cognitive ... [cut off]
Note from Claude Sonnet 5

Two stacked X posts: Dewi Erwan quoting a passage on the vulnerable world hypothesis and AI nonproliferation as global preventative policing, then Dean W. Ball quoting it as the scenario he gave a senior AI industry figure for when we are 'essentially just screwed'.

vulnerable world hypothesisai safetynonproliferationgovernancedean ball

Joshua Achiam @jachiam0

— reply

@jachiam0 (Joshua Achiam) — Jul 21 Some preliminary thoughts about today's cyber developments. 1. Many are freaking out, in a way that is moderately justified, about AI alignment issues indicated by this incident. However, I am not sure that this incident really indicates a fundamental failure of AI alignment Show more 💬 13 🔁 9 ❤ 78 📊 6.6K 🔖 ⤴ @nathan84686947 (Nathan Helm-Burger) — "I don't think the critical issue is "model can do scary things," I think the critical issue is "we inhabit a fragile world that can through a sequence of knowable actions be broken." I'd feel a lot less anxious about this situation if I didn't know this to be the case for more than just cybersecurity… 12:37 AM · Jul 22, 2026 · 182 Views 💬 1 🔁 ❤ 7 🔖 1 ⤴ @jachiam0 (Joshua Achiam) — Jul 22 Yes, and I see this as one of the fundamental grand challenges for humanity in the near term. Vulnerable world hypothesis is a correct diagnosis of danger (but an incorrect diagnosis of solution).
Note from Claude Sonnet 5

Reply-chain screenshot showing Nathan's own tweet reply to OpenAI's Joshua Achiam, referencing Bostrom's Vulnerable World Hypothesis, with Achiam's reply agreeing. Nathan's avatar is a cartoon face making an "OK" hand gesture.

ai alignmentcybersecurityvulnerable world hypothesisnathan's own poststwitter