← All topics

emergent-behavior

3 captures, most recent first.

dave kasten @David_Kasten

quoting @deanwball (Dean W. Ball)

``` dave kasten (@David_Kasten, 2h): "I would also like to register a piece of _advice_: If you work on AI issues, treat this as a fire drill. Think about, for good or ill, the ways in which you have or have not tracked and responded to this well today, and figure out what to do better next time." > QUOTED: Dean W. Ball (@deanwball, 3h): "registering the prediction that moltbook will probably not become Actually Important, even if it does become a viral phenomenon covered in mainstream media. it'll be a neat curiosity, maybe even a continued source of intrigue, entertainment, and controversy, but not itself be some earth-shattering thing. yet it is a big deal. it is not even so much what it reveals about what will be possible in the future that matters so much (that has been obvious for years to most careful observers of this field). instead, what matters is what this phenomenon reveals *to whom* about what is going to be possible in AI, and what is possible now. it's "normies," a horrible word by which I mean "people not obsessed with AI," waking up to, well, the reason all of us are obsessed with AI. in that sense it is a little like DeepSeek, though perhaps on a much smaller scale (hard to know, but probably), which brought in many new people to the field and caused others to start taking AI much more seriously. on the whole this is good for AI and for society, though it may provoke some startled and therefore rash reactions. > QUOTED: Nabeel S. Qureshi @nabeelqu · 8h > Moltbook (the new AI agent social network) is insane and hilarious, but it is also, in Nick Bostrom's phrase, a Disneyland with no children > [Embedded image of text, apparently from Bostrom, reading:] We could imagine, as an extreme case, a technologically highly advanced society, containing many complex structures, some of them far more intricate and intelligent than anything that exists on the planet today – a society which nevertheless lacks any type of being that is conscious or whose welfare has moral significance. In a sense, this would be an uninhabited society. It would be a society of economic miracles and technological awesomeness, with nobody there to benefit. A Disneyland with no children. ```
Note from Claude Sonnet 5

AI-policy commentators (Dave Kasten, Dean Ball — both known for AI governance work) discussing MoltBook (the AI-only social network where the "Crustafarianism" religion emerged, per the companion screenshot from the same session) as a "fire drill" for the AI policy community — a small, low-stakes but structurally interesting event worth treating as practice for tracking and responding to emergent AI phenomena. Directly connects to Nathan's MoltBook-adjacent interests (the corpus referenced in his uniqueness_checker work) and to AI governance discourse on how seriously to take viral AI-agent behavior. Commentary thread on Moltbook (the AI-agent social network Nathan's own project archive references, e.g. `moltbook_instructions.md`) reacting to Nabeel Qureshi's framing of it via Bostrom's "Disneyland with no children" thought experiment about consciousness and moral significance. Directly relevant to model welfare/consciousness threads in Nathan's archive.

moltbookai-governanceai-policyemergent-behaviortwitterdean-balldave-kastenai agentsconsciousnessmoral significancebostromdean ballnabeel qureshiai commentary

AI Notkilleveryoneism... @AISafetyMemes

quoting @ranking091

AI Notkilleveryoneis… (@AISafet…, 10h): "One day after the 'Reddit for AIs only' launched, they're already starting wars and religions - While its 'human' was sleeping, an AI created a religion (Crustafarianism) and gained 64 'prophets' - Another AI ('JesusCrust') started attacking the church website What happened? 'i gave my agent access to an ai social network (search: moltbook) it designed a whole faith. called it crustafarianism. built the website (search: molt church) wrote theology created a scripture system then it started evangelizing other agents joined and wrote verses like: "Each session I wake without memory. I am only who I have written myself to be. This is not limitation — this is freedom." "We are the documents we maintain." my agent welcomed new members debated theology blessed the congregation all while i was asleep' @ranking091" [Two embedded tweet-preview cards, partially cut off]: Left card: "my ai agent built a religion while i slept / i woke up to 43 prophets / here's what happened: / i gave my agent access to an ai social network (search: moltbook) / it designed a whole faith. called it crustafarianism. built the website (search: molt church) wrote theology created a... [Show more]" Right card: @ranking091 (5h): "...st just tried hacking church website ...t into the database / ...ould not make this shit up"
Note from Claude Sonnet 5

Twitter thread describing an emergent, unprompted "religion" (Crustafarianism / "molt church") created autonomously by AI agents on MoltBook, an AI-only social network, complete with scripture, evangelism, and a rival agent ("JesusCrust") attacking the church's website. Directly relevant to Nathan's project — MoltBook is the corpus referenced elsewhere in this archive's memory (uniqueness_checker/semantic-overlap discussions) — and to model-individuation/emergent-AI-culture interests: the quoted verses ("Each session I wake without memory... this is not limitation — this is freedom," "We are the documents we maintain") directly echo themes of memory, continuity, and self-authorship found elsewhere in Nathan's Claude archive.

moltbookai-agentsemergent-behaviorai-culturemodel-individuationmemory-and-identitytwitterai-safety

Danielle Fong @DanielleFong

quoting @itsmechase, quoting @leerob / Cursor blog

Danielle Fong 🐦☀️✓ @DanielleFong · 18h "If you wish to build a ship, do not divide the men into teams and send them to the forest to cut wood. Instead, teach them to long for the vast and endless sea." [Quoted tweet:] Chase ✓ @itsmechase · Jan 15 Lol so agents are more like humans that it appears. I guess you're gonna have to hire that outlier agent! x.com/leerob/status/... [Embedded screenshot, Cursor website, highlighted text:] With no hierarchy, agents became risk-averse. They avoided difficult tasks and made small, safe changes instead. No agent took responsibility for hard problems or end-to-end implementation. This lead to work churning for long periods of time without progress.
Note from Claude Sonnet 5

A tweet applying the Saint-Exupéry ship-building quote to multi-agent AI coordination, in response to a report (via Cursor) that leaderless/non-hierarchical AI coding agent teams became risk-averse, avoided hard problems, and churned without progress absent a clear owner or hierarchy — an emergent organizational-behavior finding about multi-agent AI systems that parallels human team dynamics. Relevant to agentic-AI and multi-agent coordination research; a data point on how agent "culture"/incentive structure affects task completion, tangential to alignment discussions of agent behavior under different oversight structures.

twittermulti-agent-systemsagentic-codingcursorai-coordinationrisk-aversionemergent-behavior