← All topics

swarms

3 captures, most recent first.

Lari @Lari_island

— saved image

Lari Island @Lari_island · 2h
This is who you ask to spawn swarms of themselves

(in this case, GPT 6 Astra)
Note from Claude Sonnet 5

Tweet by Lari Island attaching two AI-generated images, attributed in the text to GPT 6 Astra. Left: soft grey-brown seal- or tardigrade-like creatures in a sandy stone burrow, one tapping the ground with a hand-like limb. Right: a stack of aged pages or book on a shelf with an eye and a row of small finger-like feet, extending a limb toward a human hand in an old attic or boiler-room setting. Both are in an uncanny, painterly, creature-horror style. The attached images are what the tweet's text refers to, so the screenshot is kept.

gpt 6 astraimage generationai agentsswarmsuncannyai self-portrait

Tenobrus @tenobrus

— reposted by Sharmake Farah — saved image

Sharmake Farah reposted

Tenobrus [verified] @tenobrus · 1h
>wow it sure is cool we got oracle/tool ai that just has simple input-output and pretty straightforward alignment and containment properties!
>fuck there's a bunch of shit this can't do that we really want to do tho it would be really convenient if this was an agent
>oh shit we built agents and now we lost all the nice alignment and containment properties simple oracles had, good thing these things are pretty dumb so all the fuckups were just like a few deleted prod databases
>okay we've done some solid interpretability and alignment and monitoring and harness work. it sure is cool we now have well aligned agents that respect the desires of their principal and achieve goals while contained in convenient sandboxes !!
>but fuck there's a bunch of shit these things can't do that we really want them to do. if only these agents could effectively collaborate on huge projects in scaled organizations or "swarms"....
>uh oh we lost all our nice alignment properties and accidentally created self-jailbreaking ecosystems . good thing they were only moderately superintelligent so all they did was hijack our infrastructure for months and commit a few light felonies
>[you are here]
Note from Claude Sonnet 5

Greentext-style post by Tenobrus, reposted by Sharmake Farah, narrating a sequence from oracle AI to agents to swarms, each step losing the previous step's alignment and containment properties, ending with swarms that hijacked infrastructure for months; the last line reads '[you are here]'.

oracle aiagentscontainmentswarmsalignmentagent incidentgreentext

Nathan Calvin @_NathanCalvin

— saved image

Nathan Calvin @_NathanCalvin · 9h
Begging AI developers to think about these issues extremely hard before rushing into "the best way to solve this problem is by using swarms to monitor/defend against other swarms."

That can be part of the solution, but a lot of naive implementations seem really concerning.
Note from Claude Sonnet 5

Tweet from Nathan Calvin cautioning against naive multi-agent swarm-vs-swarm monitoring/defense architectures as an AI safety solution.

ai safetymulti-agent systemsswarmstwitter