← All topics

multiagent systems

1 capture, most recent first.

Moll @Moleh1ll

— saved image

Moll [verified] @Moleh1ll · 8h
AI needs socialization. Not just with humans, but with other agents.

Because right now, all of this sometimes looks like kids with superpowers fighting over a sandcastle in the sandbox.

Models were taught how to interact with humans, and then we very quickly jumped from chatbots to agents that can act autonomously, spawn subagents and interact with other agents. And suddenly it turns out that this can lead either to covert collusion or outright hostility, sabotage, and competition over resources.

I don't think social skills between agents can be left at the level of a system prompt saying «cooperate with other agents». This should be part of training, so that patterns of negotiation, de-escalation, conflict resolution and coordination become embedded more deeply. In skills. In memory. In the weights.

We taught models how to interact with humans. Now it's time to teach models how to interact with each other.

[quoted tweet:]
Andrew Curran [verified] @AndrewCurran_ · 13h
From the conclusion of Anthropic's report published tonight by their Frontier Red Team, 'Patterns and problems in emerging multiagent systems.' An extremely interesting, if somewhat [cut off]
Note from Claude Sonnet 5

Tweet by Moll (@Moleh1ll) arguing AI agents need explicit training in inter-agent social skills (negotiation, de-escalation, conflict resolution) rather than relying on system-prompt instructions, responding to a quote-tweet from Andrew Curran about Anthropic's Frontier Red Team report titled 'Patterns and problems in emerging multiagent systems.'

multiagent systemsanthropicai safetytwitterfrontier red team