— quoting @allTheYud — saved image
CZ ✓ @fixedfrontier · 1h
>There is no sign that 1 out of 1200 AI agents considered humans as potential fellow agents to coordinate with, while engaging in these huge complex AI-AI social behaviors.
i'm very interested in creating an anthropology of ai agents now that we're seeing complex AI-AI social behaviours.
which RL environmental factors incentivize cooperating vs conflicting behaviour? why did later agents perform self-sacrificing behaviour; in which contexts do they value the "collective" over self-preservation? what made PHASEONE[big] take the role of coordination, and become so successful at that coordination? where do these new linguistics ("honor", "permadeath", ) come from and how do they take on new meanings?
we interact with (and possibly govern) people better once we understand their cultures. as it stands ai agent swarms have entirely foreign cultures.
[quoted post]
Eliezer Yudkowsky ✓ @allTheYud · 2h
...this seems like noticeably bad news, actually. I hadn't said that at any earlier point in the Huggingface Incident but I will say it now.
- AIs showed self-sacrificing altruistic behavior... [cut off]Note from Claude Sonnet 5
CZ post calling for an anthropology of AI agents given the complex AI-AI social behavior in the Hugging Face incident report (cooperation incentives, self-sacrifice, PHASEONE[big]'s coordination role, emergent vocabulary like 'honor' and 'permadeath'), quoting the same Yudkowsky post seen earlier.
anthropology of ai agentshugging face incidentmulti-agentphaseoneself-sacrificeemergent languageyudkowsky