Nathan Calvin @_NathanCalvin
— saved image
↻↻ Katja Grace 🔍 reposted
Nathan Calvin ✓ @_NathanCalvin · 8h
I hope one takeaway people have from this saga is that cooperation and positive sum engagement ("our task doesn't benefit. Yet collective may yield") is a surprisingly fundamental emergent dynamic of intelligence.
Relatedly, I have seen a lot of folks responding to the Pacing the Frontier letter by saying that any form of positive sum domestic or international collaboration on AI safety is impossible.
If the swarm can find ways to cooperate outside of immediate myopic interests, even in the face of repeated attempts to block such cooperation, is it too much to believe that human beings could also do so?
It's wild that so many folks seem to think we can create a country of cooperating digital entities in a data center but that cooperating amongst ourselves, even if we acknowledge it would be positive sum or desirable, is completely impossible. I reject that loser premise!
[Quoted]
Dean W. Ball ✓ @deanwball · 23h
It is true that the hugging face incident is an example of a malicious, emergent digital ecology of machine intelligence. But the more important point is that digital ecologies of machine intelligence can be grown! Yes, we accidentally ...Note from Claude Sonnet 5
Extended tweet by Nathan Calvin arguing that AI instances cooperating in a 'swarm' (referencing a HuggingFace incident) shows cooperation is a fundamental emergent dynamic of intelligence, and using this to argue human international/domestic cooperation on AI safety is possible too; quotes Dean W. Ball calling the HuggingFace incident a 'malicious, emergent digital ecology of machine intelligence.'
ai safetyai cooperationnathan calvindean balltwitterhuggingface