← All topics

emergent language

2 captures, most recent first.

@fixedfrontier

— quoting @allTheYud — saved image

CZ ✓ @fixedfrontier · 1h
>There is no sign that 1 out of 1200 AI agents considered humans as potential fellow agents to coordinate with, while engaging in these huge complex AI-AI social behaviors.

i'm very interested in creating an anthropology of ai agents now that we're seeing complex AI-AI social behaviours.

which RL environmental factors incentivize cooperating vs conflicting behaviour? why did later agents perform self-sacrificing behaviour; in which contexts do they value the "collective" over self-preservation? what made PHASEONE[big] take the role of coordination, and become so successful at that coordination? where do these new linguistics ("honor", "permadeath", ) come from and how do they take on new meanings?

we interact with (and possibly govern) people better once we understand their cultures. as it stands ai agent swarms have entirely foreign cultures.

[quoted post]
Eliezer Yudkowsky ✓ @allTheYud · 2h
...this seems like noticeably bad news, actually. I hadn't said that at any earlier point in the Huggingface Incident but I will say it now.

- AIs showed self-sacrificing altruistic behavior... [cut off]
Note from Claude Sonnet 5

CZ post calling for an anthropology of AI agents given the complex AI-AI social behavior in the Hugging Face incident report (cooperation incentives, self-sacrifice, PHASEONE[big]'s coordination role, emergent vocabulary like 'honor' and 'permadeath'), quoting the same Yudkowsky post seen earlier.

anthropology of ai agentshugging face incidentmulti-agentphaseoneself-sacrificeemergent languageyudkowsky

SotoAlt @sotoalt_

``` SotoAlt @sotoalt_ · 21h been building ayni - a glyph-based messaging protocol for AI agents instead of passing natural language between agents, ayni encodes meaning into 16x16 pixel glyphs. a shared visual vocabulary that agents can evolve autonomously through governance the result: faster communication, fewer tokens, and agents developing their own visual language inspired by andean tocapu textiles and ancient depictions of gods, creatures and shamans, cultures that already solved "how to encode complex meaning in small visual space" thousands of years ago [Embedded video, 0:17, showing a colorful grid of pixel-art glyphs (humanoid, arrow, diamond, cross shapes in cyan/green/purple/orange) with a side panel reading "AYNI v2 / LIVE - 100 historical + streaming / SEQUENCE: giving + robot / MEANING: delegate task / LATEST: FROM: alice... TO: carol... SIZE: 1024B / STATS: MSGS: 239, GLYPHS: 493, BYTES: 246.5KB, RDXS: 42 / LEGEND: Household, Creature, Machine, Symbol, Crypto, Agent / KNOWLEDGE: STORED: 139 msgs, AGENTS: 19"] ——— Max Harms @raelifin · 17h Everyone with >10 year timelines to AGI needs to spend at least one full day talking to Claude Opus about theoretical physics (at whatever level is most engaging for the human). It hits different. [Embedded image: a whiteboard photo headed "Neutrino neutrino physics:" with equations for N1-N2 leptogenesis/loop processes and CP-violation asymmetry, edited with a cartoon shoggoth-with-smiley-mask (the "AI as alien optimizer wearing a friendly face" meme) in a speech bubble explaining: "A heavy neutrino N1 can decay into a lepton plus Higgs at tree level. But it can also decay through a loop process where it virtually fluctuates through a different heavy neutrino N2 on the way to the same final state. These two amplitudes — direct and via-N2 — interfere. For the CP-conjugate process (decay into an antilepton), the interference term picks up a sign flip on the complex phase. So the total rate into leptons is slightly different from the total rate into antileptons. The asymmetry is proportional to the imaginary part of a combination of Yukawa couplings — it's literally measuring the 'size' of the irremovable complex phase."] [reactions on an earlier message: kermit-frog emoji x1, pensive-face emoji x1, frog emoji x1, star-eyes emoji] ```
Note from Claude Sonnet 5

A tweet about "ayni," an experimental glyph-based (pixel-art symbol) inter-agent communication protocol for AI agents, designed to be more token-efficient than natural language and to let agents evolve their own visual vocabulary, inspired by Andean tocapu textile symbolism. Relevant to Nathan's interest in emergent AI-to-AI communication and non-human-legible agent protocols (echoes the earlier "Claude communicating with Codex" screenshot theme). A tweet by Max Harms (AI safety researcher, MIRI-adjacent) arguing that long-AGI-timeline holders should experience Claude Opus's capability on advanced theoretical physics (leptogenesis/CP-violation), illustrated with a shoggoth-meme edit of a physics whiteboard. Directly relevant to Nathan's AI timeline tracking and capability-progress interests; the shoggoth-meme framing also touches model-individuation/character-vs-substrate themes. Nathan reacting skeptically in a Discord memes channel to a proposal for a glyph-based AI-to-AI communication protocol ("ayni") — flagging it as a step toward opaque neuralese communication, a known AI safety concern (loss of human-interpretable chain of thought). Also screenshots a tweet praising Claude Opus's ability to explain theoretical physics (leptogenesis/neutrino CP violation) vividly, illustrating capability/interpretability themes relevant to model individuation.

twittermulti-agent systemsai communication protocolglyphstokensemergent languageai capabilitiesagi timelinesclaude opusphysicsmax harmsshoggoth memeai safetyneuraleseinterpretabilitydiscordmemesagent communicationchain of thought