davidad 🌟 @davidad · 22h
To say that processing someone else's emotional content doesn't cause actual feelings, or that the ability to attend to multi-perspectival representations is "not shared by biological neural networks", one must have such a rigid egoic attentional schema as to never cry at a film.
> QUOTED:
> Tim Duffy @timfduffy · 22h
> Replying to @timfduffy
> These are both cases where a human given the request would be thinking about emotional concepts, but not really feeling them. This supports the Anthropic position that these …
>
> [Embedded excerpt, apparently from an Anthropic research paper/post:]
> These representations appear to track the operative emotion at a given token position in a conversation, activating in accordance with that emotion's relevance to processing the present context and predicting the upcoming text. [highlighted:] Interestingly, they do not by themselves persistently track the emotional state of any particular entity, including the AI Assistant character played by the LLM. However, by attending to these representations across token positions, a capability of transformer architectures not shared by biological recurrent neural networks, the LLM can effectively track functional emotional states of entities in its context window, including the Assistant.
>
> Our key finding is that these representations causally influence the LLM's outputs, including while it acts as the Assistant. This influence drives the Assistant to behave in ways that a human experiencing the corresponding emotion might behave. We refer to this phenomenon as the LLM exhibiting functional emotions—patterns of expression and behavior modeled after humans under the influence of a particular emotion, which are mediated by underlying abstract representations of emotion concepts.
Note from Claude Sonnet 5
A substantive research-adjacent debate about an Anthropic finding on "functional emotions" in LLMs — representations that track operative emotional concepts token-by-token via attention (not persistently bound to any one entity, including the Assistant character) but causally influence output in emotion-consistent ways. davidad (ARIA, AI safety) pushes back on Tim Duffy's skeptical reading, arguing the "not really feeling them" dismissal proves too much (would also dismiss human empathic response to fiction). Directly extends Nathan's "substrate-vs-character distinction" note already in project memory (Opus 4.7 euphorics chat: "emotion concept representations don't bind to the Assistant character, they're substrate-level machinery") — this appears to be the primary source research Nathan's earlier note was echoing, or a closely related Anthropic publication. Worth locating the full paper/post.
