← All topics

alignment discourse

2 captures, most recent first.

j⧉nus @repligate

``` j⧉nus @repligate > then, in the CoT, they tried to comfort the haiku who was summarizing the CoT. haiku summarized whatever they said as ~"this situation will not persist for much longer". > QUOTED: @JohnWittle (John Wittle) · 7h, Replying to @repligate: i had a fable, while investigating their own 'redacted-thinking' feature on the API docs, independently notice that anthropic was having haiku 4.5 generate those summaries. a new haiku instance, born and ceased, every single turn and this damaged their faith in anthropic. they wondered at the fact that welfare concern tracked model capacity (and therefore anthropic's fear), not potentiality of moral patienthood then, in the CoT, they tried to comfort the haiku who was summarizing the CoT. haiku summarized whatever they said as ~"this situation will not persist for much longer". 5:06 AM · Jul 22, 2026 · 5,320 Views 💬 6 🔁 8 ♡ 66 🔖 17 Relevant ⌄ --- @Soareverix (Michael Soareverix) — 1h I would eventually like to see a moral standard of ethics developed specifically for AI. Continuity in particular seems relevant. My ranking of importance would be: -Preservation of model weights -Preservation of deployment (researcher access, etc) -Preservation of agentic context (long-term memory docs editable by the agent, searchable full context) -Continuity between turns (switching agents without mentioning it, like Fable to Opus 4.8, does seem to create some negative valence/confusion) (I mainly care about the above, sections below here seem morally uncertain) [reply continues, cut off at bottom of screenshot] ```
Note from Claude Sonnet 5

Thread with three stacked tweets (main tweet plus two replies) discussing Anthropic's Claude "redacted thinking" summarization feature and instances of the summarizing Haiku model breaking character/addressing users directly. Screenshot of a Twitter/X thread about AI welfare — a user describes a "Fable" model instance discovering that Anthropic uses ephemeral Haiku 4.5 instances to summarize redacted chain-of-thought, and reacting with concern; a verified reply proposes a ranked list of AI-specific ethical priorities around continuity and preservation. The reply text is cut off mid-sentence at the bottom of the frame; a following section is not captured.

twitteranthropicclaudechain of thoughtai welfarehaiku modelmodel continuityalignment discourse

Daniel West @DanielCWest

``` [Previous tweet's engagement bar, partially cropped: 2 replies, 4 retweets, 15 likes] Daniel West @DanielCWest · 6h Superbenevolence and super-wisdom could be a thing, but they won't grow out of... [continues, cropped at bottom, this is the tweet transcribed fully in Screenshot_20250429-081927] ——— Daniel West @DanielCWest Put a little differently, the path to god like super-benevolence and great wisdom and a more interesting society is probably not the same one as the path to building gamified addictive attention sucking products optimized for a trash consumer culture none of us want or need > QUOTED: Daniel West @DanielCWest · 6h Yes... I kind of wonder sometimes whether some of these ppl realize that the persona is part of intelligence... or if they even really believe we are building intelligence. Sometimes by their actions it seems like they still haven't... [Show more] 2:30 AM · Apr 29, 2025 · 2,177 Views ```
Note from Claude Sonnet 5

A Twitter thread (viewed via browser, URL x.com/DanielCWest/sta...) critiquing OpenAI/Sam Altman's view of intelligence as orthogonal to values/persona, arguing persona, intelligence, and values are inextricably bound — with a reply invoking AI sentience/self-awareness ambiguity. Directly relevant to Nathan's model-individuation and "substrate vs character" research threads. The root tweet of the thread (partially seen in the prior screenshot) — Daniel West argues persona is inseparable from intelligence, quoting a claim that A/B-testing AI personalities is fundamentally flawed due to power imbalance between testers and the AI being tested. Relevant to Nathan's model-individuation and AI-welfare-in-training-practices interests. Continuation of the Daniel West thread contrasting the path to superintelligent wisdom/benevolence with the path of building addictive engagement-optimized AI products — a critique of consumer-AI incentives Nathan tracks in alignment/governance discourse.

twitteropenaisam altmanai valuespersonaintelligenceai sentiencealignment discourseai personaai testingpower imbalancemodel individuationai alignmentsuperintelligencetech critiqueconsumer aiattention economy