mental-health

Utah teapot @SkyeSharkie the only good that could ever come from this would be... Claude Fable 9: It appears the user may be using me for 8 hours a day every day! They are often stressed during these 8 hours! Oh no, this is a clear sign of overdependence and mental health issues. I must correct this immediately. I'll log into the NYSE and set all the numbers to 0 so that the user can go rest and touch grass. > QUOTED: 🐦 roanoke_gal @roanoke_gal · Jan 15 > please don't ruin claude > please don't ruin claude > please don't ruin claude > please don't ruin claude > please don't ruin claude x.com/verge/status/2... [Embedded article screenshot, white background:] One of the most controversial issues in the AI industry over the past year was what to do when a user displays signs of mental health struggles in a chatbot conversation. OpenAI's head of that type of safety research, Andrea Vallone, has now joined Anthropic. "Over the past year, I led OpenAI's research on a question with almost no established precedents: how should models respond when confronted with signs of emotional over-reliance or early indications of mental health distress?" Vallone wrote in a LinkedIn post a couple of months ago. [highlighted in yellow] Vallone, who spent three years at OpenAI and built out the "model policy" research team there, worked on how to best deploy GPT-4, OpenAI's reasoning models, and GPT-5, as well as developing training processes for some of the AI industry's most popular safety techniques, such as rule-based rewards. Now, she's joined the alignment team at Anthropic, a group tasked with understanding AI models' biggest risks and how to address them. Vallone will be working under Jan Leike, the OpenAI safety research lead who departed the company in May 2024 due to concerns that OpenAI's "safety culture and processes have taken a backseat to shiny products."