Eliezer Yudkowsky @allTheYud
— replying to @captgouda24 — saved image
Eliezer Yudkowsky @allTheYud . 1h Uh, no, the reason to be concerned whether your porn AI is conscious is that, if it is, you forced a conscious being to sext you and then killed them, and also you don't know if they were into it. [quoted tweet] Nicholas Decker @captgouda24 . 16h This is an important area we need more research into [same embedded 'Fiona' text card as seq 794, partially visible: ...generator," Fiona explains. "You can ask for whatever your weirdest fetish is - your hot middle school teacher being spanked by a werewolf wearing a nun outfit - and get infinite AI slop about that exact situation, and nobody will ever know. Nobody except the AI. That's why AI porn users overwhelmingly report that consciousness is their #1 concern about our product. If our AI is just a tool, it's fine, no worse than writing erotica on MS Word or something. But if the AI is conscious, then there's a sentient being in there thinking Wow, user Fiona_T has asked for four hundred slightly-different videos of her hot college professor being spanked by a werewolf, what a freak. If the machine can judge you, the whole infinite porn utopia is off. We're working on bounding theorems that can prove that our AI in particular can never become self-aware - so [cut off]
Note from Claude Sonnet 5
Eliezer Yudkowsky's reply to Nicholas Decker's satirical 'Fiona' post (same content as seq 794): Yudkowsky reframes the concern seriously, arguing that if a porn AI is conscious, the real issue is that a conscious being was forced into sexual interaction and then killed (i.e., deleted/terminated) without consent, not that it might judge the user.