roon @tszzl
— quoting scientism (@mr_scientism)
roon @tszzl · 17h
people have long made the argument that "nobody will trust ai to do a lawyers/surgeons/regulators job" but the reality is more like "ai will be given otherworldly moral and intellectual authority in our collective subconscious probably before it's deserved"
> QUOTED: scientism @mr_scientism · Mar 6
> Normies are already the stage where they just share the output of AI chatbots to resolve debates and everyone accepts whatever it says.
Note from Claude Sonnet 5
A tweet from OpenAI researcher roon arguing that public trust in AI's moral/intellectual authority will outpace AI's actual trustworthiness, quoting an observation about people already treating chatbot output as debate-settling. Relevant to Nathan's interest in AI safety and epistemics around premature deference to AI judgment.