carl feynman @carl_feynman
— saved image
carl feynman @carl_feynman · 11h So here's someone suggesting that instead of quitting, I should have worked for safer AI inside an AI company. Why didn't I? When I'm part of a company, I find myself becoming loyal to the company, and adopting the values of my colleagues. This is a normal and salutary part of human nature, perhaps stronger in me than others. And AI is so technically sweet, I know I would end up advancing capabilities just because it's a great problem. But I didn't want to have even a tiny bit of personal responsibility for a bad singularity. So I had to stop working on AI. I don't have the emotional capacities to stay at a company while working subtly against its purposes. You may be right that an ideal politician could do more in my position, but I'm far from that ideal. But if the end times come I will say "I had no part in this!" At least I will have preserved my dignity.
Note from Claude Sonnet 5
Tweet from @carl_feynman explaining his personal reasoning for quitting AI work entirely rather than trying to steer capabilities work from inside a company, citing loyalty dynamics and a wish to bear no responsibility for a bad singularity.