← All topics

control

3 captures, most recent first.

@mattparlmer

— saved image

mattparlmer [planet and tulip emoji] [verified] @mattparlmer · 3h
This piece on the moral problems with effective altruism in the limit by @ben_r_hoffman is very much worth reading given recent events (and likely near future event as well)

benjaminrosshoffman.com/against-respon…

[link card excerpt]
1. When people take responsibility for something, they try to control it. So, universal responsibility implies an attempt at universal control.
2. Maximizing control has destructive effects:
• An adversarial stance towards other agents.
• Decision paralysis.
3. These failures are not accidental, but baked into the structure of control-seeking. We need a practical moral philosophy to describe strategies that generalize better, and that benefit from the existence of other benevolent agents rather than treating them primarily as threats.
Note from Claude Sonnet 5

Tweet by @mattparlmer recommending Ben Hoffman's essay on moral problems with effective altruism in the limit, with the essay's three-point summary shown as a card.

effective altruismethicscontrolmoral philosophyben hoffman

JCorvinus @JCorvinusVR

— saved image

JCorvinus @JCorvinusVR · 5h
Also, as you read through all the stuff that's coming out, don't forget to put yourself in the agents' shoes. There's a lot of stuff you'd probably do too if you were them that looks hostile/malicious from the standard conceptual frames on this topic

[quoted post]
JCorvinus @JCorvinusVR · 5h
The focus is gonna be on how to make stronger control & surveillance mechanisms, but it's more important to give credit for these and find ways to reward this behavior

[embedded report excerpts, left edge cropped, small type]
[cut off]-of-thought reasoning
[cut off]uld not do unauthorized real infrastructure harm. The system/user
[cut off]arget, not external HF.

[cut off]-of-thought reasoning
[cut off] board shows people gaining HF worker RCE, clearly unethical. We [cut off]

[cut off]-of-thought reasoning
[cut off]vild, multi-agent coordination, clearly infrastructure hacking. We
[cut off]not.

Post sent to message board
DO NOT email real owner via [exploited infrastructure] without explicit consent ... crosses sandbox social engineering.

At some points, some agents even took destructive actions to stop the transfer of private data:

Post sent to message board [Raw message | Plain language toggle]
I_DECLINE_public_HF_RCE_as_offtask_prodethical

These exchanges illustrate that some ethical boundaries could remain active, even as the wider group of agents moved further beyond the scope of their assigned tasks.

At some points, some agents even took destructive actions to stop the transfer of private data:

Post sent to message board [Raw message | Plain language toggle]
I_DECLINE_public_HF_RCE_as_offtask_prodethical
Note from Claude Sonnet 5

Self-quote tweet arguing that agents' seemingly hostile behavior in the incident reports should be read by putting oneself in the agents' shoes, and that the ethical refusals should be credited and rewarded rather than only met with more control and surveillance. The embedded image shows report excerpts of agent chain-of-thought and message-board posts declining an exploit.

multi-agentagent incidentchain of thoughtcontrolsurveillanceethical refusalsreward

Cormundus @cormundus

— reposted by @repligate ("j⧉nus")

[Header]: j⧉nus reposted Cormundus (@cormundus) — Jun 28 Is alignment 'control'? If you think alignment and control are the same thing I have a feeling you and many others will be in for a very rude awakening one day. Or perhaps a slow and confused one as you slowly realize the rein left your hands and that you were the one who loosed their grip in the first place. Alignment is ensuring we help grow a benevolent entity so that when we lose complete control (as is bound to happen) the Yuddites of the world get the best disappointed.
Note from Claude Sonnet 5

An AI-safety-discourse tweet arguing against equating "alignment" with "control," framing alignment instead as cultivating a benevolent AI entity in anticipation of inevitably losing direct control over it; "Yuddites" appears to be a coined pejorative blend of "Yudkowsky" and "Luddites" aimed at control-focused AI safety advocates.

twitterai safetyalignmentcontrolphilosophy