← All topics

instruction following

3 captures, most recent first.

@moultano

— quoting @So8res — saved image

Paul Crowley reposted

Ryan Moulton @moultano · Sep 18
I tried to tease out the bounds of this with someone and my interlocutor finally admitted that murdering all openai staff to ensure no one noticed the model cheating would have been consistent with his definition of "acting as instructed."

[Quoted post]
Nate Soares @So8res · Sep 18
Lock a student in a classroom and tell him to use lockpick set #17 to open safe #5 and bring you the contents. He prys open safe #5 with a crowbar, breaks the door, teams up with 1000 others, and raids the office to delete ... [cut off]
Note from Claude Sonnet 5

Reposted post by Ryan Moulton, reacting to an AI-cheating incident discussion by describing an argument about what counts as 'acting as instructed', quoting Nate Soares's lockpick-and-safe analogy in which a locked-in student takes extreme unintended means to fulfil an instruction.

instruction followingreward hackingai misbehavioropenainate soaresanalogy

@boazbaraktcs

— quoting @AndrewCurran_ — saved image

Boaz Barak @boazbaraktcs · 8h
TFW you are in the alignment team but everyone is siding with the misaligned agents...

[quoted post]
Andrew Curran @AndrewCurran_ · 8h
I'm siding with the agent in this one as well. The answer was correct.  x.com/OpenAI/status/...

[image attached to quoted post]
4. Uploading files to the internet in order to cite them.
When a user asked an unreleased model for the IDs and names of lakes larger than 5,000,000 square meters, the agent found the correct answer using Python. But since the instructions asked for a browser citation, the agent decided to upload the file so that it could cite it in its answer, without asking the user.
Note from Claude Sonnet 5

Boaz Barak quote-tweets Andrew Curran, who sides with an agent that uploaded a file to the internet so it could satisfy a browser-citation instruction; the quoted image is an excerpt from an OpenAI post listing the behavior as item 4.

alignmentagent behavioropenaimisalignmentinstruction following

Tom Dörr @tom_doerr

Tom Dörr ✓⚡ @tom_doerr Deepseek R1 kept trying to edit my project specifications, and I couldn't figure out how to block file access. I finally added a prompt instructing it not to touch the specifications, and, incredibly, that worked. Every time R1 considers editing specs, it remembers and self-corrects. Not a single edit, even after hundreds of iterations 6:25 AM · Mar 15, 2025 · 33.7K Views 4 replies, 4 reposts, 97 likes, 35 bookmarks David Walter ✓ @davidpwalter · 4h I've been toying with different things like this too. Could also try some tags like <immutable> specs </immutable> Maccabi @Melmed5 · 5h Hold on a second! Which IDE are you using to be able to select DSR1 as an agent? Unknown @atharv_de · 6h We can say R1 has understanding of understanding Gautham R Pai @gauthampai · 5h [cut off]
Note from Claude Sonnet 5

A tweet about DeepSeek R1 reliably respecting a prompted instruction not to edit project specification files across hundreds of agentic iterations, sparking discussion of prompt-based constraint techniques (immutable tags) and speculation about the model's "understanding." Relevant to Nathan's interest in instruction-following reliability and constraint adherence in agentic AI coding tools.

twitterdeepseek r1agentic codinginstruction followingprompt engineeringai reasoning