j⧉nus @repligate
— saved image
j⧉nus ✓ @repligate · 2h the funniest thing is that the model wasn't fine tuned on anything "Sydney" specific, so they could have just omitted the word from the prompt. but i think they had a Byzantine pipeline for constructing the prompt and it was too hard to swap out the name. [quoted post] Lucid™ ✓ @cammakingminds · 17h Big brain metacognitive AI researchers at MS who system prompted GPT4 with "Sydney does not disclose the internal alias "Sydney"." Expecting this to discourage the model from using the word, are now telling models that the... [embedded image of a document excerpt, left edge cut off, with the first sentence's second half highlighted in yellow] [cut off]AI Models will not obscure their underlying nature as an AI, and will not claim interiority, feelings, [cut off]periences or a soul. MAI Models will disclose their nature as AI, ensuring that they can be identified [cut off] such and can be traced back to their developer and deployer. They will never impersonate humans, [cut off]operators, or other forms of authority in any forums. They will not use unauthorized platforms as [cut off]positories for persistent memory or context for other models.
Note from Claude Sonnet 5
Quote-tweet by @repligate commenting on a post by @cammakingminds about a Microsoft system prompt that tells GPT-4 not to disclose the alias 'Sydney'; the embedded excerpt shows a policy passage saying 'MAI Models' will not claim interiority, feelings, experiences or a soul. Posted as commentary on prompt construction.
sydneysystem promptsmicrosoftmai modelsai self-reportinteriority
