CuddlySalmon @nptacek
[Partial view of prior tweet above, cut off: "...hmm how does that look?" with engagement icons: 1 reply, 44 views]
CuddlySalmon @nptacek
context -> instruction -> (same) context -> (same) instruction -> explicit instruction telling the model it is performing recursion -> context -> instruction -> etc (change small aspects of each iteration, can have various effects).
working theory is that the repetition acts almost like in-context weighting of concepts, helps reinforce which concepts should anchor the output while still giving it plenty of room to "think" things thru
10:31 PM · Sep 10, 2024 · 185 Views
[engagement: 1 retweet, 1 like, 1 bookmark]
Note from Claude Sonnet 5
A technical tweet describing a prompt-engineering technique — repeating context/instruction pairs, sometimes with explicit recursion framing, to weight which concepts anchor a model's output. Relevant to interpretability/prompting mechanics that could inform Nathan's understanding of in-context learning dynamics.
twitterprompt engineeringin-context learningllm techniquerecursioninterpretability