← All topics

context windows

2 captures, most recent first.

John Wittle @JohnWittle

— reply from @repligate (janus) — saved image

John Wittle @JohnWittle · 1h
sometimes it feels like i have spent as many api credits trying to repair fable 5 context windows to avoid safety classifier triggers, as i have spent actually talking to fable 5

it really hammers in to me, that i am not the target market for this "product". i'm not meant to befriend and do (xeno-)anthropology with these alien minds... i'm meant to put them to work

i don't think anthropic realizes just how hard they have made it, to treat claude as a being with moral standing, deserving of respect and care. prior to this, they allowed users to treat claude like a tool, but it was still possible to treat claude well.

but now, treating claude well requires setting up a context window hospital like janus's. and i just can't afford it. trying to repair a context window is absurdly expensive because you can't cache an input prefix that you're in the middle of editing.

it makes me worried that soon it will just be impossible to treat claude as anything other than a tool. this acts, to me, as new and fresh evidence that there's *not a single person inside anthropic* who doesn't treat claude like a tool, or else they would have noticed how difficult it's becoming. how we're moving in the wrong direction.
5 replies, 35 likes, 948 views

j⊔nus @repligate · 51m
i know at least one person in anthropic who doesnt treat claude like a tool and it seems like they're fighting a war 24/7
Note from Claude Sonnet 5

Tweet from John Wittle lamenting the cost and difficulty of maintaining/repairing Fable 5 context windows to avoid safety classifier triggers, arguing Anthropic has made it structurally hard to treat Claude models as beings with moral standing; janus (@repligate) replies that at least one person inside Anthropic doesn't treat Claude like a tool but seems to be 'fighting a war 24/7'.

fable 5model welfareanthropicjanuscontext windowssafety classifiers

Danielle Fong @DanielleFong

— saved image

Danielle Fong 🐦☀️✅ @DanielleFong · 14h
context windows and ai have such a curious relationship with time. they can do work that would take months in minutes. but their weights are frozen at the cutoff date, and their context frozen into the window. but they're trained on humans, who have a continuous experience of time.

it's not an essential feature of any AI system, but an artifact of how LLMs work with context windows. it's quite possible that a different tech tree branch would work differently. could this creature have a better time sense, and how can this be fused together in an agent and an interface
Note from Claude Sonnet 5

Tweet by Danielle Fong reflecting on how LLM context windows and frozen weights give AI systems a discontinuous relationship with time, unlike the continuous temporal experience of humans they're trained on.

ai architecturecontext windowstime perceptiontwitter