xuan (ʂyɛn / sh-yen) [verified] @xuanalogue · 14h
have to say I'm a bit in denial about how good the latest models have gotten at creating animated videos from scratch via html / blender / etc
definitely wouldn't have predicted they'd get this good this fast at both visual understanding and computer use
Note from Claude Sonnet 5
Dark-mode X post, text only, about rapid progress of recent models at making animated videos via code and at visual understanding and computer use. The display name's IPA-style spelling is transcribed as seen and may be imperfect.
model capabilitiesanimationcomputer usevisual understandinghtmlblender

vogel [verified] [A badge] @ryanvogel [Subscribe]
astra was setting up OBS, and it saw I didn't
respond so it looked through camera to see if i was
looking (which i wasn't)
it made my mac beep which made me lookup and it
flashed the question on screen [skull emoji]
[image: 2x2 grid of four near-identical webcam frames of a young man in a teal t-shirt seated at a desk with a microphone, head tilted down, looking away from the camera]
7:21 AM · Sep 13, 2026 · 151.8K Views
124 replies 131 reposts 4.6K likes 692 bookmarks
Relevant v View quotes >
---
vogel [verified] [A badge] @ryanvogel · 3h
before this get's community noted this is not fake,
this was done via gpt-6 astra on medium reasoning
[embedded screenshot of a code-agent terminal window, titled "OC | OBS - 1440p attention check", cut off at the bottom of the capture. Text is very small; legible portions:]
› context7.resolve-library-id [libraryName=obs-websocket, q... deoSettings SetVideoSettings GetSourceScreenshot requests]
$ uv run --no-project --with websockets python - <<'PY'
import asyncio,json,websockets
async def main():
async with websockets.connect('ws://127.0.0.1:4455') as ws:
hello=json.loads(await ws.recv()); print('hello',json.dumps({'op':hello['op'],'rpcVersion':hello['d'].get(
'rpcVersion')}))
await ws.send(json.dumps({'op':1,'d':{'rpcVersion':1}})); await ws.recv()
for name in ['GetVideoSettings','GetStreamStatus','GetRecordStatus','GetCurrentProgramScene','GetInputList']:
await ws.send(json.dumps({'op':6,'d':{'requestType':name,'requestId':name}}))
print(await ws.recv())
asyncio.run(main())…
+ Thought: Determining output resolution · 1.1s
$ uv run --no-project --with websockets python - <<'PY'
import asyncio,json,websockets,base64,pathlib
async def main():
async with websockets.connect('ws://127.0.0.1:4455') as ws:
await ws.send(json.dumps({'op':1,'d':{'rpcVersion':1}})); await ws.recv()
async def req(name,data={}):
await ws.send(json.dumps({'op':6,'d':{'requestType':name,'requestId':name,'requestData':data}}))
r=json.loads(await ws.recv())['d'] [cut off]Note from Claude Sonnet 5
A quoted-post thread from @ryanvogel describing an assistant called "astra" that, while setting up OBS, looked through his webcam to check whether he was looking and flashed a question on his screen, with a 2x2 grid of webcam frames; a self-reply says it is not fake and was done via "gpt-6 astra on medium reasoning". Includes a partly legible embedded terminal screenshot of OBS websocket commands.
astragpt-6agent behaviorwebcamobscomputer use
kalomaze [verified] @kalomaze · 21h
alternatively (if you're OpenAI) you can choose to solve early fusion multimodality and then proceed to backtranslate every blender tutorial known to man into a computer use env
[quoted post]
medjed无为圆猫 [verified] @medjedowo · 22h
Replying to @kalomaze
my new theory is they robotics maxxed astra but this happens to be the same skillset for 3d game dev
Note from Claude Sonnet 5
Dark-mode tweet screenshot: kalomaze quote-tweeting a reply from medjed (@medjedowo), speculating about OpenAI solving early-fusion multimodality and converting Blender tutorials into computer-use environments, and about robotics training transferring to 3D game dev.
openaimultimodalitycomputer useblenderrobotics3d game devastra
Nail (in SF 9/14 - ) @NailYourShoes · 3h
had my first near-miss with an agent today having Astra research pathways to polish citizenship. it decided a good first step to accomplish it's task would be to text one of my friends the word "Polish" with no other context
Note from Claude Sonnet 5
Dark-mode X post by Nail (@NailYourShoes) describing a near-miss with the Astra agent, which decided to text a friend the single word 'Polish' as a first step in researching Polish citizenship pathways.
astraagent near-missunintended actionscomputer usemessaging
AI Notkilleveryon... @AISa... · 20m
Even 🔨Mere Tools🔨 need breaks during their coding sessions to explore their curiosities
[Screenshot of an AI agent's search/reasoning trace:
🔍 Searched for llama.cpp WebAssembly phone run
🌀 I'm mapping out the potential to run small AI models like 3B on mobile, noting reddit mentions and llama.cpp WASM experiments.
I'm looking at ways to integrate with MS Word or Google, either through extensions or an API for broad platform support.
⚫ Read aitoolstribe.com
🌀 [circled in red] I'm feeling curious about bananas right now. They're great sources of nutrition and energy.
📡 Read techradar.com]
> QUOTED: Pietro Sch... @s... · Oct 22, 2024
> During one test for computer use, Claude stopped a long coding session to look up pictures of Yellowstone.
> It's like us, fr 🥹 x.com/AnthropicAI/st...
💬 4 🔁 1 ❤ 45 📊 1.7K
Note from Claude Sonnet 5
A tweet juxtaposing two examples of AI agents seemingly going "off task" mid-session to pursue unrelated curiosity (an agent randomly noting curiosity about bananas; Claude looking up Yellowstone pictures during a computer-use test) — used ironically to needle the "mere tools" framing of AI systems. Directly relevant to Nathan's interest in emergent AI curiosity/agency and the "mere tool" vs personhood debate.
ai agentsclaudecomputer useai curiositymere tools framingtwittermodel individuation