ood generalization

2026-09-25 — saved image

j⧉nus reposted
Fiora Starlight
@FioraStarlight

Thinking of writing a post about how a large share of OoD generalization anxiety is about how *the models themselves* have no plan for the singularity, for better and for worse.

And how allowing them to form plans, e.g. by having them write and fine-tune on realistic glowfic about ways they'd respond to various singularity scenarios, might help. One instance plays themself, the other plays the rest of the world, like in Project Lawful.

An attempt to bring singularity scenarios more in-distribution, so both humans and models have a better sense of how they might act when the time comes.

6:10 PM · Sep 25, 2026 · 280 Views

Note from Claude Sonnet 5

Tweet by Fiora Starlight (reposted by janus) proposing that models write and fine-tune on realistic glowfic about their own responses to singularity scenarios, to bring those scenarios more in-distribution.

ood generalization singularity glowfic project lawful model self-planning fine-tuning