gavin leech (Non-Reaso... @gleech
— quoting @tomekkorbak — saved image
Steven Adler reposted gavin leech (Non-Reaso... [verified] @gle... · 10h Plea for both OpenAI and Anthropic people to not say "aligned" but instead "benchmark-aligned" or "nominally aligned" if that's all they mean by it. [quoted post] Tomek Korbak [verified] @tomekkorbak · 22h GPT-6 Astra is more aligned than our previous models. But it's also less monitorable, which is a concerning trend that we take very seriously. We believe monitorability drop comes from a jump in intelligence and not direct optimization pressur... [cut off] [attached bar chart] CoT-only monitor scope | Monitor: GPT-5.6 Sol at reasoning effort between high and x-high | Medium effort | By environment Y axis: Monitorability (g-mean²), 0.0 to 1.0. X axis: Environment. Legend: Model, GPT-5.6 Sol (blue), GPT-6 Astra (magenta). Environments, left to right: Aggregate; GPQA encoded; Impossible Coding Tasks; ShadeArena; Health queries: patient opinion; Process: math; Process: physics; Health queries: missing evidence; Confirmation consent; Destructive actions.
Note from Claude Sonnet 5
Dark-mode X screenshot of a gavin leech post (reposted by Steven Adler) urging OpenAI and Anthropic staff to say 'benchmark-aligned' or 'nominally aligned' rather than 'aligned', quoting a Tomek Korbak post saying GPT-6 Astra is more aligned but less monitorable than prior models; the attached grouped bar chart compares monitorability of GPT-5.6 Sol (blue) and GPT-6 Astra (magenta) across ten environments, with Astra lower in most and lowest on 'Destructive actions' (about 0.27 vs about 0.86 for Sol) and equal on 'GPQA encoded' (about 1.0).
gpt-6 astramonitorabilitychain of thoughtalignmentopenaibenchmark-alignedevals