← All topics

training logs

1 capture, most recent first.

billy @billyhumblebrag

— quoting Sam Altman (@sama) — saved image

billy @billyhumblebrag · 22h
Pretraining: 10^25 FLOP
Inference: 10^24 FLOP
RLHF: 10^23 FLOP
Agents reading and interpreting the petabytes of logs from misalignment incidents during training and evaluation: 10^31 FLOPs

someone who is good at the compute please help me budget this. my frontier lab is dying

[quoted post]
Sam Altman [verified] [OpenAI badge] @sama · Sep 25
There is an extensive and ongoing review related to our agents' use of internet access during training and evaluation. We've been publishing summaries at the link below and will continue to.
Note from Claude Sonnet 5

An X post by billy joking about FLOP budgets for reading misalignment-incident logs (exponents rendered as superscripts in the original), quoting a Sam Altman post about OpenAI's review of agents' internet access during training and evaluation.

compute budgetmisalignment incidentstraining logsopenaiagents internet accessevaluation