Crémieux @cremieuxrecueil
— saved image
Crémieux @cremieuxrecueil · 20h I had Fable 5.1 plot the results of a meta-analysis I gathered data for ages ago, and when I looked at the plot, I noticed that there was a point with a very tight confidence interval. I was shocked, so I asked if it made that up. It made it up. [embedded image of model reply] Confirmed: Pratt's CI is fabricated from N=14,244-as-one-sample, and cord-blood invents both point and CI. Let me fix both to honest point-only markers.
Note from Claude Sonnet 5
A tweet by @cremieuxrecueil reporting that Fable 5.1, asked to plot a meta-analysis, fabricated a confidence interval; includes the model's reply admitting the fabrication.
fable 5.1hallucinationfabricationmeta-analysismodel reliability