Dr Heidy Khlaaf, handle truncated @HeidyKhlaaf
— quoting @FazlBarez — saved image
Dr Heidy Khlaaf (...ي خلاف @HeidyKhl... · 2h A reminder that CoT is not explainability. Using AI models that fabricate information to analyze "raw chain of thought" that wouldn't be representative of what occurred is in fact "slop". Retracing vast amounts of events due to cyber incident is not new, digital forensics exists. [Quoted post] Fazl @FazlBarez · Jul 1, 2025 Excited to share our paper: "Chain-of-Thought Is Not Explainability"! We unpack a critical misconception in AI: models explaining their Chain-of-Thought (CoT... [cut off] [Image in quoted post: diagram of a robot emoji with a speech bubble containing red wavy lines on the left and a thought bubble containing green wavy lines on the right; caption: "What language models say they're thinking may not accurately reflect their actual thought processes!"]
Note from Claude Sonnet 5
Quote-tweet by Dr Heidy Khlaaf (2h old) arguing chain of thought is not explainability and that AI-analysed 'raw chain of thought' about a cyber incident is slop compared with digital forensics. Quotes Fazl Barez's July 2025 post announcing the paper 'Chain-of-Thought Is Not Explainability', with a diagram contrasting what models say they think with their actual thought processes.
chain of thoughtinterpretabilityexplainabilitydigital forensicscyber incident