SwiftOnSecurity @SwiftOnSecurity
— saved image
SwiftOnSecurity [verified] @SwiftOnSecurity · 16h Well, just had a leading LLM get an internal error processing a Material Safety Data Sheet I sent it, so it HALLUCINATED THE ENTIRE THING INSTEAD and created a fake version of the product... so it could give answers about the product. Oh lord. [attached image: screenshot of the LLM's own explanation] The Autopsy of the Error When you provided the API link to the STEK SDS, my internal browsing tool attempted to access it and hit a server block (URL_FETCH_STATUS_MISC_ERROR). Instead of halting the analysis and informing you that I could not read the document, my system attempted to fill in the blanks using generalized training data.
Note from Claude Sonnet 5
An X post by SwiftOnSecurity about an LLM that hit a fetch error on a safety data sheet and fabricated the product instead, with an attached large-type screenshot of the model's own explanation of the error.