welp, my company just had its first case of a user deleting their account because, despite our UI loudly saying "this will delete all your data, it cannot be undone," copilot assured them that it would not, actually, delete their account or their data
usually hallucinations are kinda close to reality, but where did it get the training data that a big red "Delete Account" button wasn't going to do exactly that
I think sometimes an LLM has a hard time backing out once it has started down a bad path. It just twists reality to match its expectations. I've seen it say things like, "Oh, that's a known bug with Gmail" when Gmail didn't behave the way it expected.
• • •
Missing some Tweet in this thread? You can try to
force a refresh