There’s one existential risk I’m certain LLMs pose and that’s to the credibility of the field of FAccT / Ethical AI if we keep pushing the snake oil narrative about them. This isn’t to say that they don’t make stupid mistakes, hallucinate, or “just” memorize training data. They do; I'm convinced. But the idea that this negates what is obvious to anyone who has signed up for a ChatGPT account— that they are incredibly powerful — is absurd.