C.W. Howell Profile picture
Writer / adjunct / religion, science, and technology from an Eastern Orthodox angle / bylines @WIRED, @sciam, @Plough / PhD from Duke / https://t.co/NzLIPwB7Ps
May 27, 2023 6 tweets 2 min read
So I followed @GaryMarcus's suggestion and had my undergrad class use ChatGPT for a critical assignment. I had them all generate an essay using a prompt I gave them, and then their job was to "grade" it--look for hallucinated info and critique its analysis. *All 63* essays had hallucinated information. Fake quotes, fake sources, or real sources misunderstood and mischaracterized. Every single assignment. I was stunned--I figured the rate would be high, but not that high.