This MIT paper arguing that using ChatGPT worsens one's performance on neural, linguist, and behavioral levels recently went viral.
Got millions of views. TIME and CNN covered it too.
But most people agreeing with it haven't read it.
Interestingly, researchers themselves used an AI Agent to evaluate essays.
I'm reading it closely to see if it withstands critical scrutiny.
Follow along for my commentary:
Got millions of views. TIME and CNN covered it too.
But most people agreeing with it haven't read it.
Interestingly, researchers themselves used an AI Agent to evaluate essays.
I'm reading it closely to see if it withstands critical scrutiny.
Follow along for my commentary:
The purpose of the study is to find out the "cognitive cost" of using an LLM while writing an essay.
The research team recruited 54 participants and divided them into 3 groups of 18 each and conducted 4 writing sessions.
Group 1: used ChatGPT to write essays
Group 2: used normal Google search
Group 3: no ChatGPT, no Google, only brain
54 is a very small sample size. It was reduced even further to 18 in the 4th and decisive session. This means that the linguistic and neural performance only 9 ChatGPT users was evaluated in the 4th session.
The study's claim that using AI worsens your linguistic and neural performance is based on an analysis of only 9 participants.
In addition to an AI agent, human teachers also evaluated these essays.
The research team recruited 54 participants and divided them into 3 groups of 18 each and conducted 4 writing sessions.
Group 1: used ChatGPT to write essays
Group 2: used normal Google search
Group 3: no ChatGPT, no Google, only brain
54 is a very small sample size. It was reduced even further to 18 in the 4th and decisive session. This means that the linguistic and neural performance only 9 ChatGPT users was evaluated in the 4th session.
The study's claim that using AI worsens your linguistic and neural performance is based on an analysis of only 9 participants.
In addition to an AI agent, human teachers also evaluated these essays.
Researchers analyzes three things across these groups:
1. Named Entities Recognition: Identification and classification of entities into predefined categories en.wikipedia.org/wiki/Named-ent…
2. n-grams: Sequence of particular symbols or words in a give order: en.wikipedia.org/wiki/N-gram#:~…
3. Ontology of topic: Organization and representation of entities in hierarchical terms.
en.wikipedia.org/wiki/Ontology_…
1. Named Entities Recognition: Identification and classification of entities into predefined categories en.wikipedia.org/wiki/Named-ent…
2. n-grams: Sequence of particular symbols or words in a give order: en.wikipedia.org/wiki/N-gram#:~…
3. Ontology of topic: Organization and representation of entities in hierarchical terms.
en.wikipedia.org/wiki/Ontology_…
• • •
Missing some Tweet in this thread? You can try to
force a refresh
