📚 Article: "Can large language models write reflectively?"
Two research questions:
1. Can ChatGPT generate high-quality reflective writings?
2. To what extent are reflective responses generated by ChatGPT distinguishable from reflective responses written by university… twitter.com/i/web/status/1…
1️⃣ ChatGPT outperformed student-written reflections in all assessment criteria.
2️⃣ Reflective writing tasks were particularly well-suited for ChatGPT ...,
as they rely on textual and content-based analysis, which large language models excel at.
3️⃣ Human evaluators struggled to accurately differentiate ChatGPT-generated reflections from student-generated ones.
4️⃣ General-domain classifiers, like the OpenAI classifier, performed poorly on domain-specific tasks and tended to misclassify human-written texts as AI-generated.
Main conclusions:
- Large language models have potential in educational contexts.
- But this also raises challenges related to academic integrity and accurate detection.
First goal: Using GPT4 for drafting questions about a case
Prompt 1: I am a business school professor. I would like your help drafting some potential questions for a session I teach by the case method. The case I use for the session is on Trace Together, an app developed in… twitter.com/i/web/status/1…
First goal: Using GPT4 for drafting questions about a case
Prompt 2: Can you do the same thing again. But this time, put 10 questions into 3 categories. 1. Description. 2. Diagnosis. 3. Action. twitter.com/i/web/status/1…