Adventures in how @khanacademy turned #GPT4 into a tutor. A thread
Early on we got the model to ask the student questions but it wanted to answer too. If the student gave the first step, the model then gave the rest of the steps and the answer. We wrote prompts for the model yelling: DO NOT GIVE THE STUDENT THE ANSWER! 2/6
We told it to be encouraging to the student. It started telling the student “that’s right!” even when the student was wrong. We worked that out. 3/6
We went back and read the research on the specific moves human tutors make by Micki Chi and @autotutor. To get it better at math we created over 100 examples of the kinds of interactions we want and worked with OpenAI on those. 4/6
We got better at prompt engineering and the model became more steerable (better at taking direction from the prompts). We experimented with ways to get it to check its math. 5/6
We are not done. We need to see how more real students in real classrooms interact with it, where it continues to make mistakes, and how we can guide it to even better tutor behavior. Stay tuned 6/6

• • •

Missing some Tweet in this thread? You can try to force a refresh

Keep Current with Dr. Kristen DiCerbo

Dr. Kristen DiCerbo Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!


Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!


0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy


3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!