Human Prompt Engineer VS AI Prompt Engineer? Who wins?
@sanderschulhoff, Founder of @learnprompting, was defeated💀 🪦...
DPSy performed 40% better on a novel classification benchmark.
Here's how 🧵
@sanderschulhoff, Founder of @learnprompting, was defeated💀 🪦...
DPSy performed 40% better on a novel classification benchmark.
Here's how 🧵
@SanderSchulhoff 1)
🌟 We gave @sanderschulhoff a task description and some training data.
🕒 He spent 20 hours testing out different techniques over 47 steps of development.
🐞 He dealt with issues like LLM refusal to respond and performance regressions
🌟 We gave @sanderschulhoff a task description and some training data.
🕒 He spent 20 hours testing out different techniques over 47 steps of development.
🐞 He dealt with issues like LLM refusal to respond and performance regressions
@SanderSchulhoff 2)
🛠️@miserlis_ ran DSPy on the same training data
✨He then slightly improved the DSPy prompt
🛠️@miserlis_ ran DSPy on the same training data
✨He then slightly improved the DSPy prompt
@SanderSchulhoff @miserlis_ 3)
🏆Both resultant DSPy prompts beat Sander on the test set!
Check out more techniques in The Prompt Report:
This is Day 23 of Posting ab it. I'll be posting ab The Prompt Report daily until it is out of content!
#llms #prompting #genaibuff.ly/3RTXA6G
🏆Both resultant DSPy prompts beat Sander on the test set!
Check out more techniques in The Prompt Report:
This is Day 23 of Posting ab it. I'll be posting ab The Prompt Report daily until it is out of content!
#llms #prompting #genaibuff.ly/3RTXA6G
• • •
Missing some Tweet in this thread? You can try to
force a refresh
