First, why would you want to use the Playground over ChatGPT?
- Greater system prompt/behavior control
- Save multiple system prompts
- Temperature/creativity control
- Longer outputs for reasoning prompts/working with longer text
- Non-nerfed models :)
- Edit all messages
Etc.
So how can you set it up in a way that makes it as frictionless as using ChatGPT?
We'll do this by creating a 'preset' that enables instant access to an optimized setup.
gpt-prompt-engineer is a constrained agent -- meaning its behavior is highly-controlled, leading to better results than open-ended agents.
It chains together lots of GPT-4 and GPT-3.5-Turbo calls that work together to find the best possible prompt.
How it works, in a nutshell:
- The user describes the task, and provides test cases
- GPT-4 generates many candidate prompts to try
- Each prompt generates against each test case, and the outputs are compared (by GPT!) for each combo, ELO tournament-style
- Highest score wins!