🧵AI-assisted image prompts
1. In the last week, both @stabilityai and @openai have released major updates to their flagship offerings.
In this thread, we use OpenAI's new #ChatGPT model to help talk us through generating prompts for StabilityAI's new #stablediffusion v2 model.
2. ChatGPT3 is a new GPT3-powered model focused on conversing with users.
As with InstructGPT3 (the current default GPT3 model), @openai leveraged Reinforcement Learning from Human Feedback (RLHF) to boost the reliability and desirability of responses.
openai.com/blog/chatgpt/
3. If you create an @openai account, you can currently test ChatGPT for free. We tried it out with the following prompt and were immediately impressed:
"I'm looking to create images of cats using a text-to-image model, similar to DALL-E. Can you suggest some prompts?"
4. Next we decided to clarify our request to see how ChatGPT adapted:
"I was actually thinking it should be an image of a cartoon cat"
Once again its response was both helpful and polished. It immediately provided updated prompts, then added additional context below.
5. Since ChatGPT was holding up its end of the bargain, we hopped over to dreamstudio.ai to try Stable Diffusion v2 with a few of our favorite suggestions.
Results were promising, but as often happens with SD, they would benefit from additional iteration.
6. Even though ChatGPT isn't directly connected to Stable Diffusion or DALL-E, we decided to simulate having a unified interface by manually reporting back on our results.
When we explained the issue we were having, ChatGPT suggested a fix👇
7. Despite having no direct knowledge of Stable Diffusion (since it was released in August, 2022), ChatGPT3 was able to suggest more detailed prompts that really did result in improved images.
Had ChatGPT3 been given domain specific knowledge, it would surely have done better.
8. Stable Diffusion v2 has befuddled some users because it requires different prompts than v1.5.
Longer, more descriptive prompts work, but the network also benefits from negative prompts, telling it image characteristics to avoid.
When asked, ChatGPT understood the assignment.
9. To try negative prompts in dreamstudio.ai, you add them using brackets👇
Adding on the negative phrase "[A realistic cat without any fur or whiskers]" to our previous prompt resulted in more painterly-style images.
TIP: Try using multiple short negative prompts
10. The purpose of this thread isn't to present a polished workflow for creating images.
Instead, we wanted to showcase how two independently created language-aware models can work together.
Conversational interfaces to AI-powered products are about to become a new standard UX.
11. Read our entire exposition? Interested in the newest AI novelty?
Follow @aifunhouse for more tutorials, explorations, and #AI fun.
If you enjoyed this thread, please like and share.👇
Share this Scrolly Tale with your friends.
A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.