Trying to learn how to animate with #stablediffusion and the @deforum_art Colab notebook by @pharmapsychotic
It's insane how fast things are moving since the release of #SD as open source!
Want to learn to animate? Here's my step by step so far! 🧵
It's insane how fast things are moving since the release of #SD as open source!
Want to learn to animate? Here's my step by step so far! 🧵
This is using a open source model that related this Monday
A colab that uses img2img to feed the next frame with the previous frame and filling in the blanks and pan/zooming.
And a prompt search engine , with 200 million images and prompts and seeds.
ALL FROM THIS F-ING WEEK
A colab that uses img2img to feed the next frame with the previous frame and filling in the blanks and pan/zooming.
And a prompt search engine , with 200 million images and prompts and seeds.
ALL FROM THIS F-ING WEEK
Use #lexica by @sharifshameem as inspiration, find images that have a repeating quality to them, this is going to be important later.
This for example is an amazing prompt to animate (pan from left to right)
This for example is an amazing prompt to animate (pan from left to right)
https://twitter.com/nabeelqu/status/1562986752885035009
Find an example that you like, right click on the image and copy it's URL, copy the prompt and copy the seed! 
Now go to the amazing colab by @pharmapsychotic from @deforum_art and set it up
https://twitter.com/deforum_art/status/1562999935414333441
Colab may look intimidating, but hey! It's free GPU compute, so you can iterate without fearing that you'll run our of credits in MJ or Dalle!
Click Runtime -> Run All and have patience, it'll take 20 minutes or so. Meanwhile let's go over the main configs you'll need
Click Runtime -> Run All and have patience, it'll take 20 minutes or so. Meanwhile let's go over the main configs you'll need
You will get asked to add access to google drive, and you should have the stableDiffusion model sitting there in the folder AI > models > sd-v1-4.ckpt
Download sd-v1-4.ckpt from @huggingface and put it in there, and allow Colab to connect to drive.
Download sd-v1-4.ckpt from @huggingface and put it in there, and allow Colab to connect to drive.
First decide which type of animation you'd like, zooming? Panning? maybe zooming in while panning down?
Playing around with those params + quick iterations on initial images can help you hone in a good animation
Playing around with those params + quick iterations on initial images can help you hone in a good animation
Interested in following along?
I've been trying to get this walk into san francisco all night, but it loses coherence... Not sure how to fix the steps for secondary images yet 🤔
@pharmapsychotic what am I missing?
gist.github.com/altryne/a7879f…
@pharmapsychotic what am I missing?
gist.github.com/altryne/a7879f…
@pharmapsychotic I wish I'd remember to add a few keyframe switches to the animation
• • •
Missing some Tweet in this thread? You can try to
force a refresh
