SparseCtrl is a feature added in AnimateDiff v3 that is useful for creating natural motion with a small number of inputs. Let's take a quick look at how to use it!
There are currently two types: RGB and Scribble. If you use a single image, it works like img2vid.
Nov 17, 2023 • 17 tweets • 5 min read
Let's take a simple tutorial about AnimateDiff openpose+inpainting workflow! #AnimateDiff #stablediffusion #AIイラスト #AI #ComfyUI
The workflow and sample video can be downloaded here. drive.google.com/drive/folders/…
#02_ First we need to render the background and character Openpose bones separately. We will use them for Depth2image and Pose2image respectively. I used Blender.
#02_ The only image the Openpose model needs is an openpose skeleton. The use of images of real people is due to the Gradio UI, according to the developer's comments.
