Discover and read the best of Twitter Threads about #ebsynth
Most recents (2)
ControlNet experiment where I'm toggling through different styles of contemporary Indian décor, while keeping a consistent scene layout.
Loving how ControlNet is putting the artists back in control of AI image generation process.
🧵Thread
#ControlNet #StableDiffusion #EbSynth
Loving how ControlNet is putting the artists back in control of AI image generation process.
🧵Thread
#ControlNet #StableDiffusion #EbSynth
For the input sequence I use a short animation made from a photogrammetry 3d scan I did a few years back of my parents living room in India.
- Top: Output generated with ControlNet + EbSynth
- Bottom: Input video sequence from my 3D scan
- Top: Output generated with ControlNet + EbSynth
- Bottom: Input video sequence from my 3D scan
I used the ControlNet depth method for this experiment.
- Left: MiDaS depth map generated from a screen recording of my 3d scan
- Right: Awesome results reskinning the room! Pretty majestic if I say so myself
Next time I want to use the synthetic depth from my 3d scan
- Left: MiDaS depth map generated from a screen recording of my 3d scan
- Right: Awesome results reskinning the room! Pretty majestic if I say so myself
Next time I want to use the synthetic depth from my 3d scan
1/ Using AI to generate fashion
After a bunch of experimentation I finally got DALL-E to work for video by combining it with a few other AI tools
See below for my workflow -
#dalle2 #dalle #AIart #ArtificialIntelligence #digitalfashion #virtualfashion
After a bunch of experimentation I finally got DALL-E to work for video by combining it with a few other AI tools
See below for my workflow -
#dalle2 #dalle #AIart #ArtificialIntelligence #digitalfashion #virtualfashion
2/ First I used DALL-E to generate outfits. I did this by erasing parts of my existing outfit and inpainting over it
Btw when I erased the entire outfit, the results didn't look as good. By keeping parts of the original, DALL-E was able to better match color and lighting
Btw when I erased the entire outfit, the results didn't look as good. By keeping parts of the original, DALL-E was able to better match color and lighting
3/ But here’s the challenge. DALL-E works great for individual pictures, but it’s not designed for video. It won’t give you consistency from frame to frame.
Here was my early experiment. See, no consistency between frames
Here was my early experiment. See, no consistency between frames
