Paul Trillo Profile picture
LA based writer / director / artist / vacuum salesman | Watch “ABSOLVE” https://t.co/gqapRcgKRj

Sep 15, 2022, 5 tweets

Using @OpenAI dall-e 2 AI to dream up what a Chinese restaurant skyscraper might look like. The fluid frame interpolation was made with @runwayapp new super slow motion setting that also uses the power of AI to morph between frames.
#aiart #ai #architecture #vfx #dalle

To create this a still from the original video was uploading to dall-e’s outpainting canvas. I then erased a little bit off the top of the building, generated an extension and repeated this step over 40 times

Next step is to sequence all the frames together and erase the sky behind it

The frame sequence is then uploaded to @runwayml - using their new super slow motion feature, I slowed the frame sequence down to 25% speed to force a fluid interpolation motion to smooth out the raw jittery stop motion

The slow motion animation is then brought back into after effects. The original video is motion tracked and the animation is layered on top

Share this Scrolly Tale with your friends.

A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.

Keep scrolling