Karen X. Cheng Profile picture
Director • Sharing my creative experiments • Business: team@karenx.com

Apr 10, 2023, 8 tweets

1/ Filmmaker's guide to GEN-2

Generate videos with nothing but words
Access to GEN-2 will start rolling out this week @runwayml

I put together this guide to help with your experiments for when you play with it
#gen2

@runwayml 2/ Filmmaker's guide to GEN-2

It gets interesting when you add movement

It works best with simple movements btw, and struggles with more complex or intricate movements

@runwayml 3/ A peek behind the process

(This is beta UI, the final UI will change)

Currently it takes about 2 minutes to generate a 4 second video clip

@runwayml 4/ This will be such a powerful tool for creatives -
At the same time we need to think about how to mitigate risks & downsides

*Disclaimer: I'm not a spokesperson for Runway. All opinions are mine. Access was granted without posting requirements. This post is not sponsored.

5/ I'm told that access will open up to everyone within a few weeks -

Anyone who signs up for @runwayml (free plan and up) will receive an email once GEN-2 opens to all runwayml.com

@runwayml Keep in mind when you see AI demos online, you're usually only seeing the best cherrypicked examples

For every clip, there were many that didn't work. Currently it struggles with complex compositions & anatomy

Here are some of my fails -

@runwayml 7/ Filmmaker's guide to GEN-2

Try experimenting with visual styles and adding unexpected elements

@runwayml 8/ Sometimes when it doesn't work, all you have to do is run the exact same text prompt again

I kept trying to make this rock levitate, and after enough attempts it worked

"Insanity is doing the same thing over and over and expecting different results"

Share this Scrolly Tale with your friends.

A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.

Keep scrolling