1/ 🚀 Runway's groundbreaking #Gen1 is here!

@runway has the tech, the network, and the community to reshape the online video landscape.

Here's why we should get ready...

🧵👀 2/ 💡 @runway has been developing AI video tools since 2018 and garnered support from content creators and major movie/TV studios. 🎬

And in 2021, they teamed up with @LMU_Muenchen to develop the first version of #stablediffusion 🤯

technologyreview.com/2023/02/06/106…

#AICinema #AiArt

Spending Sunday with #Midjourney ... 🧵

#Midjourney does not reliably understand lenses.

However, at least in an #AICinema context, you can use shot sizes to approximate the lens.

🧵 Here's how ...

(prompts ➡️ ALT)
#AIArtCommuity #AiArt Basically, you can choose between these lenses:

🏔 Wide-angle lenses (10mm to 35mm)
🕺 Standard lenses (35mm to 85mm)
👀 Telephoto lenses (85mm to 300mm)

They often correspond to these shots:

Wide angle (wide-angle)
Medium to medium close-up (standard)
Close-up (tele)

😮 So excited that a major TV production company approached me to help them develop prompts & workflows for story development using #GPT4. 🚀

⏰ For #screenwriters & #filmmakers, this is a wake-up call

🧵 💰💻💡 The industry is eager to save money & resources /w AI efficiency + #GPT4 is leading the charge. I expect production processes to be changed within a year.

The infamous #OpenAI study has shown: Creative tasks are the most exposed to AI automation

https://twitter.com/tristwolff/status/1638204342959210498?s=20

New paper on #GPT4 & "Labor Market Impact" is out.

It's an early evaluation, but creatives should be paying attention to this ... 👀

🧵 1/5 All the jobs that show 0 exposure to being automated by LLMs are defined by

- blue-collar, manual labor
- outdoor or non-office
- lower educational requirements
- use of specialized tools or equipment

As we'll see: jobs /w higher educational requirements ➡️ high exposure 🚨 2/5

AI text-to-video is now available as an open-source model 🚀

It's still in its early stages & nowhere near as mature as #Midjourney, but it's definitely worth exploring.

Here's how it works & how you can experiment with it.

🧵
#Modelscope #text2video #AIArt #AiArtCommunity The model is simply called “text-to-video synthesis”. A brief summary:

- 1.7 billion parameters 🔥
- training data includes public datasets like LAION5B (5,85 billion image-text pairs), ImageNet (14 million images) & WebVid (10 million video-caption pairs) 🌎
- open source 💪

Some #Midjourney V5 findings 🔥
Finally! Full-blown cinematic aspect ratios!

2.4:1 widescreen cinema standard ✅
2.76:1 ultra panavision 70 ✅

you can go up to 14:1 (!) but: letterboxing seems to set in roughly at ultra widescreen (3.6:1)

#midjourney5 🧵 However, 3.6:1 (and higher ratios) seems to work better if you drop the cinematic prefixes (cinematic shot, film still, etc.) 🤷‍♂️🤔
Here it's just scene & style description. 3.6:1, no letterboxing.

Built this in 1.5 hrs w/ #GPT4 & #Midjourney.
I only have basic JS skills.

The possibilities of 🤖 &🧠 co-creation are mind-boggling. 🎉

Graphics: 🤖 images &🧠 curation
Code: 🤖 HTML/CSS/JS &🧠 co-debugging
Music: 🤖 Samples &🧠 sequencing

Here's how: 🧵

@RedSquidProject I generated the images for the game with #midjourney
Prompted for basic 1:1 images, using the tried and tested combination of "white background" and "--no background" to prep transparent PNGs

With #midjourney V4 supporting aspect ratios up to "2:1", here's how you can use them effectively in your #AICinema storytelling. 🎥🔥

🧵👇 Besides being technical requirements for screen sizes, ratios can also be used to create an aesthetic backdrop for your stories. 🎬

E.g. 4:3 (or "1.33:1" in cinema slang) is the "classic ratio" of TV monitors & perfect for scenes that are meant to evoke an "analog TV" vibe

#AIArt is about to revolutionize #screenwriting! 🤯 As AI tools become more intuitive and easy to use, some think production companies might prioritize profit over storytelling & we'll be binging stunningly beautiful visuals paired with incredibly boring plots.. 🤔

A thread 🧵 1) We could be in for a wild ride here:
As with all technology, there is a risk of it being used in a way that strictly prioritizes profit. AI material might be used to create visually appealing stories that lack depth and originality

Here's a technique for movie concept creation I currently experiment with:

Using #screenwriting devices to prompt #GPT3 for basic story ideas & plots and then using those to generate #midjourney #aiart images depicting key scenes, characters & settings... Not only is this a huge time saver for #writers when brainstorming or trying out different dramatic scenarios, but you also get images that further spark your imagination...

Using AI image tools like @midjourney + @OpenAI for idea generation and plot/character inspiration is a real game-changer for #writers!

The possibilities are immense!
🧵 for the #writerscommunity First: Goodbye #writersblock! AI image & text generation let us come up with creative solutions to problems we may have been stuck on for days!

They help us generate new perspectives on

- characters
- ensemble
- plot
- story structure & dramaturgy
- dialogue
- setting