Discover and read the best of Twitter Threads about #gen1
Most recents (9)
Pushed #gen2 again & made a movie trailer.
#aicinema is finally here!
Every shot made from text prompts, except one iconic shot you all know, done with #gen1
Made possible by @runwayml
@bazluhrmann your movies been a great inspiration! 😍🎞️🙏
Voices: @elevenlabsio
#aianimation
#aicinema is finally here!
Every shot made from text prompts, except one iconic shot you all know, done with #gen1
Made possible by @runwayml
@bazluhrmann your movies been a great inspiration! 😍🎞️🙏
Voices: @elevenlabsio
#aianimation
Some stats about used AI Tools:
☑️500+ shots generated with #gen2 beta to get 65 shots that made it into the movie
☑️5000 credits used to generate 3 custom voices with @elevenlabsio, that fitted my taste of timbre and likeness
☑️Initial idea by me, script co-created with #Chatgpt
☑️500+ shots generated with #gen2 beta to get 65 shots that made it into the movie
☑️5000 credits used to generate 3 custom voices with @elevenlabsio, that fitted my taste of timbre and likeness
☑️Initial idea by me, script co-created with #Chatgpt
Some stats about the film edit process:
☑️Music: the most important part for me! Some shots inspired me to find 2 tracks, put them together with the voices first, imagining the film in my head only
☑️Pace, timing, narration - all of that was done with the soundtrack first.
👇
☑️Music: the most important part for me! Some shots inspired me to find 2 tracks, put them together with the voices first, imagining the film in my head only
☑️Pace, timing, narration - all of that was done with the soundtrack first.
👇
The new iOS app from @runwayml featuring #Gen1 is 🔥 and now widely available!
- Turn anything into everything using your phone's camera
- Revive forgotten videos on your camera roll
- Effortlessly transfer assets to your Runway account without airdropping!
Download link ↓
- Turn anything into everything using your phone's camera
- Revive forgotten videos on your camera roll
- Effortlessly transfer assets to your Runway account without airdropping!
Download link ↓
Here's a live demo, courtesy of @stas_kulesh!
1/ 🚀 Runway's groundbreaking #Gen1 is here!
@runway has the tech, the network, and the community to reshape the online video landscape.
Here's why we should get ready...
🧵👀
@runway has the tech, the network, and the community to reshape the online video landscape.
Here's why we should get ready...
🧵👀
2/ 💡 @runway has been developing AI video tools since 2018 and garnered support from content creators and major movie/TV studios. 🎬
And in 2021, they teamed up with @LMU_Muenchen to develop the first version of #stablediffusion 🤯
technologyreview.com/2023/02/06/106…
#AICinema #AiArt
And in 2021, they teamed up with @LMU_Muenchen to develop the first version of #stablediffusion 🤯
technologyreview.com/2023/02/06/106…
#AICinema #AiArt
I'm learning to make 3D animations with A.I.
1) generated an image of a spaceman in Midjourney
2) turned it into a 3D model with @kaedim3d (it's expensive but the basic trial is $6 and you can make three generations, it doesn't make textures but a actorcore.reallusion.com… twitter.com/i/web/status/1…
1) generated an image of a spaceman in Midjourney
2) turned it into a 3D model with @kaedim3d (it's expensive but the basic trial is $6 and you can make three generations, it doesn't make textures but a actorcore.reallusion.com… twitter.com/i/web/status/1…
A.I image reference for the animation above 
Reference video as an input to #Gen1
@kaedim3d + @reallusion + @Blender
(Kaedim to generate a mesh from an image)
(Reallusion to automatically rig it)
(Blender for final input animation, I screengrabbed)
@kaedim3d + @reallusion + @Blender
(Kaedim to generate a mesh from an image)
(Reallusion to automatically rig it)
(Blender for final input animation, I screengrabbed)
How to Prepare for Gen-1 Access - 5 Tips to hit the ground running
On the GEN-1 Waitlist? I got access & it’s incredible, but there are many things I wish I had known before.
Here are 5 tips so you can start making amazing videos with GEN-1 on day 1. 👇🧵
1/
On the GEN-1 Waitlist? I got access & it’s incredible, but there are many things I wish I had known before.
Here are 5 tips so you can start making amazing videos with GEN-1 on day 1. 👇🧵
1/
1: Preparing Videos for GEN-1
There’s currently a 3s limit to video outputs & the input-output results are not 1-1 so you’ll have to do some time-remapping to get the best results.
To test out GEN-1, I’ve been filming short clips & creating edits built from 3s blocks.
2/
There’s currently a 3s limit to video outputs & the input-output results are not 1-1 so you’ll have to do some time-remapping to get the best results.
To test out GEN-1, I’ve been filming short clips & creating edits built from 3s blocks.
2/
This is the flow I use to get the final GEN-1 exports to (almost) match the original timing:
a) create a final edit
b) import into a sequence & cut it into 3s pieces
c) adjust the speed/duration to about 135%
d) export each ~2s piece as an mp4 & name each _1, _2, etc
3/
a) create a final edit
b) import into a sequence & cut it into 3s pieces
c) adjust the speed/duration to about 135%
d) export each ~2s piece as an mp4 & name each _1, _2, etc
3/
Today I met with the Global Media team to discuss Generative AI. The excitement was insane! Never seen a topic like this at work before.
Here are the 14 examples of AI in Media I shared with them & why: 🧵
Here are the 14 examples of AI in Media I shared with them & why: 🧵
1) @skirano's Control Net experiment using the Nike logo.
Why? Content is king. Keeping up with demand requires volume, time & $$. Now with AI, brands (& fans) can generate high quality, stunning visuals for a fraction of the cost or time
Why? Content is king. Keeping up with demand requires volume, time & $$. Now with AI, brands (& fans) can generate high quality, stunning visuals for a fraction of the cost or time
2) @nickfloats's Air Force 1s Hogwarts collab generated with Midjourney.
Why? Same reasons as #1 but it can be more than a logo -- it can be an entire product, reimagined with AI. Mash ups also work really well!
Why? Same reasons as #1 but it can be more than a logo -- it can be an entire product, reimagined with AI. Mash ups also work really well!
Après les photos dans les threads précédents, on va parler des vidéos ! Notamment 2 usages.
Créer des vidéos de 0 et modifier des vidéos existantes #AI
Créer des vidéos de 0 et modifier des vidéos existantes #AI
Tout d'abord le 2nd sujet, la transformation
Pour bien comprendre les problèmes de génération, j’avais essayé en passant image par image pour transformer des vidéos, mais on voit les soucis de constance, d’artefacts et le processus est très complexe
Pour bien comprendre les problèmes de génération, j’avais essayé en passant image par image pour transformer des vidéos, mais on voit les soucis de constance, d’artefacts et le processus est très complexe
Il y a plusieurs travaux sur le sujet, le dernier né est la beta de #Gen1 de Runway
Vidéo d’intro pour comprendre. J’ai pu tester quelques exemples que je vous montre dans la suite
Vidéo d’intro pour comprendre. J’ai pu tester quelques exemples que je vous montre dans la suite
🧠 AI experiment comparing #ControlNet and #Gen1. Video goes in ➡ Minecraft comes out.
Results are wild, and it's only a matter of time till this tech runs at 60fps. Then it'll transform 3D and AR.
How soon until we're channel surfing realities layered on top of the world?🧵
Results are wild, and it's only a matter of time till this tech runs at 60fps. Then it'll transform 3D and AR.
How soon until we're channel surfing realities layered on top of the world?🧵
First ControlNet. Wow, this tool makes it very easy to get photorealistic results. I used the HED method for this scene and got some amazing results. I used EbSynth for smoother interpolation between ControlNet keyframes. Check out my prior posts for the end-to-end workflow.
Next up Gen 1: impressive is the word. The star of the show is the temporal consistency. Getting photoreal results is harder than ControlNet IMO. #Gen1 is almost its own stylized thing, so I advise leaning into that. But why does it matter - can't we just type text to get video?
Here's why $LUNA is - still - undervalued and why YOU should be buying it right now, if you're looking for #financialfreedom💸
A🧵that might just change your life.
A🧵that might just change your life.
1/ $LUNA's financial revolution is closely tied to it's stablecoins. To understand the importance of #stablecoins, you must know that they account for a vast majority of trading volume in #crypto and are of course at the center of putting the #currency back into #cryptocurrency.
2/ Now, on the #terraluna ecosystem there are stablecoins for a lot of different currencies (USD, EUR, CHF, GBP, KRW, etc.) but the currently most integrated and used one is the USD-stablecoin: UST💲
