Discover and read the best of Twitter Threads about #text2video
Most recents (1)
AI text-to-video is now available as an open-source model 🚀
It's still in its early stages & nowhere near as mature as #Midjourney, but it's definitely worth exploring.
Here's how it works & how you can experiment with it.
🧵
#Modelscope #text2video #AIArt #AiArtCommunity
It's still in its early stages & nowhere near as mature as #Midjourney, but it's definitely worth exploring.
Here's how it works & how you can experiment with it.
🧵
#Modelscope #text2video #AIArt #AiArtCommunity
The model is simply called “text-to-video synthesis”. A brief summary:
- 1.7 billion parameters 🔥
- training data includes public datasets like LAION5B (5,85 billion image-text pairs), ImageNet (14 million images) & WebVid (10 million video-caption pairs) 🌎
- open source 💪
- 1.7 billion parameters 🔥
- training data includes public datasets like LAION5B (5,85 billion image-text pairs), ImageNet (14 million images) & WebVid (10 million video-caption pairs) 🌎
- open source 💪
Text-to-video synthesis consists of three sub-networks that work together to produce short MP4 video clips:
- a text feature extraction,
- a text feature-to-video diffusion model,
- and a video-to-video diffusion model.
🚀🚀🚀
- a text feature extraction,
- a text feature-to-video diffusion model,
- and a video-to-video diffusion model.
🚀🚀🚀
