1/ Using AI to smooth my footage 😌 with @jperldev. We’re using DAIN, an AI technique that smoothly interpolates frames. #stopmotion #artificialintelligence
2/ For every frame you see, it generates 8 frames in between with incredibly smoothness and accuracy. Its main use case is to create artificial (and very convincing) slow motion on clips, but I thought it'd be interesting to apply it to stop motion to create "impossible" movement
3/ You can try DAIN by going to grisk.itch.io/dain-app. It works on Windows and NVIDIA only (it requires a TON of GPU power) and isn't the easiest to set up or run. But I do believe that this technology will become more mainstream
4/ It won't be too long before people can download an iPhone or Android app, press a button, and apply this effect.
5/ Keep in mind though that with this clip, and with most things I share on this page (especially AI-related) there's massive selection bias - I'm cherry-picking the best examples to show you. We tested over 100 clips and these were my favorite results.
6/ There's a lot of motions and movements that didn't do well - for example anything where I rotated my body or had overlapping movements.

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Karen X. Cheng

Karen X. Cheng Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @karenxcheng

Jul 6
1/ We used NeRF to get this shot. This entire thing was shot with a phone 🤳 No drones were used @jperldev #photogrammetry #instantNeRF #neuralrendering #artificialintelligence
2/ Here's how - walked around me in circles a few times, pointing his phone at me. We fed the video into Instant-NGP which created a NeRF out of the footage.
3/ It's kinda like a 3D model, but instead of creating mesh+textures it’s more like a point cloud that changes color depending on what angle you view it from. This creates beautiful surreal lighting effects - you can see how the light hits differently as we change camera angles.
Read 8 tweets
Jun 27
I used @OpenAI #dalle2 to create the first ever AI-generated magazine cover for @Cosmopolitan!! The prompt I used is at the end of the video #dalle
1/ For something like this, there was a TON of human involvement and decision-making. While each attempt takes only 20 seconds to generate, it took hundreds of attempts.

Hours and hours of prompt generating and refining before getting the perfect image
2/ I think the natural reaction is to fear that AI will replace human artists. Certainly that thought crossed my mind. But the more I use #dalle2, the less I see this as a replacement for humans, and the more I see it as tool for humans to use - an instrument to play
Read 8 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(