2/ For every frame you see, it generates 8 frames in between with incredibly smoothness and accuracy. Its main use case is to create artificial (and very convincing) slow motion on clips, but I thought it'd be interesting to apply it to stop motion to create "impossible" movement
3/ You can try DAIN by going to grisk.itch.io/dain-app. It works on Windows and NVIDIA only (it requires a TON of GPU power) and isn't the easiest to set up or run. But I do believe that this technology will become more mainstream
4/ It won't be too long before people can download an iPhone or Android app, press a button, and apply this effect.
5/ Keep in mind though that with this clip, and with most things I share on this page (especially AI-related) there's massive selection bias - I'm cherry-picking the best examples to show you. We tested over 100 clips and these were my favorite results.
6/ There's a lot of motions and movements that didn't do well - for example anything where I rotated my body or had overlapping movements.
• • •
Missing some Tweet in this thread? You can try to
force a refresh
2/ Here's how - walked around me in circles a few times, pointing his phone at me. We fed the video into Instant-NGP which created a NeRF out of the footage.
3/ It's kinda like a 3D model, but instead of creating mesh+textures it’s more like a point cloud that changes color depending on what angle you view it from. This creates beautiful surreal lighting effects - you can see how the light hits differently as we change camera angles.
I used @OpenAI#dalle2 to create the first ever AI-generated magazine cover for @Cosmopolitan!! The prompt I used is at the end of the video #dalle
1/ For something like this, there was a TON of human involvement and decision-making. While each attempt takes only 20 seconds to generate, it took hundreds of attempts.
Hours and hours of prompt generating and refining before getting the perfect image
2/ I think the natural reaction is to fear that AI will replace human artists. Certainly that thought crossed my mind. But the more I use #dalle2, the less I see this as a replacement for humans, and the more I see it as tool for humans to use - an instrument to play