I got a rare opportunity to ask OpenAI's video generation model Sora for some videos this week! I had 3 prompts. Here's the videos with my prompts and what I learned 🧵
Prompt 1: A medium sized friendly looking dog walks through an industrial parking lot. The environment is foggy and cloudy. Shot on 35mm film, vivid colors.
Prompt 2: A timelapse closeup of a 3D printer printing a small red cube in an office with dim lighting.
Prompt 3: A young professional product reviewer in a well lit video studio is surrounded by gadgets and technology, sitting in front of a computer with two displays. He's holding a cinema camera as he ponders what video to make next. He is in focus, while the background is slightly blurred for cinematic effect
What I learned:
1: It can struggle with physics, specifically with legs/walking. Often in Sora-generated videos of walking, the legs cross over and merge into each other. Also branded items never quite match up to real life. Things like cars, cameras, etc are never quite identifiable as a specific model
3: My god the lighting is so good sometimes. In the third clip, it's almost as if there's a large soft key light just out of frame to the left, and across the board, lighting and shadows match very well. Across the desk, the computer, keyboard, face, etc........ but he has 6 fingers lol
1: It can struggle with physics, specifically with legs/walking. Often in Sora-generated videos of walking, the legs cross over and merge into each other. Also branded items never quite match up to real life. Things like cars, cameras, etc are never quite identifiable as a specific model
3: My god the lighting is so good sometimes. In the third clip, it's almost as if there's a large soft key light just out of frame to the left, and across the board, lighting and shadows match very well. Across the desk, the computer, keyboard, face, etc........ but he has 6 fingers lol
I had a really insightful conversation with some of the @OpenAI head developers of Sora as well. Coming soon to the Waveform podcast!
youtube.com/Waveform
youtube.com/Waveform
• • •
Missing some Tweet in this thread? You can try to
force a refresh
