Martin Nebelong Profile picture
🎨 Artist on the forefront of tech, VR and AI. Client list include Runway, Lumalabs, Media Molecule, The UN, LEGO, Adobe. Once performed VR for 40k audience.
Jul 15 10 tweets 5 min read
Veo has an incredible "hidden" ability.

It's one of my absolute favorite aspects of Veo 3 i2v. It's ability to transport elements through the latent space, with this simple but very powerful prompt structure:

“Instantly jump/cut on frame 1. [Describe the new context]"

With this structure, I was able to use my quick drawing as the main subject in all the scenes you saw here. Seeing how the model is able to retain my personal sketch in all of these different contexts.. Feels magical honestly 😍

Music from artlist.io.

My personal opinion about the question asked here, should be clear if you've followed along with my posts 🔥🎨 Take a look at how consistent my sketch is, despite the change in lighting and the change in the underlying material.. The way the water distort the image.

Creating something as realistic as this in traditional 3d would be VERY difficult.

Notice how the model stays on the original frame for a short while and then jump/cuts.
Feb 16, 2024 14 tweets 4 min read
As you know, my explorations of the Gen AI space is ultimately all about creative control. You should be able to shape the generative matter using all your artistic sensibilities and your aesthetic sense.

OpenAI's Sora is a huge technological leap, but what excites me the most about it is the modalities where it depends on input other than text alone. Such as video to video. Here's an example of how Sora can change an input video.

Base video🧵 Prompt: Change the setting to be in a lush jungle.🧵
Dec 26, 2023 5 tweets 2 min read
So you might have thought that the sketch to video was impressive, and some of you even asked: "But what about 3d?"..

Here's my answer to that.

My sketch transformed to an illustration with Vizcom ai and then turned into a 3d model with Tripo ai. Expect more tests of that workflow in the near future.

#3d #ai Curiously the system didn't manage to make an actual hole through the donut.. but the worst mistake we can make is to think that that's reason enough to dismiss this tech as useless. Remember how we all used to laugh at the wierd ai generated hands? 😅
Dec 11, 2022 13 tweets 5 min read
Just had another chat session with OpenAI's ChatGPT system; that stuff is incredibly fascinating and thought-provoking. Literally feels like talking to alien intelligence. Go on an adventure with us about a human astronaut, Captain Nova. Check it out 🧵
#storytelling #chatgpt Here, ChatGPT just started the story, but I actually liked its first suggestion so let's just go with it!🧵