I spent the weekend playing with ChatGPT, MidJourney, and other AI tools… and by combining all of them, published a children’s book co-written and illustrated by AI!
Here’s how! 🧵
First, the idea: I wanted a story showing the magic of AI to children. I gave ChatGPT a prompt and went back and forth with it to refine details and get inspiration for the illustrations. It was like having a constant brainstorming partner who I could ping pong ideas off of.
Then, I took those ideas to MidJourney and gave it prompt after prompt till I could get a somewhat consistent style. This took a few hours but it was such a fun process playing with all the different styles!
There were also some hilarious results 😂 what’s going on with those eyes and hands?!
I combined all of those and put them together in a book format and signed up to Amazon Kindle Publishing! Filled out the book details, created a little cover, even had ChatGPT help me with the description.
And BOOM. In a weekend, from idea, to illustrations, to becoming a publisher author! You can check out the book on Amazon here :)
And if you have any kids you want to gift this to, let me know! I’d love to send you a copy!
Adding this to the main thread after a lot of helpful convos with folks willing to discuss—this is a PSA!
There are serious, incredibly valid concerns from artists and writers about all this technology. Their emotional responses are fair, we should listen and instead should ask:
To the creators of these tools at OpenAI & MidJourney: how do we ensure protections for artists / train models on consent? Their talent, skill, hard work to get there needs to be respected.
In fact we should involve them in the the creation of these tools so they’re heard.
This was all a test of what’s possible, but I’ll be waiting to hear more on the above before proceeding to create more content. Thank you to those who were willing to discuss despite the emotions this all unintentionally but very fairly spurred. I appreciate you.
• • •
Missing some Tweet in this thread? You can try to
force a refresh
Introducing Sparkle ✨, a custom GPT that helps you craft storybooks and become a published author!
It can:
- Generate a book with a page by page breakdown
- Provide amazing MidJourney prompts & illustrate with DALL-E
- Layout pages & much more!
Demo and full features below! 🧵
As you saw above, you can brainstorm with Sparkle, refine ideas, while it pushes you to develop your story and add depth... But you can also just start someone in your life or an image and Sparkle helps personalize the story it crafts around that!
Not sure how MidJourney prompts work, or have questions about specific parameters? Sparkle is trained on MidJourney documentation too and can help you craft the perfect prompt while explaining how it all works. It can even give you tips on things like character consistency!
Here’s an AI generated horror movie trailer I made this weekend in 2 hours!
Text-to-video clips with @runwayml Gen-2, and a little bit of voice acting.
And of course, the whole workflow and process with prompts so that you can make your own! 🧵
First, I knew I wanted to try my hand at horror, and to build tension I wanted scenes to be dimly lit, hard to look through, but just enough to see something was off. I took that direction to @runwayml's Gen-2.
So here's an example → "Cinematic horror shot" brought realism to my generations, "dimly lit" lighting descriptions made clips darker, and providing director inspiration like @flanaganfilm (who I'm a huge fan of), or @StephenKing gave it the right tone.
AI has been a game changer for making my ideas real.
From books, animated shorts, coding games, podcasts with people from the past, and more. I love sharing what I'm learning in hopes to inspire you!
This thread is a compilation of all my guides so far with more to be added! 🧵
Make your own children's book in a weekend, get it on Amazon and have the paperback in your hands within a week!
It's the experiment that started it all for me and ended up being featured in TIME, The Washington Post, Business Insider, and news outlets around the world!
Turns out it did! It seemed to be describing the Wikipedia page of the game but that was all... so it was a true test—could we bring this game back to life based on just our understanding of it and a description?
I don't know how to write a line of 3D game programming code, so I asked GPT-4 to pick out how it would make the game, it suggested using BabylonJS, and HTML and CSS. Then I described exactly what we would borrow from SkyRoads and how this version would be different—prompt:
Once I got the code, I pasted it into @Replit the exact way GPT told me too, and it worked! Except... we were FAR from the final product. The green cube, our soon-to-be spaceship, had no ability to turn left or right no way to dodge those pesky obstacles. Well, GPT fixed that🚀
So, you think GPT-4 can't make a complex game... think again!
Here's how I used GPT-4, @Replit, MidJourney, Claude, assembling a team of AI assistants, to create a 3D space runner from scratch with ZERO knowledge of Javascript or 3D game programming
Follow along for a saga! 🧵
After Snake, seeing @skirano's epic pong recreation, and @javilopen demoing Doom, I wanted to see if I could get GPT-4 to make a fully fledged 3D game. A childhood favorite game of mine was an MS-DOS game called SkyRoads, it was long forgotten. But... did GPT-4 know about it?
Turns out it did! It seemed to be describing the Wikipedia page of the game but that was all... so it was a true test—could we bring this game back to life based on just our understanding of it and a description?
Can GPT-4 code an entire game for you? Yes, yes it can.
Here's how I recreated a Snake game that runs in your browser using Chat GPT-4 and @Replit, with ZERO knowledge of Javascript all in less than 20 mins 🧵
First, I just asked GPT-4 to provide code for a Snake game, with the relevant HTML, CSS, and Javascript required to make it run. This provided all of the code I needed to get the project going. It wasn't able to complete it all in one response, but I just replied with "continue"
Once I had all of the necessary code for the game, I created an account on @Replit and started a new HTML, CSS, JS project. That gives you all of the necessary files you'll need to run the code (and all in your browser too!)