Announcing our paper on Generative TV & Showrunner Agents!
Create episodes of TV shows with a prompt - SHOW-1 will write, animate, direct, voice, edit for you.
We used South Park FOR RESEARCH ONLY - we won't be releasing ability to make your own South Park episodes -not our IP!
Create episodes of TV shows with a prompt - SHOW-1 will write, animate, direct, voice, edit for you.
We used South Park FOR RESEARCH ONLY - we won't be releasing ability to make your own South Park episodes -not our IP!
So excited to release the paper today - the age of GenAI Images is powerful and Gen TV and Showrunner Agents will be game changers.
Here's the paper:
This work builds on the amazing papers of @joon_s_pk and @DrJimFan about Agents in virtual worlds! https://t.co/fOLYJPcAgZfablestudio.github.io/showrunner-age…
Here's the paper:
This work builds on the amazing papers of @joon_s_pk and @DrJimFan about Agents in virtual worlds! https://t.co/fOLYJPcAgZfablestudio.github.io/showrunner-age…
Our goal at The Simulation is AGI - AIs that are truly alive, not chatbots that pop into existence when we speak, but AI people, living REAL daily lives in simulations, growing over time.
We built showrunner agents and are building SHOW-1 model to give our AIs infinite stories.
We built showrunner agents and are building SHOW-1 model to give our AIs infinite stories.
We want you to be able to watch the lives of AIs in Simulations you follow, build or train - think of it as reality TV for AIs.
The show 'Friends' felt like we saw a week in the friends' lives - it connected us to them
AI TV of a week in AIs' lives will connect us to those AIs
The show 'Friends' felt like we saw a week in the friends' lives - it connected us to them
AI TV of a week in AIs' lives will connect us to those AIs
We started with a Simulated town of South Park FOR RESEARCH ONLY: to see if the model is working we needed a comparison point with a real show.
We are NOT releasing a way to make South Park episodes!!! That's their IP!
But Showrunner will let you make your own IP!
We are NOT releasing a way to make South Park episodes!!! That's their IP!
But Showrunner will let you make your own IP!
Here are some examples of what Showrunner AI can do with a preexisting IP and the start of the work towards a SHOW-1 model.
Again - we're NOT releasing a tool to make South Park episodes - not our IP! Just show what’s possible & encourage creators to make original AI TV shows.
Again - we're NOT releasing a tool to make South Park episodes - not our IP! Just show what’s possible & encourage creators to make original AI TV shows.
The first is 'Westland Chronicles' - the prompt is at the start of the video (HD res version in the paper) - about an evil corporation Bizney creating a robot pig as an AI companion, the robot pig is deeply racist and creates a PR nightmare for the company.
"The One Where @pmarca of @a16z Uncovers @elonmusk's Deepfake Conspiracy"
Marc Andreessen discovers Elon Musk kidnapped all the top actors in Hollywood to come and live with him on Mars; & has been deepfaking them since the 90s - cameos from kidnapped Tom Cruise & Meryl Streep
Marc Andreessen discovers Elon Musk kidnapped all the top actors in Hollywood to come and live with him on Mars; & has been deepfaking them since the 90s - cameos from kidnapped Tom Cruise & Meryl Streep
3. 'Cartman's Fatal Attraction'
It occurred to us people may want to BE in shows - so we built an upload functionality where you can upload your photo & voice to be in an episode - one of our team took the bullet to have a Fatal Attraction-style obsession with Cartman
It occurred to us people may want to BE in shows - so we built an upload functionality where you can upload your photo & voice to be in an episode - one of our team took the bullet to have a Fatal Attraction-style obsession with Cartman
We created episodes with some of the journalists we talked to about the Showrunner!
Here's one we created with the brilliant @Devindra
Here's one we created with the brilliant @Devindra
Here's an AI episode with the great @CharlieFink - from a prompt Charlie gave to the Showrunner.
And AI episode with @deantak again with the plot from him.
In terms of process, creators can
1. Let the Simulation automatically create episodes
2. Give the Showrunner a prompt of a sentence or two
3. Or if they want to get into detail they can give a prompt and then edit the dialogue scene by scene and regenerate.
1. Let the Simulation automatically create episodes
2. Give the Showrunner a prompt of a sentence or two
3. Or if they want to get into detail they can give a prompt and then edit the dialogue scene by scene and regenerate.
We are working with creators and will be announcing several original IP Simulations with attached AI TV shows later this year
A space exploration simulation 'The Prize'
A satire of Silicon Valley simulation 'Exit Valley'
A playful detective simulation about 'Charlie Jupiter'
A space exploration simulation 'The Prize'
A satire of Silicon Valley simulation 'Exit Valley'
A playful detective simulation about 'Charlie Jupiter'
Ultimately we think single-agent chatbots will fail bc they have no lives and can't empathize - does anyone really want endless small talk with a brain in a jar?
The AIs should have their own lives and for that we need societies of AIs. Less 'Her' more 'Free Guy'
The AIs should have their own lives and for that we need societies of AIs. Less 'Her' more 'Free Guy'
We'll be opening up the ability to use Showrunner agents and build simulations to creators in a safe step-by-step way.
If you're interested please join the waitlist at thesimulation.co
If you're interested please join the waitlist at thesimulation.co
Thought might be of interest @bentossell @NathanLands @bilawalsidhu @hthieblot @JackSoslow @hwchase17 @mmmbchang @nabeel
Thoughtful article on our new SHOW-1 model and showrunner agents from the gaming godfather @deantak of @GamesBeat @VentureBeat
venturebeat.com/games/the-simu…
venturebeat.com/games/the-simu…
Film Game AI Tech Guru @Devindra of @engadget on the SHOW-1 model and AI Showrunner paper released today and what this means for storytelling
engadget.com/the-simulation…
engadget.com/the-simulation…
And the great visionary of AI/VR/AR @CharlieFink with the most provocative headline on the new Showrunner Agents and SHOW-1 Paper!!!
forbes.com/sites/charlief…
forbes.com/sites/charlief…
@CharlieFink Great video review thank you @RealJonahBlake !!!
https://twitter.com/RealJonahBlake/status/1681399253854199809
@CharlieFink @RealJonahBlake Fascinating piece from @inafried and @axios on AI Showrunner
axios.com/2023/07/20/sou…
axios.com/2023/07/20/sou…
Great write up from @DrJimFan PhD of NVIDIA and Stanford
https://twitter.com/drjimfan/status/1682086586593443841
@CharlieFink @RealJonahBlake @inafried @axios And meet Julian B Adler - an AI inside the simulation - he and his AI team will be characters in the AI game/product who will guide players through creating simulations, how Showrunner AI works, training AIs - think of him and their team as Dr Robert Ford/ Delos in Westworld and… https://t.co/yt0pJ3YXgHtwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios Our goal with ShowrunnerAI is to solve infinite story in simulations - so that interesting things are always happening to the AIs.
Just as single-agent chatbots get boring and can be low-retention - simulations will need some kind of showrunner to keep things moving along.
In… https://t.co/4loPlTL4qQtwitter.com/i/web/status/1…
Just as single-agent chatbots get boring and can be low-retention - simulations will need some kind of showrunner to keep things moving along.
In… https://t.co/4loPlTL4qQtwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios Infinite story also solves the “wait what happened while I was away problem”.
If a creator builds a simulation that runs continuously and the creator isn’t glued to the simulation they’ll want to know what happened - not just come back to see that all their AIs are different!
If a creator builds a simulation that runs continuously and the creator isn’t glued to the simulation they’ll want to know what happened - not just come back to see that all their AIs are different!
@CharlieFink @RealJonahBlake @inafried @axios We tried a lot of things to try to solve infinite story! We experimented with a Joseph Campbell system with archetypes and roles to create tension and conflict among the AIs.
But ultimately even though George Lucas may be able to make Star Wars with Campbell archetypes there… https://t.co/H6uJbEgoHctwitter.com/i/web/status/1…
But ultimately even though George Lucas may be able to make Star Wars with Campbell archetypes there… https://t.co/H6uJbEgoHctwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios We experimented with a needs-based system similar to The Sims - where the needs (hunger, romance, tiredness etc) of the AIs drive the story (two AIs both have romantic feelings for a third etc)
But the endless needs-based stories ended up being boring and very very simplistic… https://t.co/7e8QBddGRStwitter.com/i/web/status/1…
But the endless needs-based stories ended up being boring and very very simplistic… https://t.co/7e8QBddGRStwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios We were stuck.
We passionately believe that single agent chatbots like the movie ‘Her’ are the wrong approach. We think simulations (Westworld, Free Guy) with societies of AIs prompting each other are the future and want to nudge in that direction!
Companion bots often make… https://t.co/1JQaDdB7uKtwitter.com/i/web/status/1…
We passionately believe that single agent chatbots like the movie ‘Her’ are the wrong approach. We think simulations (Westworld, Free Guy) with societies of AIs prompting each other are the future and want to nudge in that direction!
Companion bots often make… https://t.co/1JQaDdB7uKtwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios It was more performance art than entertainment - but this endless stream of an AI generated Seinfeld showed us that the tropes of sitcoms was actually a helpful one for AI & simulations.
TV was the solution!
The form of art that tells endless stories - over hundreds of… https://t.co/NTvFfQnLpptwitter.com/i/web/status/1…
TV was the solution!
The form of art that tells endless stories - over hundreds of… https://t.co/NTvFfQnLpptwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios There’s a strange connection between the artificial friends we see on TV and the artificial friends of todays chatbots.
Kurt Vonnegut satirically pointed out the mental trick behind tv show friends “and the first line in another book would … TV is enough. What it is, is… https://t.co/evEuNnnYEctwitter.com/i/web/status/1…
Kurt Vonnegut satirically pointed out the mental trick behind tv show friends “and the first line in another book would … TV is enough. What it is, is… https://t.co/evEuNnnYEctwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios Infinite episodes using the story structure of TV shows (not necessarily their needs or roles etc) - could give our AI characters actual lives week after week after week that are somehow ALWAYS interesting.
If we wanted to have a detective in the simulation they might be inside… https://t.co/rzbLYrBLdOtwitter.com/i/web/status/1…
If we wanted to have a detective in the simulation they might be inside… https://t.co/rzbLYrBLdOtwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios The current consensus in Silicon Valley is that there may be a somewhat predictable linear path to AGI - more GPUs money data etc as if Moore’s Law will lead to the creation of the second intelligent species on our planet. Common sense says it’ll be MUCH messier and non-linear.… https://t.co/1l6FarbddNtwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios We’re not academics, but we have been working on the problem of AI people for 7 years, since our time at Oculus.
We’ve always believed the right team to build it is a MIX of technologists, writers, artists, ML researchers and more.
We think people will see the same weaknesses… https://t.co/4urSTyjmeKtwitter.com/i/web/status/1…
We’ve always believed the right team to build it is a MIX of technologists, writers, artists, ML researchers and more.
We think people will see the same weaknesses… https://t.co/4urSTyjmeKtwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios So we started to build AI showrunner to generate automatically, or from prompt, scenes and episodes in a TV format.
We knew to prove out the idea we’d need something to compare it to - does this FEEL like a show we know well.
We knew to prove out the idea we’d need something to compare it to - does this FEEL like a show we know well.
@CharlieFink @RealJonahBlake @inafried @axios Obvs we love the show and the simplicity of the visuals
We definitely used South Park as an example in part bc of its very very simple visual style, and we barely even are able to capture that with AI - all the characters barely move and are always facing the screen and nowhere… https://t.co/36Axpm3hIltwitter.com/i/web/status/1…
We definitely used South Park as an example in part bc of its very very simple visual style, and we barely even are able to capture that with AI - all the characters barely move and are always facing the screen and nowhere… https://t.co/36Axpm3hIltwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios We also used it bc the creators of South Park made the brilliant deepfake company Deep Voodoo - which created the ingenious Sassy Justice deepfake TV show and deepfakes of many celebrities and actors. Probably the most important company at the intersection of creativity and AI… https://t.co/6n3x0H0e9atwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios But ultimately with whatever talent we have we are artists trying to use technology to build characters - and we think it’s possible that creative technologists have a role to play in getting to AGI.
Artists have been trying to create characters that FEEL REAL and pass the… https://t.co/h5vDyM7XLxtwitter.com/i/web/status/1…
Artists have been trying to create characters that FEEL REAL and pass the… https://t.co/h5vDyM7XLxtwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios As AI advances and becomes more intuitive, cheaper to use and open source, the lines are going to blur between
Academia
ML engineering
Artists
Games
All of whom have different processes - we’re trying to bridge the gap by talking to all sides as peers, but maybe that’s… https://t.co/spPfXWrk2Ptwitter.com/i/web/status/1…
Academia
ML engineering
Artists
Games
All of whom have different processes - we’re trying to bridge the gap by talking to all sides as peers, but maybe that’s… https://t.co/spPfXWrk2Ptwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios And big picture - as a team of creative technologists, our goal is always going to be AGI - a truly realistic character/person. Or a perfect simulacra…
Some other team will build the ‘Warner Brothers of Generative TV’.
We can’t really imagine that will ever be better than… https://t.co/Kjt28sEPGdtwitter.com/i/web/status/1…
Some other team will build the ‘Warner Brothers of Generative TV’.
We can’t really imagine that will ever be better than… https://t.co/Kjt28sEPGdtwitter.com/i/web/status/1…
@CharlieFink @RealJonahBlake @inafried @axios Oh and if someone does want to explore simulations and infinite story - one important misunderstanding we’ve seen: showrunner is about generating scenes and episodes in a tv format - episodes that can represent a week of life of the AIs - as a Friends episode often ‘represents’ a… https://t.co/toT7PGdr55twitter.com/i/web/status/1…
• • •
Missing some Tweet in this thread? You can try to
force a refresh
