Cloud simulators will be the most impactful application of Machine Learning in the next few years

Games generate data for free if a player is willing or if a Reinforcement Learning bot is programmed to play them

So how big is the game simulator opportunity? 1/n
Epidemiological modeling essentially looks at 2d curves and decides OK this is bad or OK this is not too bad

A more useful approach is agent based modeling that you use to inform your behavior - e.g: are supermarkets safe is 6ft enough?… 2/n
Taking actions in the real world is expensive

A badly configured robot in the real world can injure itself and you in the process of learning

You can't randomize the real world to improve generalization 3/n…
Collecting data in the real world is expensive

Creating data in a game is free 4/n…
Games are the dominant form of entertainment for younger people, it's extremely difficult to craft good AI for games

Games like Dota 2 have 118 heroes, you need a decision tree for each hero and you need to change all of them for each patch! 5/n…
Games are datasets where you can create agents that are tested end to end on their language comprehension skills, strategic skills, vision skills etc..

Any game you can imagine or have played can be used as a dataset 6/n
So who are the players in this space?

Gaming companies: Unity, Epic, Roblox
Cloud Companies: Google, Microsoft, AWS

And who is most likely to win this space?

It's possible to craft Reinforcement Learning bots in Epic and Roblox…

However the most robust offering is Unity ML agents…

Unity also has the benefit of being the only publicly traded game engine company 8/n
Roblox owns its own store, make it trivial for others to deploy games and remix games - it's a platform reminiscent of that has the potential to move fast

Epic has more advanced lighting and physics but is still far behind Unity in ML 9/n
However, Reinforcement Learning is not sample efficient, you need tons of servers to get anywhere. Servers which AWS, Google and Microsoft own in abundance.

Unity has understood this and partnered with Google… 10/n
But does Google really need Unity?

Google, AWS and Microsoft all own their gaming stores - Microsoft has the most in house gaming expertise but AWS and Google are moving really fast

Reinforcement Learning algorithms can be implemented in a single Python file

Open source game engines like Godot are slowly rivaling the best

If cloud providers invest heavily in Godot, where is the moat for Game Engines? 12/n
The only game engine with a real moat seems to be NVIDIA with GPUs, CUDA and gamer mindshare can cut out the competition entirely… 13/n
Game engines are synonymous with data

If data is oil then Game engines are free energy machines

Cloud providers & game engines won't go out without a fight

If you'd like follow the progress on who will win this battle, make sure to subscribe

• • •

Missing some Tweet in this thread? You can try to force a refresh

Keep Current with Mark Saroufim

Mark Saroufim Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!


Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @marksaroufim

8 Nov 20
I just finished watching @NetflixTheQG and wow did it bring out some feels.

I was never particularly good but I spent the better part of my childhood playing Chess and reading Chess books.

I was about 12 years and "Searching for Bobby Fischer" was randomly airing on TV. 🧵
I remember being so captivated by the moving pieces even though I had no idea what was going on. My older sister offered to teach me, she showed me how the pieces moved, after losing the first few games I would ask for just "one more" until I was able to win consistently.
My older sister was so happy and mentioned to my dad that it sounds like I'm pretty good. I played a few games against my dad but no matter what I did I kept getting crushed and I remember being so frustrated and angry.
Read 19 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!