Emm Profile picture
Nov 5 14 tweets 8 min read
Let’s keep using #StableDiffusion to design or create #game assets, quickly and consistently.

In 15 min, generated an army of golems with similar shapes and sizes, but various “materials” (lava, rock, water, ice, forest, sand, gold…).

No in-painting is needed. Thread 🧵
Step 1 (as in my previous examples with chests - ), I made a Dreambooth finetune w. just 11 pics.

As soon as the model was trained, the first step was randomly generating a large set of images w. a simple prompt ("golem, detailed, realistic, 3D rendering")
Each golem can be extracted by removing the images' backgrounds (reco: @photoroom_app).

Some of the designs are amazing. However, the golems all look very similar to each other. Let's separate them into categories.
The following step is to prompt some more precise description (e.g. "golem with stone, lava, steel, fire")

Here's a first set of 16 golems that look consistent.
Because that initial set of lava golems was a bit simplistic, I used #img2img and an improved prompt to slightly increase the level of details (e.g. "3D rendering, trending on Artstation, etc.)

Here's the result:
And now, we can keep the same prompt and introduce many other variations while keeping the overall shape, posture, and level of detail.

Here are the ice golems (like the ones in Clash of Clans)
The forest golems! My favorites 🌲🌳
The sand golems 🏜️
And... the golden golem (directly inspired by the golden golem in Minecraft, via #img2img)
Now it's also possible to use the same finetune, and generate pictures that could be used elsewhere than in the game (ads, splash screens, etc).

Just add "Greg Rutkowski" in the prompt and start seing some cinematic composition, dramatic lighting, etc.
Some other tests I made...
As always, feel free to add any questions, feeback, remarks (and don't forget to like/follow/RT if you find this content interesting. I really appreciate it!)

Tomorrow, I'll keep sharing other explorations with #StableDiffusion 🚀🚀
(11/06 update - here's another run to create more characters, this time with "Space Marines" heavy infantry)

Link here >
Just posted another exploration around dwarves, and they turned out great 👀

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Emm

Emm Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @emmanuel_2m

Nov 7
I've done a first pass on the dwarves, and they're fun.

This proves again that #AI / #StableDiffusion is a fantastic tool for designing and creating #game assets... when adequately fine-tuned.

Here's some of the exploration, so far - 🧵 Image
The model was trained on just 11 pictures (!), with only 1500 training steps, which tuned out to be quick (20 min).

As before, the first step is to "explore“ the model with a few generic prompts. The goal is to find the modifiers that will keep a consistent style going forward. Image
Once the "stable modifiers" are found, it's time to select some of the best output and remove the background when needed.

"A dwarf, detailed, trending on Artstation, Clash of Clans"👇 ImageImage
Read 16 tweets
Nov 6
Working on a set of dwarves now, and this one will be killer.

Stay (fine)tuned.

#StableDiffusion #AI #Gaming Image
Huh ok. Maybe not. Let's change the prompt a little bit, I guess. Image
Me likey Image
Read 4 tweets
Nov 6
Sharing additional thoughts on #StableDiffusion to create #gaming content & #game assets 🧵

My last exploration was on golems; this one is with "Space Marines-like" heavy infantry.

This was a fun creation with lots of learnings 👨‍💻. Feel free to like/RT if you find it useful 🚀 Image
1/ First (as mentioned before - ) > curate a training dataset (such as pictures of figurines) to feed a #Dreambooth finetune.

Once the model is ready, compare different generic prompts (e.g. "low-poly," "3D rendering“, "ultra-detailed," "pixel art," etc.) ImageImageImageImage
2/ Once a prompt looks good, keep the modifiers (in this case: "3D rendering, highly detailed, trending on Artstation").

And start iterating around variations, such as colors (or pose). Don't over-engineer it, to keep the consistency. You should get this: ImageImageImageImage
Read 15 tweets
Nov 4
People loved the "treasure chests" #AI experiment I posted yesterday! However, the chests were all closed 🤨.

So I quickly ran a second training on a different dataset, and this time, gold and diamonds are overflowing from the open chests! 🪙🤑💰

I also used #img2img to instantly generate dozens of variants, "inspired“ by a single original photograph.

This provides consistent assets (similar shape, size, or materials) with some slight variations. It's up to the artist/user to select which one looks best.
Same thing here, using #img2img - however, I prompted "steel chest" instead of "wooden chest"

While it's not 100% perfect, there's still more steel in these chests than in the previous ones.

Also, some of the assets are disjoint or show anomalies. Some fine-tuning is necessary
Read 4 tweets
Nov 3
#Dreambooth will change how 2D game assets are being designed or generated.

Today's exploration: treasure chests 💎💰.

I trained Stable Diffusion with some low-poly treasure chests (23 images). 1h later, here's what's possible (🧵): ImageImageImageImage
At first, I randomly generated a set of 64 items, without any specific prompt engineering ("a treasure chest"). Image
Here's a close-up view: Image
Read 11 tweets
Nov 3
Tonight's dreamboothing is about grenades 💣(!).

I made a #dreambooth finetune from a few Sci-Fi grenade illustrations.

Explosive thread 🧵👇

#AI #StableDiffusion ImageImageImageImage
First, some random grenades, no specific adjectives. Image
But they look great in blue too! ImageImageImageImage
Read 14 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(