Emm Profile picture
Nov 6 15 tweets 10 min read
Sharing additional thoughts on #StableDiffusion to create #gaming content & #game assets 🧵

My last exploration was on golems; this one is with "Space Marines-like" heavy infantry.

This was a fun creation with lots of learnings 👨‍💻. Feel free to like/RT if you find it useful 🚀
1/ First (as mentioned before - ) > curate a training dataset (such as pictures of figurines) to feed a #Dreambooth finetune.

Once the model is ready, compare different generic prompts (e.g. "low-poly," "3D rendering“, "ultra-detailed," "pixel art," etc.)
2/ Once a prompt looks good, keep the modifiers (in this case: "3D rendering, highly detailed, trending on Artstation").

And start iterating around variations, such as colors (or pose). Don't over-engineer it, to keep the consistency. You should get this:
3/ A broader view of the red, blue, gold and green battalions :)
4/ Now you can get creative and add more colors (I just prompted "rainbow space marine, colorful" in the set below)
5/ It's not just about colors. The look or style of the models can be altered with other modifiers.

Such as "a dark Halloween zombie space marine". Now all the models have been zombified 🧟‍♂️💀🧟‍♀️. They could also melt or glow in the dark.
6/ I randomly found that one of the soldiers looked like a baby, so I prompted "a cute baby space marine" and made everyone look younger, in seconds:
7/ Because the shape/silhouette of the "baby space marine" was interesting, I kept it and used #img2img to generate pixel art variations, in different colors:
8/ img2img is very powerful when combined with Dreambooth. I went back to my previous tweet (link - ), and selected a "cyclopean golem", to resembling space soldiers, like this
9/ Same story below, but with a different (white) golem.
Also, I added "no gun" as a negative prompt. None of the soldiers has the machine gun they held before.
10/ As a bonus, you can have more fun with your finetune and generate other storytelling visuals.

For example, "urban warfare background" or "a group of space marines dancing in a night club"
11/ Or even find the image of a tank and then run #img2img to generate tank-like space robots/creatures 🪖
12/ I'm hoping this somehow demonstrates the power of having your own "finetune(s)"

Training lets you iterate around a specific concept, style, or object. You get consistent results, faster, and possibly using your training data. No more endless random prompting. What else? :)
end/ I've had some great discussions about it with the gaming community (artists or studios) over the past few days. If you have questions or would like to have a chat, please comment or DM me; happy to connect with innovative game creators.

#AI #GenAI #Gaming #StableDiffusion
(11/06 update) - I've done a similar pass on a dwarf character set. Check it out.

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Emm

Emm Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @emmanuel_2m

Nov 7
I've done a first pass on the dwarves, and they're fun.

This proves again that #AI / #StableDiffusion is a fantastic tool for designing and creating #game assets... when adequately fine-tuned.

Here's some of the exploration, so far - 🧵 Image
The model was trained on just 11 pictures (!), with only 1500 training steps, which tuned out to be quick (20 min).

As before, the first step is to "explore“ the model with a few generic prompts. The goal is to find the modifiers that will keep a consistent style going forward. Image
Once the "stable modifiers" are found, it's time to select some of the best output and remove the background when needed.

"A dwarf, detailed, trending on Artstation, Clash of Clans"👇 ImageImage
Read 16 tweets
Nov 6
Working on a set of dwarves now, and this one will be killer.

Stay (fine)tuned.

#StableDiffusion #AI #Gaming
Huh ok. Maybe not. Let's change the prompt a little bit, I guess.
Me likey
Read 4 tweets
Nov 5
Let’s keep using #StableDiffusion to design or create #game assets, quickly and consistently.

In 15 min, generated an army of golems with similar shapes and sizes, but various “materials” (lava, rock, water, ice, forest, sand, gold…).

No in-painting is needed. Thread 🧵
Step 1 (as in my previous examples with chests - ), I made a Dreambooth finetune w. just 11 pics.

As soon as the model was trained, the first step was randomly generating a large set of images w. a simple prompt ("golem, detailed, realistic, 3D rendering")
Each golem can be extracted by removing the images' backgrounds (reco: @photoroom_app).

Some of the designs are amazing. However, the golems all look very similar to each other. Let's separate them into categories.
Read 14 tweets
Nov 4
People loved the "treasure chests" #AI experiment I posted yesterday! However, the chests were all closed 🤨.

So I quickly ran a second training on a different dataset, and this time, gold and diamonds are overflowing from the open chests! 🪙🤑💰

I also used #img2img to instantly generate dozens of variants, "inspired“ by a single original photograph.

This provides consistent assets (similar shape, size, or materials) with some slight variations. It's up to the artist/user to select which one looks best.
Same thing here, using #img2img - however, I prompted "steel chest" instead of "wooden chest"

While it's not 100% perfect, there's still more steel in these chests than in the previous ones.

Also, some of the assets are disjoint or show anomalies. Some fine-tuning is necessary
Read 4 tweets
Nov 3
#Dreambooth will change how 2D game assets are being designed or generated.

Today's exploration: treasure chests 💎💰.

I trained Stable Diffusion with some low-poly treasure chests (23 images). 1h later, here's what's possible (🧵): ImageImageImageImage
At first, I randomly generated a set of 64 items, without any specific prompt engineering ("a treasure chest"). Image
Here's a close-up view: Image
Read 11 tweets
Nov 3
Tonight's dreamboothing is about grenades 💣(!).

I made a #dreambooth finetune from a few Sci-Fi grenade illustrations.

Explosive thread 🧵👇

#AI #StableDiffusion ImageImageImageImage
First, some random grenades, no specific adjectives. Image
But they look great in blue too! ImageImageImageImage
Read 14 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(