Emm Profile picture
Nov 6, 2022 β€’ 15 tweets β€’ 10 min read β€’ Read on X
Sharing additional thoughts on #StableDiffusion to create #gaming content & #game assets 🧡

My last exploration was on golems; this one is with "Space Marines-like" heavy infantry.

This was a fun creation with lots of learnings πŸ‘¨β€πŸ’». Feel free to like/RT if you find it useful πŸš€
1/ First (as mentioned before - ) > curate a training dataset (such as pictures of figurines) to feed a #Dreambooth finetune.

Once the model is ready, compare different generic prompts (e.g. "low-poly," "3D renderingβ€œ, "ultra-detailed," "pixel art," etc.)
2/ Once a prompt looks good, keep the modifiers (in this case: "3D rendering, highly detailed, trending on Artstation").

And start iterating around variations, such as colors (or pose). Don't over-engineer it, to keep the consistency. You should get this:
3/ A broader view of the red, blue, gold and green battalions :)
4/ Now you can get creative and add more colors (I just prompted "rainbow space marine, colorful" in the set below)
5/ It's not just about colors. The look or style of the models can be altered with other modifiers.

Such as "a dark Halloween zombie space marine". Now all the models have been zombified πŸ§Ÿβ€β™‚οΈπŸ’€πŸ§Ÿβ€β™€οΈ. They could also melt or glow in the dark.
6/ I randomly found that one of the soldiers looked like a baby, so I prompted "a cute baby space marine" and made everyone look younger, in seconds:
7/ Because the shape/silhouette of the "baby space marine" was interesting, I kept it and used #img2img to generate pixel art variations, in different colors:
8/ img2img is very powerful when combined with Dreambooth. I went back to my previous tweet (link - ), and selected a "cyclopean golem", to resembling space soldiers, like this
9/ Same story below, but with a different (white) golem.
Also, I added "no gun" as a negative prompt. None of the soldiers has the machine gun they held before.
10/ As a bonus, you can have more fun with your finetune and generate other storytelling visuals.

For example, "urban warfare background" or "a group of space marines dancing in a night club"
11/ Or even find the image of a tank and then run #img2img to generate tank-like space robots/creatures πŸͺ–
12/ I'm hoping this somehow demonstrates the power of having your own "finetune(s)"

Training lets you iterate around a specific concept, style, or object. You get consistent results, faster, and possibly using your training data. No more endless random prompting. What else? :)
end/ I've had some great discussions about it with the gaming community (artists or studios) over the past few days. If you have questions or would like to have a chat, please comment or DM me; happy to connect with innovative game creators.

#AI #GenAI #Gaming #StableDiffusion
(11/06 update) - I've done a similar pass on a dwarf character set. Check it out.

β€’ β€’ β€’

Missing some Tweet in this thread? You can try to force a refresh
γ€€

Keep Current with Emm

Emm Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @emmanuel_2m

Jun 2
Continuing from my last threads, and sharing how to create character turnarounds with the highest consistency ✨ for:

- style βœ…
- pose βœ…
- character βœ…

... using the #Scenario toolset to maintain all key details.

Follow the steps below πŸ‘‡ - no pencil needed ✏️. Let's dive in!
⚠️ First: it's not a 'one-click-and-done' process but instead a multi-step workflow, to be tailored to your creative goals.

Second: it ensures full creative control and deliberate designs from start to finish. Randomness or chance are sidelined.

To illustrate it, I revisited 2 characters I designed five months ago: the "girl with pink hair" (), and the "sorceress with a blue hat" ()

The other 2 turnarounds ("zombie" & "ninja") had some attention yesterday with 2M+ views ()

Image
Here are the key steps to creating stunning turnaround, using #Scenario ()

1/ Train or pick a character model (A).

2/ Optionaly>, pick a style model (B). Use it to create training images for (A), or you can merge both (A + B = C) for example.

3/ Utilize the custom model (A or C) to generate consistent characters. Then select a reference image to produce initial character turnarounds in your desired poses.

4/ Refine these initial outputs using Sketching and image2image.

5/ Select the best result and refine details in the Canvas for maximum consistency.

6/ Finally, upscale your final image (up to 8K resolution.)

Here are more details πŸ‘‡πŸ‘‡app.scenario.comImage
Read 13 tweets
Apr 20
Designing ultra-consistent and virtually unlimited game characters in minutes with #Scenario.

Keeping it super short πŸ˜… β€” because it's actually super fastπŸ€—.
Image
Image
1/ Select your model.

You can choose from our selection of 170+ game art models on

Or, train your own to better fit your style.

I trained this model with only 12 images, originally generated using @artificialguybr's '3D Render Style' πŸ™

Note: I'm intentionally training with consistent poses.

Spoiler alert 🚨: Next week, you'll be able to #upload your own models to Scenario! 🫣app.scenario.comImage
2/ Create consistent prompts.

It's best to maintain a similar structure between your prompts and captions.

I asked ChatGPT to use a format based on race, weapon, and outfit, with 50 initial prompts belowπŸ‘‡πŸ‘‡.

Adjust as needed.Image
Read 10 tweets
Mar 12
Just tested Midjourney's "Character Consistency" feature (-- cref). It's promising!

I don't think it beats a good #LoRA (yet). Especially when paired w. IP Adapter.

Below are some quick tests I ran on Scenario (high-def pics below + more updates comingπŸ‘‡πŸ‘‡)

What do you think? β€œA blue-skinned man with large yellow eyes, bald, wearing a BJJ gi with a black belt, raising his arm in victory on a podium, pointy ears, wrinkles, highly detailed, 35 mm, award-winning photography, bokeh, studio quality”
Left: input image
Right: MJ (--cw 0)
Image
Image
Left: input image
Right: MJ (--cw 50)
Image
Image
Read 5 tweets
Feb 9
@ClaireSilver12 - (I hope you don't mind me RT this for a broader reach and to share it with more users.)

Here's an advanced use case for the IP Adapter. You can adjust or remove the steps depending on the desired output/goal. Bear with me; it's actually quite straightforward.

1 - Train a LoRA on a specific subject (e.g., character).
2 - Blend the LoRA to perfectly capture the style (e.g., comic, cartoon, oil painting, 3D...).
3 - Run inference on that "blended" model.
4 - Select an image that stands out and use it as a reference with the IP Adapter.
5 - Modify the prompt to create variations of the subject.

Let's get started πŸ‘‡πŸ‘‡Image
1/ The first step is to train one (or more LoRA) models on a specific subject (e.g. character or object), or also a style.

The process is straightforward. I'll use the example of the "girl with pink hair" (😊🫠) that I shared before (12 training images)

Since the images were photographs, I'm creating a "mix" by adding one or two more LoRAs to the composition.

Additional LoRAs can introduce a specific style, moving away from the original photorealistic style.

You can choose platform LoRAs curated by @araminta_k and the Scenario team - See Image
Image
Read 10 tweets
Feb 1
"3D Outfit Transformation with AI"

I trained a LoRA model on , using a 3D model of an old armor, available on Sketchfab (CC0 license).

Now, I can apply it to seamlessly "dress upβ€œ my characters. Detailed process in the following X tweets πŸ§΅πŸ‘‡ Scenario.com

Image
Image
I found this nice 3D model of an ancient medieval outfit, crafted by @Blueprint_Games and shared on @Sketchfab under the CC BY 4.0 DEED license.

You can explore it here: . sketchfab.com/3d-models/old-…
Training the model is straightforward.

Simply select "New Model - Train" on . I use 9 images of the model, showcasing various angles and zoom levels, accompanied by concise captions (details below).

I selected the "Character" (= subject) preset. app.scenario.com
Image
Read 7 tweets
Jan 18
This could be the best model I've ever created for generating isometric buildings, on Scenario.

Output consistently match the style I wanted, and the model responds perfectly to (short) prompts, without any reference images needed.

It's a LoRA composition. More below.
Process: it's pretty simple.

I created a LoRA composition from 4⃣ distinct LoRA.

(i) - My own "Fantasy Buildings" LoRA
(ii) - Three LoRAs available on #Scenario: "Isometric Storybook", "Stylized Fantasy Iconic Imagery" and "Belgian School Comics".

The influence of each LoRA is below.Image
My prompt structure was dead simple... less than 10 words!

(type of building/scene), solid color background, highly detailed, centered. Image
Read 22 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(