XiQiao 西乔 Profile picture
Founder of DreamLens | Author of book «Illustrated History of Programming»

Nov 27, 2022, 9 tweets

Understand AI community's frustration with first impressions of #stablediffusion2, I was too. But after experimented new prompt engineering with various styles by SD2+Diffusers runned in DFserver, I discovered advantages and uniqueness of SD2 @EMostaque @RiversHaveWings 1/n

The thread all generated by pure prompt, no init image, no editing. View full prompt in alt of each images.

Cons of SD2: in addition to higher resolutions, significant improvements in image quality and detail richness, especially in handling light sources, shadow, reflection 2/n

Fineness of texture details of surface from various materials is awesome. I tried sand, snow field, ocean wave foam, liquid metals. 3/n

For prompt enginering of SD2, either too short or too long prompt doesn't work well. I found SD2 can offer higher controllability with more precision than 1.5 So highly targeted prompt design is possible, not stacking of keywords or artist refer as blindfold alchemy anymore. 4/n

Experiment with Color Palette, accurate and artistic outcomes.
blue & red | Yellow & blue | black & white | teal & burnt sienna
The anatomical coherence of human face is good, I picked below 4 from less than 20 generations.

#stabledifffusion2 5/n

Experiment with painting medium, oil vs watercolor.
The expressiveness of brush strokes and edge rendering, also the simulation of canvas surface for different medium is stunning.

the environmental reflections on the surface of Glass and copperware 😊

Prompt & seed in ALT

6/n

Another experiment with fine art painting medium, oil vs watercolor for landscape, in style of Andreas Rocha (although he is a digital painting master)

Prompt & seed in ALT

7/n

Heard that celebrities' face feature was removed from 2.0 dataset, but I think can be easily made up by customed finetune. As foundational open model, It's right to give more consideration to ethical controversies. I tried printmaking portraits, surely can guess who they are. 8/n

I organized this thread into a more complete article, which contains more tips and experiment results for sharing, plus progressive optimization process of 2 sets of prompts. 9/n

medium.com/@catmus2048/no…

Share this Scrolly Tale with your friends.

A Scrolly Tale is a new way to read Twitter threads with a more visually immersive experience.
Discover more beautiful Scrolly Tales like this.

Keep scrolling