Skip to main content

πŸ“Έ Stable Diffusion: Dream Studio

Stable Diffusion is an Open Source image generator. It can be used to generate images with text. To use the model go to Dream Studio, to produce over 200 free images.

Dream Studio is a visual interface, where you can comfortably change settings get quick feedback as to how your prompt works. Dream Studio is a free interface that gives access to Stable Diffusion. The company, Stability AI is also building a Chat GPT competitor.

Below is the eagle image, but this time made with Stable Diffusion.

an environment design with a bald eagle catching a salmon by Agnes Lawrence Pelton.

Process​

Because Stable Diffusion is trained on more realistic imagaes, it offers many options to create highly stylized images.

One way to get more ideas for prompts is to look at the Lexica, the site publishes images and prompts that you can use for ideas.

Content Type​

When you approach creating a piece of artwork, the first thing to think about is what is the type of artwork you want to achieve, is it a Photograph, Drawing, Sketch or 3D render?

Make a decision, here and specify the content type. This can be anime, photorealistic, phtoograph, portrait, halftone, 3d rendering, painting

Description​

A description refers to defining the subject, subject attributes, and the environment/scene. The more descriptive you can be with the use of adjectives the better the output. Use the descriptions to add details about ht enrivonment or scene.

This is where you can have the most effect on the content of the image. If you want to make changes to the description, first shift the order of items.

Style​

This is where you can get really creative. Think of style in three categories; Lighting, Detail and Art.

tip

Stable Diffusion does a great job creating images close to prompt. The better your prompt the better your image.

Lighting affects the scene in a way that light strikes your

accent lighting, backlight, blacklight, blinding light, candlelight, concert lighting, crepuscular rays, direct sunlight, dusk, Edison bulb, electric arc, fire, fluorescent, glowing, glowing radioactively, glow-stick, lava glow, moonlight, natural lighting, neon lamp, nightclub lighting, nuclear waste glow, quantum dot display, spotlight, strobe, sunlight, ultraviolet, dramatic lighting, dark lighting, soft lighting

Detail affects the visual appearance. You can change the general aesthetic to look like a video game with a command like unreal engine, or create a studio quality image.

highly detailed, grainy, realistic, unreal engine, octane render, bokeh, vray, houdini render, quixel megascans, depth of field (or dof), arnold render, 8k uhd, raytracing, cgi, lumen reflections, cgsociety, ultra realistic, volumetric fog, overglaze, analog photo, polaroid, 100mm, film photography, dslr, cinema4d, studio quality

Art This changes the tone of the image. If you have a specific artistic style in mind, use this to affect the look.

Abstract, Medieval art, Renaissance, Baroque, Rococo, Neoclassicism, Romanticism, Impressionism, post-Expression, Cubism, Futurism, Art Deco, Abstract Expressionism, Contemporary, pop art, surrealism, fantasy, Digital art, digital painting, color page, featured on pixiv (for anime/manga), trending on artstation, precise line-art, tarot card, character design, concept art, symmetry, golden ratio, evocative, award winning, shiny, smooth, surreal, divine, celestial, elegant, oil painting, soft, fascinating, fine art

Settings​

Width & Height​

These are the dimensions of the image. Larger images are more expensive to generate than smaller ones. Changing this from

CFG​

The CFG scale, which is set to 7 by default, determines how closely Stable Diffusion follows the input prompt.

Adjusting the scale can improve results for some prompts, but it can also lead to artifacts in the generated images. You can experiment with different settings and see examples of the effects later.

Steps​

Increasing the number of steps in Stable Diffusion tells the model to spend more time generating the final image, which can add more detail. However, using a very high number of steps, like 100-150 or higher, may not always lead to better results and can cause artifacts.

It depends on the prompt, and keep in mind that increasing the number of steps will also increase the cost per image.

Running Stable Diffusion on your own GPU​

If you are a technical person, who wants to run Stable Diffusion on their own GPUs, check out this site.