How to Remove any Background in Stable Diffusion

Step into the world of image editing excellence with the transformative power of stable diffusion. This guide unlocks the effortless art of background removal, enabling you to achieve flawlessness in every edit. Join us as we explore how this groundbreaking technique can elevate your image enhancement endeavors and bring your creative vision to life.

To facilitate background removal using stable diffusion, it's necessary to acquire and install a dedicated extension. For this you can follow the following steps:

• Open your Stable Diffusion Web UI.
• Navigate to the Extensions tab within Stable Diffusion.
• Go to the Install from URL subsection.
• Paste the following URL: https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg
• Click on the Install button to download the extension

Once you've installed it, head over to the Installed tab, and give a click on Apply and restart UI. This will ensure the successful installation of the extension. After you've successfully installed it, you can spot the downloaded extension in the "\stable-diffusion-webui\extensions" folder:

Before diving into background removal, let's first craft an image to work on. We'll accomplish this using our own prompt generator extension to generate a portrait of a woman. To learn more and see how to install this extension you can have a look here:

Dive into Creativity: Stable Diffusion New Prompt Extension

Certainly, feel welcome to devise your own prompt. However, I believe this extension could offer you swift idea inspiration.

The image provided below has been created through the use of the extension in the txt2img tab:

• Positive Prompt: ((Captivating)), ((Exquisite)), ((Masterpiece)), ((Impressive)), ((Intricate)), ((Mind-blowing)), women, Mexican woman, Mexican, Mexicana Woman, raw photo, Unedited photo, Original photo, Unprocessed photo, Atmospheric illumination, Light scattering, Hazy lighting, Wide aperture, Zoom lens, Shallow depth of field, beach background
• Negative Prompt: (worst quality:1.2), (low quality:1.2), (lowres:1.1), (monochrome:1.1), (greyscale), multiple views, comic, sketch, (((bad anatomy))), (((deformed))), (((disfigured))), watermark, multiple_views, mutation hands, mutation fingers, extra fingers, missing fingers, watermark
• Sampling Steps: 30
• Sampler: DDIM
• CFG scale: 7
• Size: 704x392 (16:9)
• Model: cyberrealistic

Now, let's witness the remove background extension in action. We'll delve into the process of removing the background from the image we just generated.

Having recently created an image through the txt2img tab, you'll notice a set of buttons located beneath the image. Our next step involves clicking the Send to extras button, which will ensure the image is properly placed for the eventual background removal process.

After you've clicked the Send to extras button and the extension has been installed successfully, you'll notice a Remove background section located at the lower left corner:

Now there are several remove background methods to choose from:

• u2net
• u2netp
• u2net_human_seg
• u2net_cloth_seg
• silueta
• isnet-general-use
• isnet-anime

I've observed that the u2net background removal method exhibits the highest consistency across various image types. Therefore, let's opt for that. Additionally, remember that there's a Resize option; I'll set this to 1 to maintain the image's original size. Here are the settings I'll be using before proceeding to generate and remove the background:

Now, go ahead and click the Generate button to witness the enchantment of the background removal extension in action:

The newly generated image will have a transparent background and will be saved in the outputs folder

Ouputs folder

All the images from which the background has been removed will be stored in the "outputs\extras-images" folder:

If you already possess a previously generated image, you can immediately navigate to the Extras section located within Stable Diffusion. Within this section, you have the option to either Drag and Drop or Upload an image onto the image canvas:

Ensure that you choose the u2net technique for background removal and select a Resize value of 1 if you wish to maintain the original size of the initial image without any changes. Go ahead and hit that Generate button, and watch as the background disappears like it's pulling a disappearing act that would make even a magician jealous!

You also have the capability to eliminate backgrounds from numerous images simultaneously. Navigate to the Extras section and access the Batch from Directory subtab. Here, you can define the Input directory, which designates the pathway to the images you intend to have their backgrounds removed.

Should you prefer to maintain a streamlined approach, leaving the Output Directory field unfilled will result in the storage of background-removed images within the default output folder ("outputs\extras-images" folder). Below an example of how it should look when you fill in the Input Directory:

After choosing the u2net background removal method, clicking the Generate button will trigger the removal of backgrounds from all images within your Input Directory.

As we arrive at the conclusion, we've truly embraced the art of background removal, harnessed the impressive capabilities of "u2net" and unveiled the secret to efficiently whisking away a bunch of backgrounds all at the same time—because who said editing can't be a bit like magic, where the more you make vanish, the merrier the result!