Create Morph Animations using Frame Interpolation in Stable Diffusion (A1111)

Welcome to a realm of boundless creativity! Join us on a journey where innovation converges with seamless morph transformations. With the AnimateDiff Extension (A1111) as your ally, we invite you to effortlessly navigate the intricate world of morphing, unveiling the techniques to create visually captivating experiences. Let's embark on this exploration together and breathe life into your visuals with the transformative power of AnimateDiff Extension (A1111).

Before we explore the intricacies of crafting captivating morph animations, it's essential to verify that specific prerequisites are met. Here, you'll discover a compilation of the fundamental requirements to initiate our journey into the world of morphing.

Requirement 1: AnimateDiff Extension

The AnimateDiff extension takes the spotlight as our favored tool, streamlining the creation of videos or GIFs effortlessly. If you haven't yet installed the AnimateDiff extension, please consult a dedicated article linked below. It provides step-by-step instructions for downloading and installation:

Fast Video Generation with AnimateDiff & LCM LoRA's (A1111)

Note: To produce a morph animation, we’ll interpolate between frames with Deforum's FILM implementation. To enable this option, it’s essential to have Deforum installed. Navigate to the Extensions tab, choose Available, find deforum in the list of available extensions and install it. Restart A1111 once the extension has been installed.

Requirement 2: Image Sequence

Ensure you have prepared images you wish to morph and placed them within a folder named of your choosing. We've arranged a folder named "Image_Sequence" in the C drive, depicted below, housing 25 images designated for our morphing animation.

Note: Feel free to assign numerical names to the images in the folder to create a structured order for the final morph animation.

Once the prerequisites are in place, proceed by launching the Stable Diffusion UI and navigating to the "img2img" tab.

Img2img Batch Settings

• Access the "Batch" subtab under the "img2img" tab.
• Enter the file address of the image sequence into the "Input directory" text field.
• In our case, the file address for all the images is "C:\Image_Sequence".

Img2img Global Settings

Scroll down and proceed by choosing the designated settings. It's important to mention that we will set the denoising strength to 0 to maintain the integrity of the images in our final morphing animations. When the denoising strength is set to 0, many settings, such as the checkpoint, prompt, negative prompt, sampling method, and sampling steps, won't have any effect. Please keep this in mind, the majority of the settings mentioned here won't affect the outcome since the denoising strength is set to 0. We'll include them for reference purposes:

• Sampling Method: LCM
• Sampling Steps: 8
• Width & Height: 360 x 640 (9:16 Ratio)
• CFG Scale: 2
• Denoising Strenght: 0
• Seed: -1

Let's continue by opening the dropdown settings menu in the AnimateDiff extension and making the required adjustments. The detailed settings are provided below:

• Select the motion module named "v3_sd15_mm.ckpt"
• Set the save format to "MP4" & "GIF"
• Enable the AnimateDiff extension.
• Number of Frames: 25 (Provide the total number of images you have prepared; in our case, this amounts to 25 images).
• Frames per Second (FPS): 24
• Frame Interpolation: FILM
• Interp X: 20 (A higher numerical value will result in the generation of more frames between each image in the sequence).
• For a more thorough understanding of the AnimateDiff extensions, it is advisable to explore the official AnimateDiff GitHub page.

Note: We'll be utilizing the "FILM" option in the Frame Interpolation settings. Ensure that you have installed the "Deforum" Extension to enable this functionality.

Once the settings are appropriately configured, you can click on the "Generate" button. After the rendering process is complete, you'll locate your final morphed animation in MP4 and GIF format in the specified directory: "stable-diffusion-webui > outputs > img2img-images > AnimateDiff > [Correct_Date]".

Let's examine the generated morph animation. Feel free to experiment with various image sequences to achieve different results.

Embark on a journey of limitless creativity with the AnimateDiff Extension (A1111) and delve into the art of seamlessly transforming images for captivating visual experiences. By following the steps outlined in this guide, you can effortlessly master the creation of morph animations, breathing life into your visuals with the transformative power of AnimateDiff.