pytesin / deforumstablediffusionlocal

Local version of Deforum Stable Diffusion, supports txt settings file input and animation features!

Deforum Stable Diffusion Local Version

Local version of Deforum Stable Diffusion V0.4, supports txt settings file input and animation features!

• Stable Diffusion by Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, Björn Ommer and the Stability.ai Team.

• K Diffusion by Katherine Crowson.

• Notebook by deforum

• Local Version by DGSpitzer 大谷的游戏创作小屋

• Special Thanks to VIVY Has A Dream for all the help!

👇Animated Video👇

Made this quick local Windows version mostly based on the Colab code by deforum, which supports very cool turbo mode animation output for Stable Diffusion!

As an artist and Unity game designer, I may not very familiar with Python code, so let me know whether there is any improvement for this project!

It's tested working on Windows 10 with RTX 2080 SUPER and RTX 3090 GPU (it runs somehow much faster on my local 3090 then Colab..), I haven't tested it on Mac though.

Installation

You can use an anaconda environment to host this local project:

conda create --name dsd python=3.8.5 -y
conda activate dsd

And then cd to the cloned folder, run the setup code, and wait for ≈ 5min until it's finished

python setup.py

Manually download 3 Model Files

You need to get the sd-v1-4.ckpt file and put it on the ./models folder first to use this. It can be downloaded from HuggingFace.

Additionally, you should put dpt_large-midas-2f21e586.pt on the ./models folder as well, the download link is here

There should be another extra file AdaBins_nyu.pt which should be downloaded into ./pretrained folder, the download link is here

How to use it?

The running command should looks like this:

python run.py --enable_animation_mode --settings "./runSettings_Template.txt"

After installation you can try out following examples to see if the code is working

• 1. For generate still images:

python run.py --settings "./examples/runSettings_StillImages.txt"

• 2. For animation feature, you need to add --enable_animation_mode to enable animation settings in text file:

python run.py --enable_animation_mode --settings "./examples/runSettings_Animation.txt"

• 3. For mask feature:

python run.py --settings "./examples/runSettings_Mask.txt"

Original Painting on Artstation

The output results will be available at ./output folder.

All the needed variables & prompts for Deforum Stable Diffusion are set in the txt file (You can refer to the Colab page for definition of all the variables), you can have many of settings files for different tasks. There is a template file called runSettings_Template.txt. You can create your own txt settings file as well.

That's it!