leonm99 / stable-diffusion-video2video

Small script for AUTOMATIC1111/stable-diffusion-webui to run video through img2img.

This Repo is now discontinued.

Someone did it better than me so check it out here: https://github.com/Filarius/video2video

---

---

---

---

---

---

---

---

Stable-Diffusion-vid2vid

a simple script addon for https://github.com/AUTOMATIC1111/stable-diffusion-webui takes video as input, runs it through img2img and then outputs a video with the generated frames.

---

Installation

1. Download FFMPEG just put the ffmpeg.exe and the ffprobe.exe in the stable-diffusion-webui folder or install it like shown here. Edit: Make sure you have ffprobe as well with either method mentioned.

2. download vid2vid.py and put it in the scripts folder.

3. start/restart the webui and on the img2img tab you will now have vid2vid in the scripts dropdown.

---

Generally i would advise you to play around with different settings, maybe a set seed, more or less denoising, more or less sampling steps etc, since the output quality can differ based on the input video, resolution, prompt and all that.

stable-diffusion-video2video's Issues

output is only back

running the script on windows, i can see the images being generated in the stable diffusion GUI however the output images being saved to the folder are just back squares, and so the final video is just back.

any ideas?

how use script

AttributeError: 'NoneType' object has no attribute 'convert'
I'm trying to run it but it doesn't give anything
https://github.com/Filarius/stable-diffusion-webui/blob/master/scripts/vid2vid.py
I use this script

Error on loading.

When loading up after adding the script, this error message appears:

Traceback (most recent call last):
File "F:\STABLE_DIFF\stable-diffusion-webui\modules\scripts.py", line 184, in load_scripts
module = script_loading.load_module(scriptfile.path)
File "F:\STABLE_DIFF\stable-diffusion-webui\modules\script_loading.py", line 11, in load_module
compiled = compile(text, path, 'exec')
File "F:\STABLE_DIFF\stable-diffusion-webui\scripts\vid2vid.py", line 72
<title>Stable-Diffusion-Video2Video/vid2vid.py at main · Leonm99/Stable-Diffusion-Video2Video</title>
^
SyntaxError: invalid character '·' (U+00B7)

FileNotFoundError: [WinError 2] The system cannot find the file specified

FileNotFoundError: [WinError 2] The system cannot find the file specified
Time taken: 0.01sTorch active/reserved: 2070/2082 MiB, Sys VRAM: 3328/24576 MiB (13.54%)

The vid2vid is not seeing the file? Its an mp4 on the desktop. Am I doing something wrong here?

Hope it faster!

very useful script, i have used it to make many video
but i find that the time when the vid2vid run a video(such like a 100s video need 24hours) is more longer than put every single flame to process (100305/3600=4.1hours)
maybe the script can make full use of my computer's performance and improve the running speed
thank you! vid2vid is my favorite programs!

for help: how to install in linux(ubuntu22) system

i find it can't work in Linux system (Ubuntu 22)(maybe my install process wrong),although stable diffusion can work

i follow your tip to install [FFMPEG] , put vid2vid.py in script,start sd,but i can't find video2video in img2img

then i try to run vid2vid.py,but error:ImportError: cannot import name 'opts' from partially initialized module 'modules.shared' (most likely due to a circular import) (/home/hr/stable-diffusion-webui/modules/shared.py)

so maybe if you can teach me how to install your py in linux system?
thank you very much!

Error loading script: vid2vid.py

from cmd:
Error loading script: vid2vid.py
Traceback (most recent call last):
File "D:\stable-diffusion-webui\modules\scripts.py", line 195, in load_scripts
module = script_loading.load_module(scriptfile.path)
File "D:\stable-diffusion-webui\modules\script_loading.py", line 11, in load_module
compiled = compile(text, path, 'exec')
File "D:\stable-diffusion-webui\scripts\vid2vid.py", line 64
<title>Stable-Diffusion-Video2Video/vid2vid.py at main · Leonm99/Stable-Diffusion-Video2Video</title>
^
SyntaxError: invalid character '·' (U+00B7)

The big link in the readme is not working

When I try to click that link, I only get 404.

"slash" in the directory name

    # Define a subfolder in our folder to seperate different prompts
    sub_folder = root_path + file_name + "slash"
    
    i think this "slash" is wrong as it creates directory names with the word slash at the end. 
    
    should be without the quotes?

can't find saved files

I looking everywere for the genrated video and the frames but i'm unable to find them
any clue?