differential-diffusion's People
Forkers
kustomzone etiennedossantos camenduru dive-into-papers jags111 fingerx sorokinvld zhaopufeng sts0mrg0 jmaigc alpertunga-bile anthonyyuan martyyz2112 finninmunich azure-dragon-aidifferential-diffusion's Issues
For SDXL turbo?
Amazing work! I've tried using several SDXL text2img models for img2img or inpaint tasks and have had good results. However, when I attempted to use the SDXL turbo model for these tasks, it failed. The generated content had nothing to do with my original image and it seemed like the model was still trying to perform the text2img task. I'm curious about what's going on. Do you have any suggestions?
Can Differential Diffusion help improve the inpainting model?
Thank you for your work and open-source code! I would like to ask a question, Can Differential Diffusion help improve the inpainting model? e.g runwayml/stable-diffusion-inpainting
question about the code
hello,thanks for your share,i have a question about the detail, what is the difference between differential-diffusion and diffusers inpainting pipline?just the mask type, change from int to float?
How to generate the map image effectively? Are there any tools ?
Can you make it into a WEBUI plug-in or a COMFYUI node?
It becomes very convenient if you can use it,THX~
Is it possible to clone the project and use it alone?
Is it possible to clone the project and use it alone?
Any plan to support stable cascade?
First, thanks for your team's hard work. I am wonder that will your team support stable cascade in future? or others better diffuse model, such as playground v2.5 and stable diffusion 3.
Optimize differential diffusion
Optimize differential diffusion for most consumer GPUs
My GPU: NVIDIA GeForce GTX 1060 6GB
slow ass steps: 15/40 [14:33<24:19, 58.37s/it]
SDXL Lightning Support
It would be great to include out-of-the-box support for SDXL-Lightning
Demos of SDXL-Lightning available here:
Can this algorithm used to fuse two images?
I used differential diffusion to do some experiment, and I turned out wonderful! But I am wondering if differential diffusion is able to fuse two images. I have a background image containing a object and background, a foreground image containing an object with transparent background and a mask of foreground. How can I take use of diffienertial diffusion to do this task? I noticed there are two parameters named original_image and image, I used them to do some testing and it didn't work out. Did I do it in a wrong way? Whether is diffierential diffusion able to accomplish this task?
Is there workflow with comfyui as an example, or is it a node?
couldn't find any valid examples in these two links, nor did see clear instructions for using comfyUI for your project
comfyanonymous/ComfyUI#2876
sd 1.5 support
can use this with sd 1.5?
What is the injected term in the $z_{mix}$ formulation?
From reviewing the paper, we wonder if the mask may have been reversed by mistake.
In the denoising loop,
This seems consistent with the fact that the mask is getting bigger and bigger (
However in the paper (Figure 3) it states the opposite "Top:
Can you confirm or dismiss whether there is an error in the paper? Or are we misunderstanding by claiming that the injected part is
Thanks so much in advance for your help and clarification.
how to use this with inpainting model?
is this working with1.5 inpainting or sdxl inpainting?
error CUDNN
ip adapter and controlnet pipelines
This has a lot of potential if used together with ip adapter and controlnet
However, the current pipeline is very old and does not support the new features.
can you please update and add pipelines for ip adapter and controlnet
AttributeError: 'StableDiffusionXLDiffImg2ImgPipeline' object has no attribute '_execution_device'
When running the script for SDXL, I get the following error:
The config attributes {'force_upcast': True} were passed to AutoencoderKL, but are not expected and will be ignored. Please verify your config.json configuration file.
Traceback (most recent call last):
File "G:\ComfyUI_windows_portable\differential-diffusion\SDXL\run.py", line 49, in
edited_images = base(prompt=prompt, original_image=image, image=image, strength=1, guidance_scale=17.5,
File "G:\ComfyUI_windows_portable\differential-diffusion\venv\lib\site-packages\torch\utils_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "G:\ComfyUI_windows_portable\differential-diffusion\SDXL\diff_pipe.py", line 853, in call
device = self._execution_device
File "G:\ComfyUI_windows_portable\differential-diffusion\venv\lib\site-packages\diffusers\configuration_utils.py", line 137, in getattr
raise AttributeError(f"'{type(self).name}' object has no attribute '{name}'")
AttributeError: 'StableDiffusionXLDiffImg2ImgPipeline' object has no attribute '_execution_device'
Using sdxl base model only to generate results
very nice - thank you
added implementation to sdnext via commit vladmandic/automatic@0239435
do you have plans to add sd15 pipeline?
Are you planning to release the code?
Can this work on video generators like Stable Video Diffusion?
Forge adaptation?
Hi, sorry to disturb..
Do you plan to make it available for Forge WebUI?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.