modelsurge / sd-webui-comfyui Goto Github PK
View Code? Open in Web Editor NEWAn extension to integrate ComfyUI workflows into the Webui's pipeline
License: MIT License
An extension to integrate ComfyUI workflows into the Webui's pipeline
License: MIT License
For now it is not possible to patch the webui model with lora and control clip skip, among other operations. Any action that requires the state dict is not applied at the moment.
Some tinkering needs to go into this to make it work but it should be possible to achieve.
I installed: stable-diffusion-webui
added this extension.
OS: Linux mint 21
python: 3.10.6
torch: 1.13.1+cu117
ComfyUI forks on its own.
SD webui works on its own.
but using ComfyUI inside SD webui after pressing "Queue prompt" gives me this error:
Exception in thread Thread-4 (prompt_worker):
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 953, in run
self._target(*self._args, **self._kwargs)
File "/media/entity/HDD/AI/ComfyUI/main.py", line 43, in prompt_worker
e.execute(item[-2], item[-1])
File "/media/entity/HDD/AI/ComfyUI/execution.py", line 200, in execute
torch.cuda.ipc_collect()
File "/media/entity/HDD/AI/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/cuda/__init__.py", line 578, in ipc_collect
_lazy_init()
File "/media/entity/HDD/AI/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/cuda/__init__.py", line 217, in _lazy_init
raise RuntimeError(
RuntimeError: Cannot re-initialize CUDA in forked subprocess. To use CUDA with multiprocessing, you must use the 'spawn' start method
please help, I'm a noob
to vladmandic fork of auto1111, its equally as popular as the main fork if not exceedingly at this point.
currently the tab sizing is incorrect and covers the vladmandic tabs when you switch to comfy.
Right now, we can only update ComfyUI by going to the installation and git-pulling, which is annoying. This should be a "single button click" feature.
I'm thinking of adding it to the settings tab.
Not sure where else would be more appropriate.
One really cool thing that could be done would be to create an alwayson script "redirect output to ComfyUI" or something like that, and then use a node "Webui Output" for using that output image. If the script is enabled, it redirects the output to ComfyUI, and starts the workflow. We could also add "Webui Save Img2Img", "Webui Save Txt2Img" and "Webui Save Extras" for outputing images in the same place as A1111 would. We could also append the workflow.json data to the image metadata to enable complex and reproduceable A1111/ComfyUi workflows.
Add tests for:
Loading an image generated with the extension should also restore the state of all used comfyui workflows.
Also, drag-and-dropping an image into a workflow should load the appropriate workflow from the metadata, but only for that workflow.
*** Error loading script: comfyui.py
Traceback (most recent call last):
File "/root/ssd1/jhz/stable-diffusion-webui/modules/scripts.py", line 319, in load_scripts
script_module = script_loading.load_module(scriptfile.path)
File "/root/ssd1/jhz/stable-diffusion-webui/modules/script_loading.py", line 10, in load_module
module_spec.loader.exec_module(module)
File "", line 850, in exec_module
File "", line 228, in _call_with_frames_removed
File "/root/ssd1/jhz/stable-diffusion-webui/extensions/sd-webui-comfyui/scripts/comfyui.py", line 3, in
from lib_comfyui import comfyui_context, global_state, platform_utils, external_code, default_workflow_types, comfyui_process
File "/root/ssd1/jhz/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/global_state.py", line 53, in
sys.modules[name] = GlobalState(globals())
File "/root/ssd1/jhz/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/global_state.py", line 12, in init
setattr(self, k, v)
File "/root/ssd1/jhz/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/global_state.py", line 29, in setattr
GlobalState.setattr(item, value)
File "/root/ssd1/jhz/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/ipc.py", line 12, in wrapper
return function(*args, **kwargs)
TypeError: 'staticmethod' object is not callable
My head is AT 0faa28e
Thanks for your help.
Sometimes firefox does not render the <object>
properly:
Additionally, firefox does not support the css selector :has()
, which is used at the moment to hide the gradio footer when the ComfyUI tab is selected.
Hey, I am unsure if this is similar to the domain issue from about 2 weeks back but I am having an issue when attempting to load comfyui through the webui remotely. This is within the vlad/SD.Next, windows 11. All installed fine no error outputs in the terminal and it accepts the 0.0.0.0:8189 input for the cli webui argument to point at the ComfyUi.
Terminal output:
PS D:\AI Stuff\Vlad1111> .\webui.bat --listen --comfyui-listen
Using VENV: D:\AI Stuff\Vlad1111\venv
10:25:03-696502 INFO Starting SD.Next
10:25:03-702502 INFO Python 3.10.6 on Windows
10:25:03-726502 INFO Version: 9d17cf4c Mon Aug 7 19:50:39 2023 +0300
10:25:04-188180 INFO Latest published version: ff2d846667f62bd83a49b85e44e137e97c64727b 2023-08-07T21:51:23Z
10:25:04-191699 INFO nVidia CUDA toolkit detected
10:25:04-269290 WARNING Modified files: ['modules/lora', 'modules/lycoris']
10:25:04-294546 INFO Disabled extensions: ['sd-webui-agent-scheduler']
10:25:04-295547 INFO Enabled extensions-builtin: ['a1111-sd-webui-lycoris', 'clip-interrogator-ext', 'LDSR', 'Lora',
'multidiffusion-upscaler-for-automatic1111', 'ScuNET', 'sd-dynamic-thresholding', 'sd-extension-system-info',
'sd-webui-controlnet', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg', 'SwinIR']
10:25:04-297546 INFO Enabled extensions: ['a1111-sd-webui-tagcomplete', 'novelai-2-local-prompt', 'OneButtonPrompt', 'openpose-editor',
'sd-canvas-editor', 'sd-webui-3d-open-pose-editor', 'sd-webui-comfyui', 'sd-webui-infinite-image-browsing',
'sd-webui-inpaint-anything', 'sd-webui-regional-prompter', 'stable-diffusion-webui-aesthetic-image-scorer',
'Stable-Diffusion-Webui-Civitai-Helper']
10:25:04-301064 INFO Verifying requirements
10:25:04-308064 INFO Verifying packages
10:25:04-313571 INFO Verifying repositories
10:25:08-099765 INFO Verifying submodules
10:25:23-322068 INFO Extensions enabled: ['a1111-sd-webui-lycoris', 'clip-interrogator-ext', 'LDSR', 'Lora',
'multidiffusion-upscaler-for-automatic1111', 'ScuNET', 'sd-dynamic-thresholding', 'sd-extension-system-info',
'sd-webui-controlnet', 'stable-diffusion-webui-images-browser', 'stable-diffusion-webui-rembg', 'SwinIR',
'a1111-sd-webui-tagcomplete', 'novelai-2-local-prompt', 'OneButtonPrompt', 'openpose-editor', 'sd-canvas-editor',
'sd-webui-3d-open-pose-editor', 'sd-webui-comfyui', 'sd-webui-infinite-image-browsing', 'sd-webui-inpaint-anything',
'sd-webui-regional-prompter', 'stable-diffusion-webui-aesthetic-image-scorer',
'Stable-Diffusion-Webui-Civitai-Helper']
10:25:23-323068 INFO Verifying packages
10:25:23-327068 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions-builtin
10:25:23-328068 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions
10:25:23-335521 INFO Server arguments: ['--listen', '--comfyui-listen']
No module 'xformers'. Proceeding without it.
10:25:27-056966 INFO Pipeline: Backend.ORIGINAL
10:25:27-419001 INFO Libraries loaded
10:25:27-420002 INFO Using data path: D:\AI Stuff\Vlad1111
10:25:27-423508 INFO Available VAEs: D:\AI Stuff\Model Storage\models\VAE 5
10:25:27-462423 INFO Available models: D:\AI Stuff\Model Storage\models\Stable-diffusion 98
10:25:28-522759 INFO ControlNet v1.1.233
ControlNet v1.1.233
ControlNet preprocessor location: D:\AI Stuff\Vlad1111\extensions-builtin\sd-webui-controlnet\annotator\downloads
10:25:28-601745 INFO ControlNet v1.1.233
ControlNet v1.1.233
Tag Autocomplete: Could not locate model-keyword extension, LORA/LYCO trigger word completion will be unavailable.
[sd-webui-comfyui] restoring graceful SIGINT handler for the webui process
Civitai Helper: Get Custom Model Folder
Civitai Helper: Load setting from: D:\AI Stuff\Vlad1111\extensions\Stable-Diffusion-Webui-Civitai-Helper\setting.json
Civitai Helper: No setting file, use default
10:25:34-064803 INFO Loading UI theme: name=gradio/default style=Dark
10:25:34-103894 INFO Extra network created thumbnails: checkpoints 0
Running on local URL: http://0.0.0.0:7860
10:25:40-360323 INFO Local URL: http://localhost:7860/
10:25:40-361323 INFO Initializing middleware
[sd-webui-comfyui] started callback listeners for process webui
Loading weights: D:\AI Stuff\Model Storage\models\Stable-diffusion\bb95FurryMix_v110.safetensors ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/4.3 GB -:--:--10:25:41-246073 INFO Setting Torch parameters: dtype=torch.float16 vae=torch.float16 unet=torch.float16
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
[ComfyUI] [sd-webui-comfyui] started callback listeners for process comfyui
[ComfyUI] [sd-webui-comfyui] Injecting custom extensions...
[ComfyUI] Total VRAM 24564 MB, total RAM 65277 MB
Loading weights: D:\AI Stuff\Model Storage\models\VAE\vae-ft-mse-840000-ema-pruned.safetensors ━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/334.6 MB -:--:--10:25:42-759007 INFO Applying scaled dot product cross attention optimization
10:25:42-790859 INFO Embeddings: loaded=28 skipped=5
10:25:42-795859 INFO Model loaded in 1.8s (load=0.3s create=0.2s apply=0.5s vae=0.5s move=0.4s)
10:25:42-984319 INFO Model load finished: {'ram': {'used': 5.32, 'total': 63.75}, 'gpu': {'used': 4.19, 'total': 23.99}, 'retries': 0,
'oom': 0} cached=0
10:25:43-449493 INFO Startup time: 20.1s (torch=2.6s gradio=0.5s libraries=1.0s scripts=6.3s onchange=0.3s ui-txt2img=0.3s ui-img2img=0.1s
ui-settings=0.2s ui-extensions=1.4s launch=4.3s app-started=0.2s checkpoint=2.8s)
[ComfyUI] Set vram state to: NORMAL_VRAM
[ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3090 Ti : native
[ComfyUI] Using pytorch cross attention
[ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 0.0.0.0 --port 8189
[ComfyUI]
Import times for custom nodes:
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_io.py
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_checkpoint_loader.py
[ComfyUI]
[ComfyUI] Starting server
11:50:16-276332 INFO Exiting
[sd-webui-comfyui] stopped callback listeners for process webui
Terminate batch job (Y/N)? y
PS D:\AI Stuff\Vlad1111> .\webui.bat --listen --comfyui-listen --webui-comfyui-client-address 0.0.0.0:8189
Using VENV: D:\AI Stuff\Vlad1111\venv
11:50:55-809512 INFO Starting SD.Next
11:50:55-815061 INFO Python 3.10.6 on Windows
11:50:55-844743 INFO Version: 9d17cf4c Mon Aug 7 19:50:39 2023 +0300
11:50:56-548215 INFO Latest published version: ff2d846667f62bd83a49b85e44e137e97c64727b
2023-08-07T21:51:23Z
11:50:56-552263 INFO nVidia CUDA toolkit detected
11:50:56-614961 WARNING Modified files: ['modules/lora', 'modules/lycoris']
11:50:56-640775 INFO Disabled extensions: ['sd-webui-agent-scheduler']
11:50:56-641777 INFO Enabled extensions-builtin: ['a1111-sd-webui-lycoris',
'clip-interrogator-ext', 'LDSR', 'Lora',
'multidiffusion-upscaler-for-automatic1111', 'ScuNET',
'sd-dynamic-thresholding', 'sd-extension-system-info',
'sd-webui-controlnet', 'stable-diffusion-webui-images-browser',
'stable-diffusion-webui-rembg', 'SwinIR']
11:50:56-643861 INFO Enabled extensions: ['a1111-sd-webui-tagcomplete',
'novelai-2-local-prompt', 'OneButtonPrompt', 'openpose-editor',
'sd-canvas-editor', 'sd-webui-3d-open-pose-editor',
'sd-webui-comfyui', 'sd-webui-infinite-image-browsing',
'sd-webui-inpaint-anything', 'sd-webui-regional-prompter',
'stable-diffusion-webui-aesthetic-image-scorer',
'Stable-Diffusion-Webui-Civitai-Helper']
11:50:56-647312 INFO Verifying requirements
11:50:56-656827 INFO Verifying packages
11:50:56-662827 INFO Verifying repositories
11:51:00-550719 INFO Verifying submodules
11:51:20-808695 INFO Extensions enabled: ['a1111-sd-webui-lycoris',
'clip-interrogator-ext', 'LDSR', 'Lora',
'multidiffusion-upscaler-for-automatic1111', 'ScuNET',
'sd-dynamic-thresholding', 'sd-extension-system-info',
'sd-webui-controlnet', 'stable-diffusion-webui-images-browser',
'stable-diffusion-webui-rembg', 'SwinIR',
'a1111-sd-webui-tagcomplete', 'novelai-2-local-prompt',
'OneButtonPrompt', 'openpose-editor', 'sd-canvas-editor',
'sd-webui-3d-open-pose-editor', 'sd-webui-comfyui',
'sd-webui-infinite-image-browsing', 'sd-webui-inpaint-anything',
'sd-webui-regional-prompter',
'stable-diffusion-webui-aesthetic-image-scorer',
'Stable-Diffusion-Webui-Civitai-Helper']
11:51:20-810921 INFO Verifying packages
11:51:20-814007 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions-builtin
11:51:20-815007 INFO Extension preload: 0.0s D:\AI Stuff\Vlad1111\extensions
11:51:20-839614 INFO Server arguments: ['--listen', '--comfyui-listen',
'--webui-comfyui-client-address', '0.0.0.0:8189']
No module 'xformers'. Proceeding without it.
11:51:25-556295 INFO Pipeline: Backend.ORIGINAL
11:51:26-390568 INFO Libraries loaded
11:51:26-391568 INFO Using data path: D:\AI Stuff\Vlad1111
11:51:26-395568 INFO Available VAEs: D:\AI Stuff\Model Storage\models\VAE 5
11:51:27-169707 INFO Available models: D:\AI Stuff\Model
Storage\models\Stable-diffusion 98
11:51:28-303101 INFO ControlNet v1.1.233
ControlNet v1.1.233
ControlNet preprocessor location: D:\AI Stuff\Vlad1111\extensions-builtin\sd-webui-controlnet\annotator\downloads
11:51:28-512422 INFO ControlNet v1.1.233
ControlNet v1.1.233
Tag Autocomplete: Could not locate model-keyword extension, LORA/LYCO trigger word completion will be unavailable.
[sd-webui-comfyui] restoring graceful SIGINT handler for the webui process
Civitai Helper: Get Custom Model Folder
Civitai Helper: Load setting from: D:\AI Stuff\Vlad1111\extensions\Stable-Diffusion-Webui-Civitai-Helper\setting.json
Civitai Helper: No setting file, use default
11:51:34-704611 INFO Loading UI theme: name=gradio/default style=Dark
11:51:35-031390 INFO Extra network created thumbnails: checkpoints 0
Running on local URL: http://0.0.0.0:7860
11:51:41-982860 INFO Local URL: http://localhost:7860/
11:51:41-984867 INFO Initializing middleware
[sd-webui-comfyui] started callback listeners for process webui
Loading weights: D:\AI Stuff\Model Storage\models\Stable-diffusion\bb95FurryMix_v110.safe…
11:51:42-875012 INFO Setting Torch parameters: dtype=torch.float16 vae=torch.float16
unet=torch.float16
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
[ComfyUI] [sd-webui-comfyui] started callback listeners for process comfyui
[ComfyUI] [sd-webui-comfyui] Injecting custom extensions...
[ComfyUI] Total VRAM 24564 MB, total RAM 65277 MB
Loading weights: D:\AI Stuff\Model Storage\models\VAE\vae-ft-mse-840000-ema-pruned.safete…
11:51:44-449731 INFO Applying scaled dot product cross attention optimization
11:51:44-982107 INFO Embeddings: loaded=28 skipped=5
11:51:44-986107 INFO Model loaded in 2.4s (load=0.3s create=0.2s apply=0.5s vae=0.5s
move=0.4s embeddings=0.5s)
11:51:45-176018 INFO Model load finished: {'ram': {'used': 5.31, 'total': 63.75},
'gpu': {'used': 4.19, 'total': 23.99}, 'retries': 0, 'oom': 0}
cached=0
[ComfyUI] Set vram state to: NORMAL_VRAM
[ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3090 Ti : native
[ComfyUI] Using pytorch cross attention
[ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 0.0.0.0 --port 8189
11:51:45-658939 INFO Startup time: 24.8s (torch=2.6s gradio=1.0s libraries=1.9s
models=0.8s scripts=7.2s onchange=0.3s ui-txt2img=1.1s
ui-img2img=0.1s ui-settings=0.2s ui-extensions=1.6s
ui-defaults=0.1s launch=4.3s app-started=0.2s checkpoint=3.4s)
[ComfyUI]
Import times for custom nodes:
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_io.py
[ComfyUI] 0.0 seconds: D:\AI Stuff\Vlad1111\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_checkpoint_loader.py
[ComfyUI]
[ComfyUI] Starting server
No issues with ComfyUI itself when held by SD.Next/Vlad runs perfectly, just the output in the tab does not display while using the --listen hook to push both SD.Next and ComfyUI through VPN. I have tried giving a straight IP for what the pc its hosted on is but no dice. Any help appreciated :).
I have my Stable Diffusion "public" and was trying to have ConfyUI on it, but I can't configure the page the tab is trying to go, so it goes to the local host. is there any way I can redirect it to my domain or do I have to do a workaround?
In the machine where I am running Stable Diffusion it all works as intended.
See https://stackoverflow.com/questions/28101895/reloading-packages-and-their-submodules-recursively-in-python for a solution. This makes it possible to reload the extension without having to completely restart the webui all the time.
Adding a form in the settings for additional models location would be a nice quality of life improvement. People can use the yaml file in the comfyui directory to setup models, but having it in the settings of the extension directly would be more user friendly.
Traceback (most recent call last):
File "", line 1, in
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
exitcode = _main(fd, parent_sentinel)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/spawn.py", line 126, in _main
self = reduction.pickle.load(from_parent)
File "/Users/dark/ai_projects/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/comfyui_pre_main.py", line 5, in
from lib_comfyui import (
File "/Users/dark/ai_projects/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/argv_conversion.py", line 2, in
from lib_comfyui import webui_settings
File "/Users/dark/ai_projects/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/webui_settings.py", line 3, in
from lib_comfyui import ipc
File "/Users/dark/ai_projects/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/ipc.py", line 38, in
'webui': parallel_utils.CallbackWatcher(parallel_utils.CallbackQueue(call_fully_qualified)),
File "/Users/dark/ai_projects/stable-diffusion-webui/extensions/sd-webui-comfyui/lib_comfyui/parallel_utils.py", line 45, in init
manager = ctx.Manager()
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/context.py", line 57, in Manager
m.start()
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/managers.py", line 562, in start
self._process.start()
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/process.py", line 121, in start
self._popen = self._Popen(self)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
return Popen(process_obj)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in init
super().init(process_obj)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/popen_fork.py", line 19, in init
self._launch(process_obj)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
prep_data = spawn.get_preparation_data(process_obj._name)
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
_check_not_importing_main()
File "/Users/dark/dev_lib/miniconda3/envs/sd/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
raise RuntimeError('''
RuntimeError:
An attempt has been made to start a new process before the
current process has finished its bootstrapping phase.
This probably means that you are not using fork to start your
child processes and you have forgotten to use the proper idiom
in the main module:
if __name__ == '__main__':
freeze_support()
...
The "freeze_support()" line can be omitted if the program
is not going to be frozen to produce an executable.
For some reason, the mix of process/thread/asyncio used by the extension hangs on WSL. In particular, it seems that the thread in the comfyui process responsible for responding to webui requests hangs either here:
or here:
It is possible that it also hangs there on bare metal linux, however I do not have a machine to test it. If anybody could confirm whether it works or not, I'd appreciate it.
The idea would be to add a "workflow manager" tab for managing ComfyUI workflows. I don't know if there's already an extension for that in ComfyUI, I just had the idea.
Would be nice to have a node "WebuiCheckpointLoader" that can use the checkpoint that's already in memory.
on : a21c282
I never had SigmoidCorrection be able to load, with this latest pull the others started failing import.
The traceback started showing up today after the update. Never had that before.
A couple of pulls before, it started saying it didn't find sigmoid when I opened the postprocess workflow.
Didn't do that before. Now it tells a few more aren't available.
Am o windows 10 and on webui 1.5.1
console relevant part:
[ComfyUI] [sd-webui-comfyui] Injecting custom extensions...
[ComfyUI] Total VRAM 8192 MB, total RAM 32620 MB
[ComfyUI] xformers version: 0.0.20
[ComfyUI] Set vram state to: NORMAL_VRAM
[ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3070 Laptop GPU : native
[ComfyUI] Using xformers cross attention
[ComfyUI] [sd-webui-comfyui] Launching ComfyUI with arguments: --listen 127.0.0.1 --port 8189
[ComfyUI] Adding extra search path checkpoints D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/Stable-diffusion
[ComfyUI] Adding extra search path configs D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/Stable-diffusion
[ComfyUI] Adding extra search path vae D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/VAE
[ComfyUI] Adding extra search path loras D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/Lora
[ComfyUI] Adding extra search path upscale_models D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/ESRGAN
[ComfyUI] Adding extra search path upscale_models D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/SwinIR
[ComfyUI] Adding extra search path embeddings D:\WORK\conda_envs\automatic\stable-diffusion-webui\embeddings
[ComfyUI] Adding extra search path hypernetworks D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/hypernetworks
[ComfyUI] Adding extra search path controlnet D:\WORK\conda_envs\automatic\stable-diffusion-webui\models/ControlNet
[ComfyUI] [Allor]: 10 standard nodes was overridden.
[ComfyUI] Traceback (most recent call last):
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1604, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor_init.py", line 10, in
NODE_CLASS_MAPPINGS = loader.get_modules()
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor\Loader.py", line 100, in get_modules
from .modules import ImageSegmentation
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor\modules\ImageSegmentation.py", line 3, in
from rembg import remove, new_session
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\rembg_init_.py", line 5, in
from .bg import remove
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\rembg\bg.py", line 16, in
from pymatting.alpha.estimate_alpha_cf import estimate_alpha_cf
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting_init_.py", line 2, in
from pymatting.util import *
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting\util_init_.py", line 2, in
from pymatting.util.kdtree import KDTree, knn
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting\util\kdtree.py", line 2, in
from numba import njit, prange
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba_init_.py", line 88, in
from numba.core.decorators import (cfunc, generated_jit, jit, njit, stencil,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\decorators.py", line 12, in
from numba.stencils.stencil import stencil
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\stencils\stencil.py", line 11, in
from numba.core import types, typing, utils, ir, config, ir_utils, registry
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\registry.py", line 5, in
from numba.core import utils, typing, dispatcher, cpu
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\dispatcher.py", line 13, in
from numba.core import (
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\compiler.py", line 6, in
from numba.core import (utils, errors, typing, interpreter, bytecode, postproc,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\callconv.py", line 13, in
from numba.core.base import PYOBJECT, GENERIC_POINTER
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\base.py", line 20, in
from numba.cpython import builtins
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\cpython\builtins.py", line 536, in
from numba.core.typing.builtins import IndexValue, IndexValueType
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\builtins.py", line 22, in
@infer_global(print)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\templates.py", line 1271, in register_global
if getattr(mod, val.name) is not val:
AttributeError: module 'lib_comfyui.comfyui_pre_main' has no attribute ''
[ComfyUI] Cannot import D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor module for custom nodes: module 'lib_comfyui.comfyui_pre_main' has no attribute ''
[ComfyUI] ### Loading: ComfyUI-Impact-Pack (V2.21.2)
[ComfyUI] ### Loading: ComfyUI-Manager (V0.14)
[ComfyUI] ### ComfyUI Revision: 1233 [834ab278]
[ComfyUI] [Allor]: 0 standard nodes was overridden.
[ComfyUI] Traceback (most recent call last):
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1604, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_allor_init.py", line 10, in
NODE_CLASS_MAPPINGS = loader.get_modules()
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_allor\Loader.py", line 100, in get_modules
from .modules import ImageSegmentation
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_allor\modules\ImageSegmentation.py", line 3, in
from rembg import remove, new_session
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\rembg_init_.py", line 5, in
from .bg import remove
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\rembg\bg.py", line 16, in
from pymatting.alpha.estimate_alpha_cf import estimate_alpha_cf
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting_init_.py", line 2, in
from pymatting.util import *
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting\util_init_.py", line 2, in
from pymatting.util.kdtree import KDTree, knn
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\pymatting\util\kdtree.py", line 2, in
from numba import njit, prange
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba_init_.py", line 88, in
from numba.core.decorators import (cfunc, generated_jit, jit, njit, stencil,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\decorators.py", line 12, in
from numba.stencils.stencil import stencil
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\stencils\stencil.py", line 11, in
from numba.core import types, typing, utils, ir, config, ir_utils, registry
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\registry.py", line 5, in
from numba.core import utils, typing, dispatcher, cpu
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\dispatcher.py", line 13, in
from numba.core import (
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\compiler.py", line 6, in
from numba.core import (utils, errors, typing, interpreter, bytecode, postproc,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\callconv.py", line 13, in
from numba.core.base import PYOBJECT, GENERIC_POINTER
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\base.py", line 20, in
from numba.cpython import builtins
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\cpython\builtins.py", line 536, in
from numba.core.typing.builtins import IndexValue, IndexValueType
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\builtins.py", line 22, in
@infer_global(print)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\templates.py", line 1271, in register_global
if getattr(mod, val.name) is not val:
AttributeError: module 'lib_comfyui.comfyui_pre_main' has no attribute ''
[ComfyUI] Cannot import D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_allor module for custom nodes: module 'lib_comfyui.comfyui_pre_main' has no attribute ''
[ComfyUI] Comfyroll Custom Nodes: Loaded
[ComfyUI] Traceback (most recent call last):
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1604, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ImageProcessing_init.py", line 1, in
from .imageprocessing import NODE_CLASS_MAPPINGS, NODE_DISPLAY_NAME_MAPPINGS
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ImageProcessing\imageprocessing.py", line 2, in
from kornia.filters import bilateral_blur, unsharp_mask
ImportError: cannot import name 'bilateral_blur' from 'kornia.filters' (d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\kornia\filters_init_.py)
[ComfyUI] Cannot import D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ImageProcessing module for custom nodes: cannot import name 'bilateral_blur' from 'kornia.filters' (d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\kornia\filters_init_.py)
[ComfyUI] Total VRAM 8192 MB, total RAM 32620 MB
[ComfyUI] xformers version: 0.0.20
[ComfyUI] Set vram state to: NORMAL_VRAM
[ComfyUI] Device: cuda:0 NVIDIA GeForce RTX 3070 Laptop GPU : native
[ComfyUI] Traceback (most recent call last):
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1604, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in call_with_frames_removed
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui_init.py", line 1, in
from .WAS_Node_Suite import NODE_CLASS_MAPPINGS
File "D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui\WAS_Node_Suite.py", line 37, in
from numba import jit
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba_init_.py", line 88, in
from numba.core.decorators import (cfunc, generated_jit, jit, njit, stencil,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\decorators.py", line 12, in
from numba.stencils.stencil import stencil
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\stencils\stencil.py", line 11, in
from numba.core import types, typing, utils, ir, config, ir_utils, registry
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\registry.py", line 5, in
from numba.core import utils, typing, dispatcher, cpu
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\dispatcher.py", line 13, in
from numba.core import (
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\compiler.py", line 6, in
from numba.core import (utils, errors, typing, interpreter, bytecode, postproc,
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\callconv.py", line 13, in
from numba.core.base import PYOBJECT, GENERIC_POINTER
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\base.py", line 20, in
from numba.cpython import builtins
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\cpython\builtins.py", line 536, in
from numba.core.typing.builtins import IndexValue, IndexValueType
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\builtins.py", line 22, in
@infer_global(print)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\numba\core\typing\templates.py", line 1271, in register_global
if getattr(mod, val.name) is not val:
AttributeError: module 'lib_comfyui.comfyui_pre_main' has no attribute ''
[ComfyUI] Cannot import D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui module for custom nodes: module 'lib_comfyui.comfyui_pre_main' has no attribute ''
[ComfyUI]
Import times for custom nodes:
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\Pseudo_HDR_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\sampler_rescalecfg.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\saturation_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_postprocess_output.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\sharpness_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\histogram_equalization.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\imageflip_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_postprocess_input.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\gaussian_blur_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\brightness_contrast_ally.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\bsz-auto-hires.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\conditioning_sizing_for_SDXL.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\SeargeSDXL
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ADV_CLIP_emb
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-post-processing-nodes
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_Noise
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_TiledKSampler
[ComfyUI] 0.0 seconds (IMPORT FAILED): D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ImageProcessing
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_checkpoint_loader.py
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-animatediff
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_UltimateSDUpscale
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\Derfuu_ComfyUI_ModdedNodes
[ComfyUI] 0.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_Comfyroll_CustomNodes
[ComfyUI] 0.0 seconds (IMPORT FAILED): D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_allor
[ComfyUI] 0.0 seconds (IMPORT FAILED): D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui
[ComfyUI] 0.1 seconds (IMPORT FAILED): D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor
[ComfyUI] 0.4 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manager
[ComfyUI] 1.0 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\efficiency-nodes-comfyui
[ComfyUI] 1.7 seconds: D:\WORK\conda_envs\ConfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack
[ComfyUI]
[ComfyUI] Starting server
[ComfyUI] To see the GUI go to: http://127.0.0.1:8189
[ComfyUI] [sd-webui-comfyui] registered new ComfyUI client - comfyui_general_tab
[ComfyUI] [sd-webui-comfyui] registered new ComfyUI client - comfyui_postprocess_txt2img
[ComfyUI] [sd-webui-comfyui] registered new ComfyUI client - comfyui_postprocess_img2img
When I tried to use the WebuiSaveImage node, I got the following error.
Error occurred when executing WebuiSaveImage:
No module named 'lib_comfyui.webui_paths'
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "C:\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py", line 34, in save_image
filename, _ = WebuiSaveImage.webui_save_image(image=pil_image, path=save_path, basename='')
File "C:\stable-diffusion-webui\extensions\sd-webui-comfyui\comfyui_custom_nodes\webui_save_image.py", line 40, in webui_save_image
from lib_comfyui.webui_paths import save_image
Last update is using a new callback postprocess_batch_list
that is not yet implemented in SD.Next.
We might want to make a PR in SD.Next repo.
Opening a web client too early fails to load the comfyui iframes. The client has to reload the iframes automatically, which it does not do at the moment.
This would be in the settings for ComfyUI's location, and in the tab if ComfyUI is not found.
AUTOMATIC1111/stable-diffusion-webui#11856
It appears to me that the subprocess the extension launched has invoked modules/launch_util.py
and in turn activated a start
timer. This looks unexpected. Is there any way to mitigate this?
The initial generated image from the webui is still being saved for now.
The problem we had was that we didn't want to lose the original title or png info. The current way images are saved is not properly handled, so we kept the original images saved.
This should probably be fixed in the same PR that is going to embed the full png info of webui + comfyui in the metadata for reproducible results.
Hello,
When using this plugin I get the following error after enabling the plugin, it doesn't happen immediately on install, but comfui tab doesn't show up right away so I close and restart my WSL2 Ubuntu instance and re-launch sd-webui, then I get:
Traceback (most recent call last):
File "/home/MYUSERNAME/anaconda3/envs/automatic/lib/python3.10/multiprocessing/queues.py", line 244, in _feed
File "/home/MYUSERNAME/anaconda3/envs/automatic/lib/python3.10/multiprocessing/reduction.py", line 51, in dumps
File "/home/MYUSERNAME/anaconda3/envs/automatic/lib/python3.10/site-packages/torch/multiprocessing/reductions.py", line 369, in reduce_storage
RuntimeError: unable to open shared memory object </torch_1545_703365300_501> in read-write mode: Too many open files (24)
If I then try to connect to sd-webui via browser I get a string of similar errors that goes on indefinitely (could be forever but I always Ctrl+C terminal after a minute or two).
I have the following plugins installed alongside this one:
Mask2Background,SadTalker,TemporalKit,a1111-mini-paint ,a1111-sd-webui-lycoris ,a1111-sd-webui-tagcomplete ,canvas-zoom ,danbooru-prompt ,deforum-for-automatic1111-webui ,ebsynth_utility ,gif2gif ,infinite-zoom-automatic1111-webui ,model_preset_manager,multidiffusion-upscaler-for-automatic1111,sd-3dmodel-loader ,sd-canvas-editor ,sd-extension-aesthetic-scorer,sd-extension-steps-animation ,sd-webui-3d-editor,sd-webui-agent-scheduler,sd-webui-controlnet,sd-webui-infinite-image-browsing,sd-webui-llul,sd-webui-panorama-viewer ,sd-webui-regional-prompter ,sd-webui-text2video,sd-webui-txt-img-to-3d-model,stable-diffusion-NPW ,video_loopback_for_webui
Can confirm removing the ComfyUI extension folder from sd-webui/extensions returns everything to working order.
Opening multiple browser windows at http://localhost:7860 makes both web clients use the workflows from the last open client. Both clients should use their respective workflows, there shouldn't be any cross talk between the clients.
Add a dropdown listing workflows and a button to load the current selection. The extension would discover workflows from a list of paths in the settings and when clicking on a reload button.
Hi ModelSurge
After install ComfyUI manager I manager to install missing node however some node require some module in the venv folder such as numba module etc...
The WebUI has all the modules but I dont know to config the extension to find in the venv folder
Please help, thank in advance
Currently, the javascript code is doing polling every 200ms to calculate the new height and update it. It would be better to update the height only on:
Running latest sd-webui-comfyui plugin in latest auto webui.
Running an Hires.fix from 512x704 to 896x1216. First run it goes through.
This works when I remove the sd-webui-confyui, every time.
Don't really know the "WebuiModelLoader node" you mentioned.
Second run and afterwards, with plugin activated even if without other nodes, just the in and out, throws in console:
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 30/30 [00:10<00:00, 2.89it/s]
ScuNET tiles: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 9/9 [00:00<00:00, 13.49it/s]
*** Error completing request
*** Arguments: ('task(7gfsmts5m0xwln7)', 'gorgeous cinematography, 1800s Paris, shoulder shot, (Dutch angle:1.4), post-production, depth of field, movie, cinema, professional color grading, 35mm lens, very detailed, film grain, by Tim Walker, panavision anamorphic lens effect, lora:epiNoiseoffset_v1:1, lora:AnalogDiffusion_LoRA300:.8', 'doll, 3d, cartoon, (low quality:1.5), (bad art:1.5), duplicate, multiple, disfigured, asian, middle eastern, old, ugly, child, piercing, watermark, logo, signature', [], 30, 15, False, False, 1, 1, 3, 3099757425.0, -1.0, 0, 0, 0, False, 704, 512, True, 0.25, 2, 'ScuNET', 20, 896, 1216, 1, '', '', [], <gradio.routes.Request object at 0x00000151038DE020>, 0, False, {'ad_model': 'face_yolov8n.pt', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 32, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 4, 'ad_denoising_strength': 0.4, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': False, 'ad_inpaint_width': 512, 'ad_inpaint_height': 512, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_sampler': False, 'ad_sampler': 'Euler a', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_use_clip_skip': False, 'ad_clip_skip': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'inpaint_global_harmonious', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, {'ad_model': 'None', 'ad_prompt': '', 'ad_negative_prompt': '', 'ad_confidence': 0.3, 'ad_mask_min_ratio': 0, 'ad_mask_max_ratio': 1, 'ad_x_offset': 0, 'ad_y_offset': 0, 'ad_dilate_erode': 32, 'ad_mask_merge_invert': 'None', 'ad_mask_blur': 4, 'ad_denoising_strength': 0.4, 'ad_inpaint_only_masked': True, 'ad_inpaint_only_masked_padding': 32, 'ad_use_inpaint_width_height': False, 'ad_inpaint_width': 512, 'ad_inpaint_height': 512, 'ad_use_steps': False, 'ad_steps': 28, 'ad_use_cfg_scale': False, 'ad_cfg_scale': 7, 'ad_use_sampler': False, 'ad_sampler': 'Euler a', 'ad_use_noise_multiplier': False, 'ad_noise_multiplier': 1, 'ad_use_clip_skip': False, 'ad_clip_skip': 1, 'ad_restore_face': False, 'ad_controlnet_model': 'None', 'ad_controlnet_module': 'inpaint_global_harmonious', 'ad_controlnet_weight': 1, 'ad_controlnet_guidance_start': 0, 'ad_controlnet_guidance_end': 1, 'is_api': ()}, False, 'MultiDiffusion', False, True, 1024, 1024, 96, 96, 48, 4, 'None', 2, False, 10, 1, 1, 64, False, False, False, False, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 0.4, 0.4, 0.2, 0.2, '', '', 'Background', 0.2, -1.0, False, 1536, 96, True, True, True, False, False, 7, True, 1, 1, 1, 100, 'Constant', 0, 'Constant', 0, 4, False, 1.6, 0.97, 0.4, 0, 20, 0, 12, '', True, False, False, False, 512, False, True, ['Face'], False, '{\n "face_detector": "RetinaFace",\n "rules": {\n "then": {\n "face_processor": "img2img",\n "mask_generator": {\n "name": "BiSeNet",\n "params": {\n "fallback_ratio": 0.1\n }\n }\n }\n }\n}', 'None', 40, False, False, 'LoRA', 'None', 0, 0, 'LoRA', 'None', 0, 0, 'LoRA', 'None', 0, 0, 'LoRA', 'None', 0, 0, 'LoRA', 'None', 0, 0, None, 'Refresh models', True, <scripts.controlnet_ui.controlnet_ui_group.UiControlNetUnit object at 0x000001507F40EB60>, <scripts.controlnet_ui.controlnet_ui_group.UiControlNetUnit object at 0x00000151037FEE00>, False, 'None', 20, False, False, 0, None, [], 0, False, [], [], False, 0, 1, False, False, 0, None, [], -2, False, [], False, 0, None, None, '', False, None, '', 'outputs', 1, 0, 0.25, False, False, 'positive', 'comma', 0, False, False, '', 'Illustration', 'svg', True, True, False, 0.5, True, 16, True, 16, False, 1, '', [], 0, '', [], 0, '', [], True, False, False, False, 0, 1.6, 0.97, 0.4, 0, 20, 0, 12, '', True, False, False, False, 512, False, True, ['Face'], False, '{\n "face_detector": "RetinaFace",\n "rules": {\n "then": {\n "face_processor": "img2img",\n "mask_generator": {\n "name": "BiSeNet",\n "params": {\n "fallback_ratio": 0.1\n }\n }\n }\n }\n}', 'None', 40, None, None, False, None, None, False, 50, True, False, 0, 'Range', 1, 'GPU', True, False, False, False, False, 0, 512, False, 512, False, False, 3, False, 3, True, 3, False, 'Horizontal', False, False, 'u2net', False, True, True, False, 0, 2.5, 'polylines_sharp', ['left-right', 'red-cyan-anaglyph'], 2, 0, '∯boost∯clipdepth∯clipdepth_far∯clipdepth_mode∯clipdepth_near∯compute_device∯do_output_depth∯gen_normalmap∯gen_rembg∯gen_simple_mesh∯gen_stereo∯model_type∯net_height∯net_size_match∯net_width∯normalmap_invert∯normalmap_post_blur∯normalmap_post_blur_kernel∯normalmap_pre_blur∯normalmap_pre_blur_kernel∯normalmap_sobel∯normalmap_sobel_kernel∯output_depth_combine∯output_depth_combine_axis∯output_depth_invert∯pre_depth_background_removal∯rembg_model∯save_background_removal_masks∯save_outputs∯simple_mesh_occlude∯simple_mesh_spherical∯stereo_balance∯stereo_divergence∯stereo_fill_algo∯stereo_modes∯stereo_offset_exponent∯stereo_separation') {}
Traceback (most recent call last):
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\call_queue.py", line 58, in f
res = list(func(*args, **kwargs))
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\call_queue.py", line 37, in f
res = func(*args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\txt2img.py", line 62, in txt2img
processed = processing.process_images(p)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\processing.py", line 677, in process_images
res = process_images_inner(p)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\batch_hijack.py", line 42, in processing_process_images_hijack
return getattr(processing, '__controlnet_original_process_images_inner')(p, *args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\processing.py", line 794, in process_images_inner
samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\webui\workflow_patcher.py", line 65, in p_sample_patch
x = original_function(*args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\processing.py", line 1109, in sample
samples = self.sd_model.get_first_stage_encoding(self.sd_model.encode_first_stage(decoded_samples))
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\sd_hijack_utils.py", line 17, in
setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: self(*args, **kwargs))
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\modules\sd_hijack_utils.py", line 28, in call
return self.__orig_func(*args, **kwargs)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\utils_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\models\diffusion\ddpm.py", line 830, in encode_first_stage
return self.first_stage_model.encode(x)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\models\autoencoder.py", line 83, in encode
h = self.encoder(x)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\modules\diffusionmodules\model.py", line 526, in forward
h = self.down[i_level].block[i_block](hs[-1], temb)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "D:\WORK\conda_envs\automatic\stable-diffusion-webui\repositories\stable-diffusion-stability-ai\ldm\modules\diffusionmodules\model.py", line 131, in forward
h = self.norm1(h)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\normalization.py", line 273, in forward
return F.group_norm(
File "d:\WORK\conda_envs\automatic\stable-diffusion-webui\venv\lib\site-packages\torch\nn\functional.py", line 2530, in group_norm
return torch.group_norm(input, num_groups, weight, bias, eps, torch.backends.cudnn.enabled)
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 540.00 MiB (GPU 0; 8.00 GiB total capacity; 6.84 GiB already allocated; 0 bytes free; 6.94 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
When using the Webui Save Image node, the first image generation works, but the following error occurs when generating images after that. If I don't use that node there is no problem.
commit : 9d01ada
Error occurred when executing KSampler:
No module named 'ldm.models.diffusion.ddpm'
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "C:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1206, in sample
return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise)
File "C:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1167, in common_ksampler
previewer = latent_preview.get_previewer(device, model.model.latent_format)
File "C:\ComfyUI_windows_portable\ComfyUI\latent_preview.py", line 65, in get_previewer
taesd = TAESD(None, taesd_decoder_path).to(device)
File "C:\ComfyUI_windows_portable\ComfyUI\comfy\taesd\taesd.py", line 55, in init
self.decoder.load_state_dict(torch.load(decoder_path, map_location="cpu", weights_only=True))
File "C:\stable-diffusion-webui\modules\safe.py", line 108, in load
return load_with_extra(filename, *args, extra_handler=global_extra_handler, **kwargs)
File "C:\stable-diffusion-webui\modules\safe.py", line 133, in load_with_extra
from modules import shared
File "C:\stable-diffusion-webui\modules\shared.py", line 21, in
from ldm.models.diffusion.ddpm import LatentDiffusion
A little confused.
To create a public link, set share=True
in launch()
.
Startup time: 15.2s (import torch: 1.4s, import gradio: 1.0s, import ldm: 0.5s, other imports: 0.8s, setup codeformer: 0.2s, load scripts: 1.2s, load SD checkpoint: 5.0s, create ui: 0.5s, gradio launch: 4.4s).
Launching ComfyUI with arguments: --port 8188
Process SpawnProcess-1:
Traceback (most recent call last):
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\multiprocessing\process.py", line 314, in _bootstrap
self.run()
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\multiprocessing\process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "D:\stable_diffusion\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\async_comfyui_loader.py", line 13, in main
start_comfyui(comfyui_path)
File "D:\stable_diffusion\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\async_comfyui_loader.py", line 20, in start_comfyui
runpy.run_path(os.path.join(comfyui_path, "main.py"), {}, 'main')
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 288, in run_path
code, fname = _get_code_from_file(run_name, path_name)
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 252, in _get_code_from_file
with io.open_code(decoded_path) as f:
FileNotFoundError: [Errno 2] No such file or directory: 'D:\stable_diffusion\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\main.py'
in the extensions folder, the main.py in the scripts, why the error show '/lib_comfyui\main.py';
there no main.py in lib_comfyui
I have Automatic1111 running on a remote server in the building, accessible on the local network. That UI loads as expected. I can start main.py in ComfyUI with --listen [address] and then open the ComfyUI remotely as expected. I have added the path and necessary switch --listen [address] to the settings for the plugin and reloaded with successful console:
Launching ComfyUI with arguments: --listen [address] --port 8188
Total VRAM reported here
xformers version: 0.0.20
Set vram state to: NORMAL_VRAM
Device: cuda:0 GPU here
Using xformers cross attention
Starting server
To see the GUI go to: http://192.168.0.51:8188
and in this state I can see both the Automatic UI, and the ComfyUI on their relevant remote ports.
Clicking on the tab does not load the interface in either firefox or Edge.
I used Civitai helper to install your repo, and upon reload i get this error (i used python from powershell to run install_comfyui incase that was the issue)
Error loading script: main.py
Traceback (most recent call last):
File "D:\source\StabDiffCode\stable-diffusion-webui\modules\scripts.py", line 256, in load_scripts
script_module = script_loading.load_module(scriptfile.path)
File "D:\source\StabDiffCode\stable-diffusion-webui\modules\script_loading.py", line 11, in load_module
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "D:\source\StabDiffCode\stable-diffusion-webui\extensions\sd-webui-comfyui\scripts\main.py", line 10, in
from lib_comfyui import webui_callbacks
File "D:\source\StabDiffCode\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\webui_callbacks.py", line 4, in
from lib_comfyui import comfyui_adapter, webui_tab, webui_settings
File "D:\source\StabDiffCode\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\webui_tab.py", line 70, in
File "D:\source\StabDiffCode\stable-diffusion-webui\extensions\sd-webui-comfyui\lib_comfyui\webui_settings.py", line 29, in get_port
return settings_port or shared.cmd_opts.comfyui_port
AttributeError: 'Namespace' object has no attribute 'comfyui_port'
i am guessing that for whatever reason it (automatic1111) isn't seeing your extension? Any ideas on how to fix this?
The current node implementation systematically updates the model no matter what. I'm thinking of adding a comfyui api endpoint for sending webui model updates.
I've run into an issue: the TAESD previews stopped working after connecting ComfyUI as a plugin, both as A1111 plugin and standalone. The standalone configuration wasn't changed, and I don't remember updating it.
Chances are, the first run messed up something in my venv. There were no errors, but I saw the startup was odd and it was installing some libraries. Please, don't do that. The plugin shouldn't change ANYTHING in an existing installation unless it's absolutely essential for the extension's function.
This issue is for #2
When clicking on the "Install ComfyUI" button, in the ComfyUI tab when the install location isn't set up yet, ComfyUI doesn't show up even though it clearly started in the console:
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.