Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! about ait

[asagi4]

If you want, you can try my branch: https://github.com/asagi4/AIT/tree/hacks

The fixes in it aren't ready for publication, but it restores compatibility with at least my installation of ComfyUI. It's very WIP though.
I have some local patches in comfyUI too that deal with tensor type issues, so that version of AIT might not be enough.

[asagi4]

EDIT: removed the ComfyUI patch

I updated the hacks branch with a better fix. AIT no longer forces tensors on the CPU, which makes things work properly.

[asagi4]

@FizzleDorf I'll make a PR once I have time to put some thought into it. There's probably more refactoring and cleanup that can be done with the recent updates to ComfyUI, and I'd rather not leave too much useless code lying around.

[CyberTimon]

Thank you very much. Will try it tomorrow!

[CyberTimon]

@asagi4 Thank you very much for your fix. Everything works including controlnet!! :)

[FizzleDorf]

@asagi4 I caught this kind of late. Thanks for putting this together. You can open the PR early if you like for some more visibility and if you need any help with anything or roll back some recent changes so the merge is more graceful let me know.

[asagi4]

Looking at https://github.com/gameltb/AIT/ it seems it should be possible to refactor AIT to get rid of the sampler override and a large bunch of the other code in the repository and simplify things greatly, but that fork seems to completely remove downloading precompiled modules.

Rebasing AIT on top of that work and adding in the module downloading is what I'd like to see happen; it seems like it would remove a lot of confusing code that's really difficult to keep compatible with base ComfyUI.

[asagi4]

I don't know if I'll have the motivation to do that though; Refactoring Python code is painful.

[CyberTimon]

Yeah it would be cool if you would do that - if you have time and motivation of course. It's quite sad to see how little attention AiT gets.