I can't seem to run this about paint-with-words-sd

[cloneofsimo]

Say you have a input_prompt = "a rabbit and a cat".
and you have text-labeled segmentation maps with region with dog in it. In this current implementation, this will cause an error because dog is not in the input_prompt.
Make sure that that all your segmentation labels are strictly include in the prompt.

Note : This is, to be honest, not the best way to implement as there can always be subtle difference in segmentation label and prompt, which is reasonable! I am planning to thus implement some sort of "neural" version of this, but this was not in their paper so I don't know if this would work.

[hiss-remi]

Say you have a input_prompt = "a rabbit and a cat". and you have text-labeled segmentation maps with region with dog in it. In this current implementation, this will cause an error because dog is not in the input_prompt. Make sure that that all your segmentation labels are strictly include in the prompt.

The thing that was tripping me up is that if you have multiple words for a given region, it won't trigger this error as long as one of the words is in your prompt. Unfortunately, words that aren't in the prompt usually don't seem to have any effect on the output image, while words that are in the prompt that could apply to the subjects of multiple regions frequently end up contaminating them. Which makes using this for complicated subjects a bit of a crapshoot.

(Although the lack of negative prompting is sometimes making it hard to tell what's going on... the model I'm using is very good at making bad art if you don't tell it not to.)

[cloneofsimo]

could apply to the subjects of multiple regions frequently end up contaminating them. Which makes using this for complicated subjects a bit of a crapshoot.

Right, I am aware of this issue. This is fixable problem and I will work on it.

(Although the lack of negative prompting is sometimes making it hard to tell what's going on... the model I'm using is very good at making bad art if you don't tell it not to.)

I have added negative prompting today, so check it out!
you can use it with arguement unconditional_input_prompt: str = "",

[leonnn1]

thank you, I mannaged to make it work, I am still a bit lost but it's doing something haha, great work by the way!

[hiss-remi]

Right, I am aware of this issue. This is fixable problem and I will work on it.

Glad to hear it. I... don't really get how any of this works, so I wasn't sure what I should hope for.