can not use custom_pipeline hd_painter with IP_adapter about diffusers

[fabiorigano]

hi everyone, thanks @asomoza for adding me here
I made some tests, HD Painter code is not up to date with the more recent developments: in

diffusers/examples/community/hd_painter.py

Line 572 in 35f45ec

output_hidden_state = False if isinstance(self.unet.encoder_hid_proj, ImageProjection) else True

the isinstance method will always return False, because now image projection layers are encapsulated in MultiIPAdapterImageProjection
this is where code breaks, for reference it should be: https://github.com/huggingface/diffusers/blob/35f45ecd71a5c917406408a02bc982c3795d5a35/src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py#L942C1-L949C14

[sayakpaul]

Cc: @asomoza

[sayakpaul]

Also where does "stable-diffusion/absolutereality_v181" come from? We need to have access to this for reproduction.

[asomoza]

I won't have the time to test this soon.

cc: @fabiorigano for IP Adapter and @haikmanukyan for HD Painter if they have some insights about it.

[linthmwan]

reality_v181" come from

Use other SD 1.5 base model like runwayml/stable-diffusion-v1-5 also reproduce this error.