xeeroxxx / comfyui_magicclothing

unofficial implementation of Comfyui magic clothing

Updates:

• ✅ [2024/04/17] only cloth image with prompt generation
• ✅ [2024/04/18] IPAdapter FaceID with human face detection and synthesize with cloth image generation
• ✅ [2024/04/18] IPAdapter FaceID with controlnet openpose and synthesize with cloth image generation
• ✅ [2024/04/19] lower-body and full-body models for preliminary experiment

You can contact with me thr twitter: FrankChieng or weixin: GalaticKing

the main workflow

IPAdapater FaceID workflow

IPAdapater FaceID chained with controlnet openpose workflow

lower-body full-body workflow

full-body workflow with IPadapterFaceid

you should run under custom_nodes directory of ComfyUI

git clone https://github.com/frankchieng/ComfyUI_MagicClothing.git

then run

pip install -r requirements.txt

download the models of cloth_segm.pth , magic_clothing_768_vitonhd_joint.safetensors(upper-body model),OMS_1024_VTHD+DressCode_200000.safetensors(lower-body and full-body model) from 🤗Huggingface and place them at the checkpoints directory

you should try the combination of miscellaneous hyperparameters especially when you inference with the lower and full body model,just for experiment now

install the ComfyUI_IPAdapter_plus custom node at first if you wanna to experience the ipadapterfaceid.Then download the IPAdapter FaceID models from IP-Adapter-FaceID and place them as the following placement structure

tips:If you wanna to run the controlnet openpose part,you have to install the comfyui_controlnet_aux custome code as well as download the body_pose_model.pth, facenet.pth and hand_pose_model.pth at openpose models and place them in custom_nodes/comfyui_controlnet_aux/ckpts/lllyasviel/Annotators

ComfyUI
|-- models
|   |-- ipadapter
|   |   |-- ip-adapter-faceid-plus_sd15.bin
|   |   |-- ip-adapter-faceid-plusv2_sd15.bin
|   |   |-- ip-adapter-faceid_sd15.bin
|   |-- loras
|   |   |-- ip-adapter-faceid-plus_sd15_lora.safetensors
|   |   |-- ip-adapter-faceid-plusv2_sd15_lora.safetensors
|   |   |-- ip-adapter-faceid_sd15_lora.safetensors
|-- custom_nodes
|   |-- ComfyUI_MagicClothing
|   |   |-- checkpoints
|   |   |   |-- cloth_segm.pth
|   |   |   |-- magic_clothing_768_vitonhd_joint.safetensors
|   |   |   |-- OMS_1024_VTHD+DressCode_200000.safetensors