Clothes Swapping Made Easy! ComfyUI 

Comfyui is fun, great that you’ll get to try it!

huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors

Hi - there are two approaches that you can combine with the technique in the video. In-painting from a reference or Lora training. Or forcing an image via IPAdpater or the diffusion itself. I think Lora training would be the first good step to take. Lora is forcing the the visual by feeding in a limited number of images to refine a model (SD XL) to give back a result. What's the best way to connect with you to talk about further, want to make sure I'm 100% understanding you need.

@@creatorbrew i have tried Leonardo AI. dataset training for a product, but result is deformed , and it can't be taken by a model , i have no idea to connect both sides, so i think that only comfy UI look promising in its accurately control , but i don't understand it at all, it's somewhat complicated for me to tweak it, and it spends much time to learn it , if you can give a help , i would like to pay and get the result directly , sincerely

How to contact you? And did you look at my Lora training video yet?

What GPU you're using, I'm using RTX4070 Ti Super, but still occured: Warning: Ran out of memory when regular VAE encoding, retrying with tiled VAE encoding. Warning: Ran out of memory when regular VAE decoding, retrying with tiled VAE decoding.

The Ipadapter apply node is replaced with the ipadapter adavanced, but the problem there is the image connection which I am running into

Hi - 1. download the portable version of comfyui. And test it by running the default workflow that shows (the case) up 2. Install the manager. 3. Update comfyui 4. Download the workflow. 5. Go to the manager and install the missing nodes. 6. Restart confyui manually (check your see if there are any node conflicts. 7. Download the models and place them in the model folder. 8. Restart comfyui (or click the refresh button) to have those models listed. 9. Start out simple, 1024x1024 images for the person snd the clothes.

@@creatorbrew I'm on a Mac

@@DwaynePaisleyMarshall If I remember, I think that error happens when the wrong model is used. (the only other reason would wrong node).

I think he's using a model with a baked vae, so it's not loaded by a seperate node.

Did you down load the workflow, went to the manager, added the missing nodes, restart comfy? As long as the provided workflow works you can reproduce on your own.

@@creatorbrew Yep I did all of this, there just isn't an equlivent node for ApplyIPA adaptor, not unless the IPA has had an update?

@@creatorbrew seems like there is no "apply ipadapter" node in ipadapter plus which is the package it should come with.

You can download the original ipadapters from git. Or, with a little rework, you can rewire the new ipadapters to the flow (swap in). How much should I help? Always a question, part of learning is working through a minor bump since 3 years from now who knows what the exact adapters will be but the workflow concept will be the same. But I can see if anyone wishes a one click solution having a new tutorial would accommodate them.

Why = AI isn’t Photoshop and it has to dream up what you are asking. However, with the right prompts and control you can force the randomness into a closer space . The strongest way is to train a Lora on about 10 images which will be a strong guide to getting a close result Train ComfyUI Lora On Your Own Art! ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-5PtLQSFrU38.html

Lora training, requires multiple images Train ComfyUI Lora On Your Own Art! ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-5PtLQSFrU38.html instead of a character in the video.

RED = those nodes are not installed. See the other response about installing missing nodes.

Hi- have you tried the following: download the new portable version of comfyui (that’s the self contained folder with no installs) then install the comfyui manager.. update “all” the comfyui and nodes. Then follow the workflow .

Hi - PNGs are good to start to avoid the JPG compression (boxes). This demo workflow is the simple level to show how to create a task and link them together, so you can keep on growing. For further refining, to continue with ComfyUI would be linking an Upscaler and detailer node. My source image of the person isn't that hi-res, starting with better source material will help. The other way to go is to start making a daisy chain of the masks process as shown in the video, such as 1) taking the person as the final output and running segment anything with the prompt of "person" or "character" and that to 2) an invert mask to knock out the background. 3) Connecting that chain to an inpaint vae and 4) drop in a background (image or via prompt). This will get rid of the stray pixel smudges around the person. Then to focus back on the jacket, 1) copy and paste the jacket workflow for masking and add rerun it with the newly cleaned up background version of the person. This could help eliminate some of the rough pixels around the wrist. What I have been doing is breaking outfit into pieces, and combining those masks together with a focus on each area. Also, for something quick, I take the general output and do retouching in photoshop (or photopea.com if you want to use a free image editor). Using Comfyui as away to get the general position / pose of the person correct with the current outfit and then correcting imperfections on the pixel layer there. ComfyUI, Automatic 1111, and Photoshop are tools that are part of a workflow. Sometimes it is "quicker" to dip into a few tools to get refined output than to try to use just one tool. In theory, I can keep using masking and inpainting to wire together a big network of nodes that could automate the process. I've done this when creating Kiosk experiences with a front end with stable diffusion. But if it is for personal or production art, then using each tool's strengths to save time is a way to go.

Thank you for your answer. I have learned how to remove the background from a long image and make it transparent, so it can be used as the original image for the clothing. Then I tried to get a high-definition optimized image through SD enlargement, but the effect was not ideal. I tried many combinations, and I feel that it seems impossible to get the ideal image with only comfyui. Do I really need to use several software together to get the ideal image? Is there any way to get a very good image with only comfyui?@@creatorbrew

within the Comfyui/customnodes/ipadapter models.

Start a reddit threat and link to it here, then we can chat.

Hi, Can you share your result via github? or other place? I'm about to make another tutorial for little tweaks to improve. But if you have a business reason (other than hobby) reach out to me directly. What I share on RU-vid are the "starts" of things as I perfect the final outcome for clients.

@@creatorbrew Thanks, Yes, I would love to share some of the bad results. Is there other ways than github that I can share the output pictures with you? Cheers.

@@sunnytomy make a reddit channel in the Stable Diffusion area, then drop the link back here.

It could be the usual 1) update comfyui, 2) update the nodes 3) make sure the models are the correct version. Which node does it fail at?

Hi - if you post your workflow to the same URL I posted mine, I can take a look. A difference I see, I didn't use the plus-face version, I used this model: ip-adapter_sdxl_vit-h.safetensors. To trouble shoot. Hold down the CONTROL key and drag a selection around the top nodes. Then press the CONTROL M key (this deactivates those nodes). Slick on the Load Checkpoint and press CONTROL M to reactivate that node. See if the bottom part of the workflows works. If it does, the means it is one of the models specified on the top one (probably ip-adapter_sdxl_vit-h.safetensors) as a guess.

@@creatorbrew I mistyped. I actually used ip-adapter_sdxl_vit_h.safetensors Can you tell me which clip vision are you using? Its definitely a model mismatch according to my research

It's the SD 1.5 version model.safetensors, based on my browser search history, I believe I downloaded it from here: huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors

comfyworkflows.com/workflows/7e9b0e9f-e012-4f2d-ac7b-989bd8589fd1 this one is a simple one and one way to burn into our minds a task is to try it out :)

@@creatorbrew Error occurred when executing GroundingDinoSAMSegment (segment anything): How can I fix this?

Are you running on CPU/GPU? Which GPU? The usual cause is the wrong models mixing. Here are the models I'm using. Here's the list of models... Main Model: sd_xl_base_1.0.safetensors Ipadapter Model ip-adapter_sdxl_vit-h.safetensors Clipvision SD1.5\model.safetensors SAM Model Loader (segment anything) sam_vit_h (2.56GB) Grounding Dino Model loader GroundingDINO_SwinT_OGC (694MB)

@@creatorbrew rtx 3060 12g

@@djivanoff13 that's enough Vram, so it's probably a matter of getting the models listed in the description/this reply from huggingface.

😊

Hi, do you have a way to share your result? /workflow. Yesterday on a different project I was on a 2060 and ran the same workflow in a 4050 and got a different visual result even though everything was fixed and used the same models and images. The Segment anything can be time consuming the first time it runs, after that the mark is created and then the rest of the nodes can be adjusted. You can try inpainting it on your image and then bypass the segment anything mode.

Latent acts as the dream, with giving so much info to what the Kssmpler will dream up the only place to be creative is on the masked out area. The IPadapter pushed the interpretation of the new jacket forward into the Ksampler where the latent of the inpainted jacket (via segment anything) meets up with the model to create the effect.

What is the issue you are experiencing? Have you 1) updated your comfyUI 2) downloaded the models

Hi, thank you for watching and enjoying. Yes, you can use the image and then wire in the mask as an image to skip segment anything. It would simplify. Segment anything is better suited for when you want your mages to be batched and don’t have the time to mask.

@@creatorbrew Thank you for your very kind reply, best regards.

Which files? The image is dragged to comfyui interface (you probably knew that), the models can be placed in the stable diffusion models folder.

1. Do you have ComfyUI Manager installed? If so, click the Manger button. When it is done updating Then click Update ALL. (check the terminal window). Exit ComfyUI and restart. 2. If you don't have Comfyui Manager, then download the Comfyui Portable, then install the ComfyUI Manger. Then click the ManagerButton and install the missing nodes.

Training a Lora on the jacket would help keep consistency. Or using a photo of the jacket and inpainting to switch people.

@@creatorbrew we have hundreds of items and unfortunately training a Lora on each would not be feasible compared to traditional methods

Does the segment anything node pick up the logo? such as typing in the word "logo" or "square" or whatever it looks like? In the end it is an inpainting that will do it. This workflow is automating the inpainting by creating the mask of the jacket automatically. Do you have a picture of the model/logo anywhere to share?

what is the size of your graphic card's memory? What is the length of your video? Check to see if the models match the names. There are some low version and high version of models. An alternative approach is to launch comfyui with the command line switch so it is all running on the CPU to get everything on the CPU. Also, check the image sizes. Start with everything at 512x512 then bump up the size to 1024x1024 and go up from therre.

... a way to troubleshoot is to see at the start of the video when it is two separate workflows.? try each workflow along and the one that doesn't work has the wrong model (maybe) you can wire it like in the video. Then select the nodes that you don't want to run and press CONTROL M on the keyboard to deactivate those nodes. Then reactivate them and deactivate the other work flow. Hopefully that will give an answer.