Use Any Face EASY in Stable Diffusion. Ipadapter Tutorial. 

Text & image guide for Patreon supporters www.patreon.com/posts/use-same-face-ip-98117124

<a href="#" class="seekto" data-time="509">8:29</a> The edit with the music is just too funny man I actually had to laugh 😂 Thank you for the tutorial! :)

I had been aware of this extension for a few days, but after looking at some other guides (and being confused) I decided to wait for yours, which as anticipated was clear, concise and comprehensive. Thanks Sebastian.

One thing nice about using Ip-adapter first, to create the base image, is that it creates a good image to use Reactor for a face swap. So if you want an image that very closely resembles yourself, just use Reactor to swap your face back on there. :)

Thanks Sebastian, I used to do this with other methods, but this way is much cleaner. 🤘

Hi sir, thank you so much for video, you always bring best tutorial stable diffusion.

Good thing this is available for SD 1.5. Not everyone is able to catch up with SDXL.

Woh ! Thanks for this very useful video, such a good job ! I'm a newbie and your videos are perfect to me. I've tried and it's amazing, even though for now all the characters in the image looks the same 😂

by the way, as usual this is a great tutorial. As I had to try reinstalling reactor I wanted to follow along with a tut to make sure I was doing it right, couldn't find yours at first, the alternative one was terrible so I persevered until I found yours which is great! You are the best!

Great tutorial as always. I laughed at <a href="#" class="seekto" data-time="526">8:46</a> 😂😂

Seems like a good way to test your input images before making a textual-inversion or lora.

It works well! Thank u :)

Awesome video once again. Here, have my sub. Absolutely love this IPAdapter thing. I only roughly knew what it does so far. That's a a game changer.

First, thanks for the video, your channel is really helpful in keeping up to date with all changes, and you explain everything very well. I've been using Reactor for a few months to generate a consistent face for a model, and I really like it. Decided to give this a try, and I was expecting to get similar results with this method (but somehow better and/or more consistent), however that's not what happened. The face swaps I'm getting with IpAdapter are very different from the results I get with Reactor, it seems like another person, which makes this method not very useful for me (at least for this particular project, which already has a strongly defined face). Is this normal? Any tips to improve? For now I will keep using Reactor, since it's giving me better results.

Nice tute Seb! Thanks

I laughed for 3 minutes 🤣🤣🤣 nice tutorial btw

Great video!

If I met you in a dark alley at night it would be a pun-ishing time for both. 🙂 I stumbled onto this through trial and error but was missing the settings to get good results. Cheers.

very good

The subtitles are really helpful!

Very strange work of the controlnet, the IP adapter V2 worked a couple of times and then began to produce completely worthless results completely different from the sample photos that I uploaded.

Nice tutorial Sebastian. But why it doesn't work with batch images? Only with single image input.

Great tutorial, 100% spot on. I'm new to SD. Is there a way to save the "outcome" of the face, so you can use it later?

its not working when i use my model face in multiple or even in single

no me impresionaba tanto, pero en la segunda generacion :O its awesome

How does this compare to reactor? that's the best one i've found, but of course always looking for something that might be better

Better than reactor? becausee that one is really good. And also much easier to setup

Finally, a really well explained Tutorial that works perfectly!

set it up exactly as he did, not even close to looking like my input images, seems to be alot of how to videos on sd, not any of them will give the same results as posted. moving on to the next one.

any tips for choosing the most adequate samples images? resolution? background? portrait angles? number of samples?

Great tutorial. Works really well with SD1.5, but with SDXL - bodies and faces seem way off and very unrealistic (despite negatives), unless it's close-up portrait facing the camera. Instant-ID gives me similar results with SDXL, not great for anything but portraits.

i got it all installed im just trying to get it to look like my photo but it comes out nothing like them XD so i gotta play around see what i did wrong , great guide tho it looks great even tho its not me XD

I've been playing with it and the main issues is the lora can drastically change your image even if you set it to lower values. Reactor isn't dead yet. 😊

wonder if this would work with SSD-1B?

for some reason I am having difficulty adding the upgraded version of controlnet to ForgeUI, anyone else having this issue? - may be conflicting due to already build in controlnet?

Can ForgeUI do multi-input? I'm trying to use batch folder and batch upload but I think they only use the first image.

Hello, thank you for the tutorial, i am using forge, i am unable to find the proper pre processor in my list or online, i have InsightFace+CLIP-H (IPAdapter) only. it isnt the same as you

Are there any requirements for the quality or type of image used as an input? Also, is the amount of input images important? I can't get any good results. At times, you can't even recognize anything at all.

Don't forget to enable your Controlnet module which very subtlety happens here. <a href="#" class="seekto" data-time="274">4:34</a> And I was just wondering why my images didn't look anything like me. 😂 Other than that, great tutorial !! Thanks! 👍

which is better ReActor or IPadapter

thanks for the video, i find it quite hard to get into SD. There are so many options, i have the feeling its overcomplicated. We need more simple ui.

Your sense of humor is making me subscribe 😅🤣😅🤣😅🤣 Of course, nice explanation as well

Hey! Thanks for this great guide! Unfortunately it doesn't work for me, just results in images of random people.

Is there a specific version of dream booth everyone uses? Mine looks very different compared to some.

thanks for your tutorial! but what can I do wehen I see this: AttributeError: 'NoneType' object has no attribute 'mode'?

Is there a way we can generate images with the same face and clothing but in different pose?

Hello Sebastian. Thank you very much for your insightfull tutorials. I started playing with SD thanks to you. I just recently installed forge as instructed in your video but how do I install IP adapter plus on forge? I did the same as in this tutorial but I dont get the proper selection for the preprocessor. I can select ip adapter plus for the model but not for the preprocessor.

I'm guessing this is not going to help for groups? I'm trying to recreate family pictures of us on the moon and more haha, does this work with the fork that uses directml for AMD GPUs? it does not seem to be taking my pictures in consideration

The faceid portrait model is even better.

can help me about sdxl training model i have a good pc with rtx 4090 but i dont know how to train xl model for my personal data

¿Cómo llegamos a la página que muestras cuando empiezas el video?

do you have the link for the said app?

How do you create a consistent body? cause I know how to do the face swap but I can't seem to get a consistent body though.

Great turtorial! but i have one problem. My stable diffusion generates 2 or more people 50% of the time. Is this a common problem?

how do i can change the ControlNet Integrade for this ControlNetv1.1.440?

I think the pre-processors name changed to InsightFace and CLIP ViT on newest Forge.

Has this been disabled? I had this working down to perfection for my face but took 4 weeks away and now it doesn't work, it just renders random guys faces even when I use all my same pics

Why Starting Control Step and Ending Control Step sometimes doesn't affect output render at all. And if I set 0.2 - 0.8 as in your example, I have zero resemblance on ref images 😂😂😂 And should I change extension of .bin to .pth? Or atm it doesn't matter? Thanks

someone help me with this solution please, when I choose the multiple option this is what appears '' loadsave.cpp:1121: error: (-215:Assertion failed) !image.empty() in function 'cv::imencode' '''

Maybe with facefusion or roop can help to reach that last step of similarity

Hello Sebastian. Thank you for sharing. I tried with Reactor and the ipadapter on SD1.5 txt2img under the same prompt (with lora when using Controlnet). When I use the ipadapter, the photo becomes so blurred like a glare covered. What parameters should I adjust?

you please show us how to merge sdxl train model with other sdxl model... like we do with sd 1.5 checkpoint merger where in A we use to put our train model on B we use to put Photon or dreamshaper and on C pruned checkpoint, and as VAE 56000 or 84000 so we want to see tutorial on SDXL

Do you know if this works with Fooocus?

How does this work in ImageToImage or Inpaint ?

How do you use ipadapter with FORGE? I tried on FORGE but the result not as good as original auto1111

Drives me crazy, I am trying and i keep getting an error Exception: Insightface: No face found in image. its like control net doesnt really do anything and i made sure its enabled, uploaded 6 photos 1000x1000 very clear face in them... any ideas?

It's great when it works, but for some reason it just stops working randomly. I don't know what causes this.

So what is the best lora?

What is the full name of the extension? Typing ControlNet gives me a billion results.

Can this somehow work with Fooocus?

My images turn out to be an absolute mess, it isn't working at all. Anyone know why? I have the same exact version of controlnet, same models, same res, same sampling method with steps and resolution. Same model, but the faces are just glitchy

how you get all foocus styles in A 1111.

Was this video re uploaded. But anyway. Could you do a video with comfy UI using this workflow?

Where's your baseball cap from? I need a new one 😊

I Followed the same steps but its not working as shown in the video the resemblence is not at all matching

im trying to use it with force but it wont see the bin files

This js amazing, can you please make a video on the new automatic 1111 forge

I'm working on ComfyUI (and SDXL) since weeks. I think i installed ReActor node just before we started to read eveywhere about ipadapter.... so i was wondering : About face swapping... Is ipadapter better than ReActor ? or is it mostly the same ? Thanks if someone here tryed them both and could answer me ! I'd like to be sure first before i decide to uninstall ReActor and choose instead the other one. And thank you for your new video Sebastian !

What's the difference between this method and the old one where we use the ReActor extension? Are there any benefits to using IPAdapter?

why it processed only one picture i added multiple pictures "ControlNet - WARNING - Insightface: More than one face is detected in the image. Only the first one will be used."

Can used it at Intel graphics？

Do we need any trigger word in the prompt for the lora we have added

I have forge UI and i dont know how to get this working. preprocessors for for Face Id dont appear

Best settings: LORA: 0.65 Guidance controlnetNet: 1.25 Keep Start 0 and end 1.0

Among all the other similar face-transfer systems (Roop, ReActor, InstantID) this one seems to give me by far the worst results. The likeness is really bad and the overall image quality is terrible.

Man, controlnet is not working at all for me. I have installed the extensions and all of its models and uploaded them and everything but stablefusion is completely ignoring it. Yes I pressed enable and did everything from the videos. Please any advice or a discord server or anyone to whom I can share screen so he can maybe see where the problem is?

I'm using forge and I don't have the face id plus preprocessor ... where can I find that and where do I put it?

What happens when you turn preprocessor to 1024 instead of 512 when using sdxl checkpoint ?

Why is my local Automatic1111 setup missing DPM++ 2M SDE Karras sampling method? I only have DpM++ 2M, first time fresh install this April 2024, someone please any ideas...

it's not better ReActor?

When I follow the steps, it starts doenloading 2.35gb file first on the following path stable-diffusion-webui\extensions\sd-webui-controlnet\annotator\doenloads\clip_vision\clip_h.pth

reactor is definitely easier and more relevant for beginners

made all the steps but still cant get the same face that I need, i even also put higher the Control Weight :( heeeeelp

Brother this is old and I say that respect. I assumed you was talking about InstantID. I hope you try that and make a video.

Speaking of owning ducks - Did you hear about the Dr. Duck who got arrested? Apparently he was a Quack

Why my result is totally different?

I use A1111 and in the controlnet it does not show me the Models beside the preprocessor. what could i have done wrong? Controlnet is 1.1.440, i restated all multiple times ... i put the folder into stablediffusion > models > stable-diffusion and extracted them

How come if I'm doing what he is doing my pictures end up looking nothing like the person...

🎖🎖

Damn dude, your tutorials are amazing! Do i need Nvidia gpu for this one ? my AMD really struggles with most of these tools.