InstantID for Automatic 1111 

Finaly we can have some of our sanity back with A1111. Comfy ui was driving us all nuts.

Love your videos. I've only just got into all of this and find 1111 much more accessible as a beginner. ComfyUI is the end goal, but I'm glad you're still covering 1111 tips, too!

YESSSSSS!!! Finally another A1111 video. We don't do COMFY-roun-heya!

thank you for doing automatic 1111 stuff again

I can't get into comfyui rn, so this is very welcome. I'll get a Linux setup first for comfyui

using only the first controlnet works the second one is just to give exact pose as the image. you can also use a diffrent pose image in the second controlnet and a face in the first, you can also use open pose instead

Thank you so much for doing these in Automatic as well. You are always awesome mate🧡

Don't normally comment on your vids but always watch. Thank you for your great, quick, to the point videos. You are one of my go to whenever I am looking to delve into something new.

i was waiting for thisss....Thank you !!!

Thanks for the extremely useful videos as always. I tried to follow the discussion on the Github repo for the A1111 extension and failed to get it working correctly, but your video made it a breeze.

Thank you for always explaining in an easy-to-understand manner!!!!

I think the 2nd controlnet doesn't have to be the same image, can put any image in there that is sort of used as a pose, basically takes the position of the face. Something that also helped the speed was going into A1111 settings and set the controlnet model cache size to 2 instead of 1. Sadly I guess this doesn't work with normal hiresfix but it seems to work with Kohya hiresfix although I don't have much experience with Kohya's version.

Don’t forget to set Controlnet cache in A1111 settings to “2” for cache each controlnet model that we are using. It will make rendering so much faster after first run. 😊👍

@OlivioSarikas, that's great! The current ComfyUI nodes for Instant ID are very restrictive, because you can't connect loras or others ControlNets to the pipeline. I wonder why the that A1111 extension is more flexible and the current comfy UI nodes are not.

Wake me up when there is a version for SD 1.5^^

It's very helpful for me thanks for the amazing content ❤❤❤

Always Love your videos as they are informative and fun to watch. BTW.. why do you have 2 ControlNets? ControlNet and sd-webui-controlnet?

Hi Olivio :-) Finally for A1111 - thanx for the Video. But pls help me.... is this nice tool for restyle only or is it also possible to use it as a reactorlike tool? which means - more complex compositions beyond a portrait?

Thank you to explain to me because I had no clue Now I try to do it

Does this work for forge? I do not have the instant id face keypoints preprocessor and I did your methods. Also another yourtuber who is trying to do the exact same thing as you recommends using instant id embedding..very confusing why to preprocessors for same thing. Which one is better?

Is this an alternative to making a LORA and does it include the body?

Excelent video ⭐❤

not using automatic1111 for a loooong period of time and I DO not REGRET it !!!

so this won't work on models based on SD 1.5 then?

This looks so amazing! Just wish not so complex to set all up

Hi, I doiwnlowaded the two files and renamed as required... but Auto1111 doesnt recognize the Instant... file. It does recognize the other one (adapter) the name I already checked is correct, it is a safetensors file, what do you think could be the problem? Thank you!!

Should teh files that i am rename be still .bin files, or do i change them to .pty ?

I don't know if I'm doing something wrong, but for some reason, I'm not liking this InstantID compared to FaceID sdxl + IPadapter Plus Face sdxl (0.2 weight). Not only it is more resource heavy, but also achieves less likeness to the person in the photo (it works somewhat, but not as well as I would like). I really want this InstantID to work for me, but for now, I'll have to stick to other one.

Hey Olivio, great video as always, but one question - when I download those two models and rename them, what extensions should they have - .ckpt, .saetensors, or no extension? Just cannot get this to work and want to eliminate any problem I can.

Thanks, wonderful.

could you please tell me what gpu you are using ?

Thanks for youre good videos!

Once I get more RAM I'll be rocking so much with the SDXL

i just updated controlnet and now i have a error "attributeerror 'nonetype' object has no attribute 'values'" please someone help

When I do this in Auto1111, nothing happens with the controlnet. It just generates an image without anything to do with the Control0 and 1 images.

Love it, thanks so much! It's insanely slow on my end. 60+ seconds / iteration, regardless of SDXL Turbo or not. I am using an older RTX 2080 Ti 11GB and am fine with any other types of image generations with or without ControlNet. Is Instant-ID that hungry?

Olivio, many thanks! I am now experimenting and comparing the results with those generated by the gradio demo on huggingface. The "IdentityNet strength" seems very much related to the ControlNet0 weight. Do you happen to know what is related to the "Image adapter strength"? It does not seem corresponding to ControlNet1 weight, as on the demo I am not even using the optional pose image!

you seem to have the model ip-adapter_instant_id_sdxl and control_instant-id .....i have both the id preprocessors but neither of the models came with controlnet update that you showed, can you tell me where to dl the models and place them?

Great news -InstantID in A1111 - but how to use openpose with that? - right now I get only 1:1 portraits like the input image...

Bit confused with how both the ending control steps work

Does fooocus have this feature ?

thought you forgot about us a1111 users!

Why can't you use this for commercial use when you can use it offline? How would somebody be able to tell what you used to create a specific image? (Just asking for interest reasons - I'm not using any AI tools, and I'm not planning to use any AI image generator in the future, but I'm genuinely curious about this). Thank you!

Good, very good video

Hey, need to know why all SDXL based Checkpoints takes too much time as compared to like picXreal and other checkpoints.

Thanks!

What about Inpainting? Can it work with a masked image? It doesn't seem to be ready for that, right?

Hi Oli !!! Can you make a video explaining how to install xformers in the recent Stable Diffusion A1111, the videos i found are old, and find people saying they got errors installing xformers with the old methods in recent updates. Thanks!

Thank you for this video, this is super nice. I tried doing this, everything works but it takes 3min to make one image at 512x512 resolution. Is this normal? I am using TurboDiffusion model.

Exciting Matt! Thank you 🔥🔥🙏🔥🔥

You also can do this with FaceID through IP-Adapter (working also for SD1.5) can't post link because message will be deleted

How to get rid of the fact that instant id constantly changes the direction of the eyes, the eyes always look either down or sideways. In promt I always specify looking at the camera, but it doesn't react

Can you share the prompts you used for the various samples?

It works but the final image is totally burn out... any ideas?

It's very nice but why just for XL models?! SD1.5 is more popular and usable right now. Hope for SD1.5 soon

I have better results with ReActor :D , Love your videos Olivio!

waiting for SD1,5 version

automatic1111

can you provide with feedback I follow the process to istall instan ID but in the gui do not show the instantID radio selection in controlnet

There's a reason why you didn't try a further away subject, isn't it?

InstantID for Automatic 1111, it didn't work, it doesn't generate my face, it turned everything on and updated, who can help?

i need those wildcards!

So if i made a character and want its face i just use this and have the same face?

May I use this tools to edit the photograph instead of changing the image look ?? For example change the cloth or the haristyle ?

i can't seem to get this working on forge. do you have a video for that?

Just fyi to everyone don't change the file extensions! Just the names.

Do u recommend replacing turbo model u used with the "sd_xl_base_1.0"? Does it have same data like the base and is also 'turbo'?

Is anybody else experiencing a pretty hefty slowdown with this? I can generate an image with a turbo model in a few seconds, but with this CN it seems to take forever. (Around 5 mins each image) Is this normal?

Hi everyone, I would need your help to understand my mistake, after downloading and changing the 2 names of the models... I don't have instant_id_face embedding but I have the choice of instant face (instant id) Can you help me! How do I fix this? A HUGE thank you! :D

I tried this, but a lot of the generated images come out blurry or looking very low res. Did you encounter these issues as well?

is it better than ip_adapter_plus_face_v2?

Huh, I was placing the image I wanted to place the face on in my second controlnet - had to experiment a bunch but was able to get the result I wanted - my face in controlnet 0 merged with a diffused version of the image in controlnet 1. Was this the incorrect use?

can it be combined with open pose?

it's not doing anything for me, i wonder if the model or something is corrupted, since i did have some stutters on the download... otherwise i dunno. The process is straightfoward, just another model for controlnet, only with two tabs... i don't understand why its not working

Is there a workflow in confyui?

This just takes forever even with turbo, and the likeness isn't that great. With ipadapter faceid portrait, I get much better likeness in less than 10 seconds.

I heard that the instantid uses like 20 GBs of vram

How do you get the instant id tab in A1111 control net when update does not show it and how do you get the preprocessor for instant id to show up? still not working :/

fair warning this is using the inside face technology so you can't use this in a commercial way ... what do you mean by this? who can stop me if i do use face recreated using this in a commercial way?

Can it work on furry?

I do not understand the benefits of this now compared to IMAGE2IMAGE with the A1111 controlnet solution? If i add a picture to image2image and use style lora or add a prompt style it also looks like the character in that style? I thought with instandID i can use a picture and use the character then consistent in all angles front side and it looks always identical so i can create a story then like a comic and the character always looks 100% identical? Face,clothing and so on. Can i i use this Instant ID Character to work with that other than adding a style? I also want to create face textures with AI to create unity models and for that i need 1 pic close shot front (exact matching angle ) as the video shows from minute 3:21 on 1pic close shot from side left ( exact matching angle ) 1 pic close shot from side right ( exact matching angle ) In high resolution which is impossible using a LORA which creates multi angles in "one pic". The output cannot be used if you cut these out and add it to a mesh due to its low res. I need two, better three single created pictures of same "identical" face at least front and side angle in best possible resolution. So can Instant ID do this now finally in AI World to keep the person as it is?

Is it normal for an RTX 3070 with 8GB VRAM to generate an image in about 4 minutes?

Olá Olivio tudo bem amigo? Se me permite a sugestão, faça um vídeo falando desse modelo, o Turbo Diffusion XL Turbo, achei ele fantástico, faz um vídeo de com dicas para fotos, animes,vetores,logo e etc.. para o AUTOMATIC1111, abraços e feliz 2024 atrasado kkkk

I can't get the ComfyUI version to install correctly. Keeps saying Import Failed (w/ Manager and GitHub Pull)

Auto1111 is best. Comfy ui is made by 16 yr old who had nightmare 😂 it confuse everyone

👋

InstantID Portable more fast

This will be very slow by default! You need to go to settings > uncategorized > ControlNet and set Model cache size to 2 or greater. Otherwise, every image generation will swap a controlnet out of memory. Now you have normal speed.

is it work at Comfy UI?

It takes forever to generate an image lol

Meh

slow....

I'm sure, if a little more effort was applied, that the whole process could be even more long winded; I think I'll wait for grown-up program.....

People are still using A1111?!?!