InstantID Implementation in ComfyUI for Stable Diffusion SDXL

Подписаться 2,8 тыс.

Просмотров 14 тыс.

50% 1

Learn step-by-step how to install the InstantID implementation in ComfyUI, troubleshoot errors and workflow.
In this video I help you learn how to install the unofficial InstantID implementation in ComfyUI. We will be using Python 3.10 and creating a virtual environment to avoid dependency conflicts.
The steps include installing Python 3.10, creating the virtual environment, installing Comfy UI requirements, modifying run_nvidia_gpu.bat, deleting the models folder, creating a symbolic link, cloning the InstantID repository, installing requirements, downloading the ControlNet, IP Adapter models, installing the omegaconf dependency, and finally testing the InstantID node in Comfy UI. Timestamps are included.
I appreciate if you can like and share the video if it was helpful.
Subscribe for more content soon!
[SUPPORT THE CHANNEL]
Patreon: bit.ly/44js1Xx
Paypal: bit.ly/45lJsIg
[Resources]
Original Github Repo: github.com/InstantID/InstantID
ZHO-ZHO-ZHO Implementation for ComfyUI: github.com/ZHO-ZHO-ZHO/ComfyU...
HuggingFace Space Demo: huggingface.co/spaces/Instant...
Python: www.python.org/
Microsoft Build Tools: visualstudio.microsoft.com/do...
[SOCIAL MEDIA]
RU-vid Channel: bit.ly/47OterT
Twitter X: bit.ly/3ReP9D3
[PREVIOUS VIDEOS]
Official PhotoMaker for ComfyUI: • The Official ComfyUI P...
PhotoMaker by ZHO-ZHO-ZHO: • Exploring the New Phot...
Advanced Custom Nodes: • Advanced Custom Nodes ...
Understanding Prompting: • Understanding Promptin...
ComfyUI End of Year Updates: • End of Year ComfyUI Up...
Custom Nodes: • Create Your Own Custom...
SDXL Turbo Gradio App: • How to Use My SDXL Tur...
SDXL Turbo: • How to Use SDXL Turbo ...
Python API for ComfyUI: • Building a Python API ...
Introduction to Gradio: • Introduction to Python...
[TIMESTAMPS]
00:00:00 Introduction
00:00:40 GitHub repo for InstantID
00:01:40 Comparing previous technologies
00:02:12 Showcasing the Gradio Demo by HuggingFace
00:03:22 The ComfyUI implementation
00:03:49 Project by Zho-Zho-Zho
00:05:33 Making a backup ComfyUI installation
00:06:52 Download 7-Zip
00:07:34 Installing by following Github instructions
00:14:48 Installing ComfyUI manually
00:33:54 Symbolic Link for models folder
00:38:39 Test ComfyUI
00:39:50 Installing InstantID for ComfyUI
00:49:00 Testing InstantID and Custom Nodes
00:49:47 Making a workflow
00:54:58 Doing a test run
00:58:25 Conclusion
00:59:46 Thank you for watching and see you next time.
[TAGS]
instantid, comfyui, diffusers, ai art, install tutorial, python, virtual environment, symbolic link, controlnet, ip adapter, omegaconf, custom node
GitHub, Open Source, face generation, zho-zho-zho, Code Crafters Corner, CodeCraftersCorner
[HASHTAGS]
#InstantID #ComfyUI #Diffusers #AIArt #InstallTutorial #Python #VirtualEnvironment #SymbolicLink #ControlNet #IPAdapter #Omegaconf #CustomNode #CodeCraftersCorner

Опубликовано:

15 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 161

@WhySoBroke 5 месяцев назад

Not spamming at al!! You are doing all the hard work and providing immense value!! Forever grateful amigo!! ❤️🇲🇽❤️

@CodeCraftersCorner 5 месяцев назад

Thank you @WhySoBroke! I appreciate you continuous support.

@SebAnt 5 месяцев назад

Keep the wonderful tutorials coming Sharvin, and congratulations on reaching 1K subscribers 👏🏼👏🏼

@CodeCraftersCorner 5 месяцев назад

Thank you so much, @SebAnt! Your support, both as a long time subscriber and Patreon contributor, means a lot to me. Thank you, I'm thrilled to have reached 1K subscribers. I appreciate you being part of this journey! Your encouragement helps keep the momentum going.

@strizerquel8796 5 месяцев назад

Huge props to you for detailed video.

@CodeCraftersCorner 5 месяцев назад

Thank you, @strizerquel8796!

@matthewkolb9950 5 месяцев назад

Great information, very thorough explanations covering a lot. You explained symbolic links so well that I actually was able to switch my models folder quite easily. I love the command line tips too. Can't wait to see what you teach me next! Subbed.

@CodeCraftersCorner 5 месяцев назад

Thank you @matthewkolb9950! Glad it was helpful.

@Shisgara77 5 месяцев назад

Thank you so much for such a helpful video and breakdown of the time codes ❤

@CodeCraftersCorner 5 месяцев назад

Thank you, @Shisgara77! I am glad it was helpful.

@dgtlnative259 4 месяца назад

This video helped a lot. InstantID working now. Thank you!

@CodeCraftersCorner 4 месяца назад

Glad it helped, @dgtlnative259!

@titerote71 2 дня назад

Thanks for so detailed and informative video. Good work!

@silverstone6849 3 месяца назад

Your video helped me so much, really like the extensive explanation of each step. 😊

@CodeCraftersCorner 3 месяца назад

Glad it was helpful!

@sunlightlove1 5 месяцев назад

Oh man your explanation is really really great . very very clean and super help full . Looking forward to see more videos ❤❤❤❤

@CodeCraftersCorner 5 месяцев назад

Thank you, @sunlightlove1!

@0A01amir 5 месяцев назад

With your tutorials no one will be lost, keep up the greate work bro

@CodeCraftersCorner 5 месяцев назад

Thank you, @0A01amir! I appreciate that!

@0A01amir 5 месяцев назад

@@CodeCraftersCorner The dude behind IPAdapter Plus is making a new one for InstantID, he talk about it in "issue" page of his IPAdapter Plus github, let us hope that runs as good and fast as ipadapter

@CodeCraftersCorner 5 месяцев назад

@0A01amir, yes I am also keeping an eye on it. There is a placeholder Github repo here: bit.ly/3Ome31I

@DianneStudio 5 месяцев назад

Amazing video, its so detailed and thank you so much for your big effort and time to make this video ultra detailed explaining every commands, issues and process. amazing. cheers....

@CodeCraftersCorner 5 месяцев назад

Thank you for your kind words, @DianneStudio!

@zimnelredoran9985 5 месяцев назад

Thanks for sharing :D Keep it coming!

@CodeCraftersCorner 5 месяцев назад

Thank you, @zimnelredoran9985! Will do!

@sklad_2023 5 месяцев назад

Thank you very much for such a great job, it was only thanks to you that everything was able to get started.

@CodeCraftersCorner 5 месяцев назад

That's great to hear, @sklad_2023! Glad it worked.

@intergalacticpassenger5911 5 месяцев назад

Thank you, everything works. Very good lesson!

@CodeCraftersCorner 5 месяцев назад

Glad it helped you, @intergalacticpassenger5911!

@Gabriecielo 5 месяцев назад

Thanks for the fast try! And ZHO's implementation also broke my Comfy, reinstalled too. Looking forward to official implementation.

@CodeCraftersCorner 5 месяцев назад

Thank you, @Gabriecielo! I am also looking forward to the official implementation.

@anthonyfesce4073 5 месяцев назад

amazing he's also explaining how DOS commands are working :P great tutorial

@CodeCraftersCorner 5 месяцев назад

Glad you liked it, @anthonyfesce4073!

@MrLespola 5 месяцев назад

Bro! Thank you for a job well done!

@CodeCraftersCorner 5 месяцев назад

Thank you, @MrLespola!

@yngeneer 5 месяцев назад

Subscribed immediately! :D thx for tutor the basix. Btw I didn't install the comfyUI version, I installed just their gradio demo and the first completion takes about 100 sec (4060TI 16GB)

@CodeCraftersCorner 5 месяцев назад

Thank you so much for the support, @yngeneer! That's great. Have fun!

@djivanoff13 5 месяцев назад

You are the best of the best

@CodeCraftersCorner 5 месяцев назад

Thank you so much, @djivanoff13! Really appreciate it.

@yizhouqian5899 5 месяцев назад

Great tutorial! Thank you for the detailed instructions!

@CodeCraftersCorner 5 месяцев назад

Glad it was helpful, @yizhouqian5899!

@yizhouqian5899 5 месяцев назад

I still had an error showing the lack of "diffuser". Do you have any idea about this? Thanks! @@CodeCraftersCorner

@CodeCraftersCorner 5 месяцев назад

@yizhouqian5899 Did you invoke your ComfyUI python when installing the dependencies? Alternatively, you can manually install it by doing -m pip install --upgrade diffusers

@yizhouqian5899 5 месяцев назад

Thanks for the feedback. I have manually checked the python version as well as diffuser installation and import. Everthing appears to work properly. However, I still run into the same error code when loading InstantID. It is really strange...@@CodeCraftersCorner

@CodeCraftersCorner 5 месяцев назад

@yizhouqian5899! Hmm, if you've verified everything and still encountering the error, I not sure what else you can try. It might be best to wait for the official ComfyUI implementation. It should provide better compatibility. Hope it comes out soon for you to try.

@danieljfdez 5 месяцев назад

You do such an amazing job explaning everything! Unfortunely in my case, I ran out of memory on my RTX 3060 12 Gb VRAM. I hope there will be a refined model which will not use such amount of Vram!

@CodeCraftersCorner 5 месяцев назад

Hi @danieljfdez! Sorry to hear you could not get it to work. Yes, right now, this implementation is not optimized. Thankfully, there is another implementation is on the way using the ComfyUI module.

@rifz42 5 месяцев назад

First! 😃 thanks for this!!

@CodeCraftersCorner 5 месяцев назад

Thank you so much for the support, @rifz42! I truly appreciate it.

@MarcoAndrade00 5 месяцев назад

Amazing my friend, but too much for me haha!!! keep it up!

@CodeCraftersCorner 5 месяцев назад

Thank you for watching, @MarcoAndrade00!

@xcom9648 5 месяцев назад

Thanks, you explain everything in great detail. How long would this take to generate on a 4090 you think?

@CodeCraftersCorner 5 месяцев назад

Hello @xcom9648! I estimate it will take slightly longer than base SDXL with refiner at 50 sampling steps.

@SyncWaveAnimation 5 месяцев назад

loads of likes!

@CodeCraftersCorner 5 месяцев назад

Thank you, @SyncWaveAnimation!

@bigfisher42 5 месяцев назад

Thank you for the tutorial. It effectively allowed me to test InstantID early! I would suggest to you to skip the parts where you're teaching us a dozen times how to do a copy and paste. You're already talking about somewhat advanced stuff, I'm fairly confident your audience is familiar with 7zip and copy and paste techniques so let's move along shall we ^^ Additionally, unless I missed it, a little disclaimer at the start of the video warning about the 40+ minutes render times would have been welcome. Would be curious about what GPU model you're using too, useful info to put on your descriptions.

@CodeCraftersCorner 5 месяцев назад

@bigfisher42, Thank you for your feedback! I appreciate your suggestion to streamline the tutorial and will take that into consideration for future videos.

@AICreator1314 5 месяцев назад

I love U

@CodeCraftersCorner 5 месяцев назад

Thanks a bunch, @AICreator1314! Appreciate the love!

@PallaviChauhan91 5 месяцев назад

I just discovered your channel. Great video, explained very well. Can you make a video on hardware requirements for running stable diffusion locally, based on low med and high budget? Like explaining, what difference to expect when we upgrade to high end GPUs and what cons to consider when settling down with cheaper ones. Stuff like that. I am currently running on runpod and thinking of getting a good GPU without breaking the bank. Thanks in advance.

@CodeCraftersCorner 5 месяцев назад

Thank you for the feedback, @PallaviChauhan91! I already have a few projects I am working on but I will add it to my list. Great suggestion!

@PallaviChauhan91 5 месяцев назад

@@CodeCraftersCorner I thought with a technical background like yours you would be able to give a much better understanding of hardware rather than from a affiliate marketer on RU-vid.

@CodeCraftersCorner 5 месяцев назад

@PallaviChauhan91 Yes, added to my list of todo.

@ZakariaNada 3 месяца назад

Your the video is the best tutorial out there even better than famous RU-vidrs. I run into an issue which is the first step ID Contronet Loader won't load even though I have downloaded the models and have the correct path in place (I haven't rename the controlnet models). I couldn't perform the .venv as well. Any advice?

@CodeCraftersCorner 3 месяца назад

Thank you for watching, @ZakariaNada! Try to follow this tutorial. It's my updated video on InstantID. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-_8iElCxHg-c.html

@PixelsVerwisselaar 5 месяцев назад

😂 You the best spammer sir. Thanks for the updates 😎👌

@CodeCraftersCorner 5 месяцев назад

Thank you, @PixelsVerwisselaar!

@PixelsVerwisselaar 5 месяцев назад

@@CodeCraftersCorner 💪

@CodeCraftersCorner 5 месяцев назад

👍

@rykk 5 месяцев назад

Great tutorial! Unfortunately I got this error "Error occurred when executing IDBaseModelLoader_local: HIP out of memory" is there a way around that? Or I just need a card with more vram?

@CodeCraftersCorner 5 месяцев назад

Thank you, @rykk! Yes, with this implementation, the out of memory error is quite common. There is a new implementation of InstantID on the way which will follow ComfyUI convention. I suggest waiting for it before investing into a new card.

@Paulo-ut1li 5 месяцев назад

That's for sure the most complicated nodes to install in comfyui. I don't understand why zho-zho nodes are so complicated to run, it always breaks the regular version of comfyui and forces us to reinstall the env python version to run it. It's not a feasible thing if you're willing to work with other comfy ui nodes that depends on newer versions of python. I'm just using another node from huxiuhan and it run with the regular Comfy portable.

@CodeCraftersCorner 5 месяцев назад

Hi @Paulo-ut1li, I appreciate your feedback. I think the intention behind its implementation was to offer early access and a quick solution. The ZHO nodes do not use the ComfyUI API and instead are just a wrapper to allow using the original diffuser code. This is relative fast to implement at the cost of the inconveniences you mentioned. I will give the other node you mentioned a try.

@a.akacic 5 месяцев назад

because he wants to limit your freedom in Comfy, and lock down everything in his own node It's a shit extension and many others are rerouting this shit work into better function nodes that dont lock down other passthroughs.

@CodeCraftersCorner 5 месяцев назад

@a.akacic, Thank you for sharing your perspective.

@silverstone6849 3 месяца назад

Hi, thanks for this tutorial, but I have a question about the manager button, why in this video there's no "manager" and "share" button under "load default" button? Because mine also doesn't have, but many other videos they have those buttons

@CodeCraftersCorner 3 месяца назад

Hello @silverstone6849! You will need the ComfyUI Manager. I made a video on how to install it here: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-qKO6pZAv0jM.html

@silverstone6849 3 месяца назад

@@CodeCraftersCorner oh thank you very much for your reply, I'll check it out😁

@CodeCraftersCorner 3 месяца назад

@silverstone6849 👍!

@satishpillaigamedev 4 месяца назад

hi i have issue installing artgallery & gemini custom nodes, after installing the comfyui UI not working

@CodeCraftersCorner 4 месяца назад

Hello @satishpillaigamedev! There is a version available. I am editing the video. It should be up by early next week.

@zhoobinnourian 5 месяцев назад

hi, thank for the great tutorial. I'm getting an error with onnxruntime when I choose GPU for InsightFace Loader. However with CPU it works fine. here's the error message : CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page , make sure they're in the PATH, and that your GPU is supported.

@CodeCraftersCorner 5 месяцев назад

Thank you @zhoobinnourian! Yes, some CUDA version may not be compatible with onnxruntime-gpu. Choosing CPU is the correct choice here. The developer note's section provides more information here: bit.ly/48VHCzN

@lilillllii246 4 месяца назад

Thanks. I ran it, but I keep getting this message "Error occurred when executing LoadImage". What should I do?

@CodeCraftersCorner 4 месяца назад

Hello @lilillllii246! Can you try with a different image? You can also try removing (deleting) the LoadImage node and add it back again.

@modzha2011 5 месяцев назад

I got this error when executing the insightface node: Error occurred when executing IDGenerationNode: StableDiffusionXLControlNetPipeline.check_inputs() takes from 5 to 14 positional arguments but 15 were given Have no idea how to fix it...

@CodeCraftersCorner 5 месяцев назад

It seems there is a model mismatched between your controlnet model and your checkpoint. Can you try with the load model from hub node?

@imranl8742 5 месяцев назад

Hey Bro, is it worth building a live product with this? can think of some good use for customers? Your thoughts?? Great Video!!!

@CodeCraftersCorner 5 месяцев назад

Hey @imranl8742! I would recommend waiting for the official ComfyUI InstantID implementation. This version is in early access, uses a significant amount of VRAM (14-18 GB), and has compatibility issues with certain models. Keep an eye out for updates! Glad you liked the video!

@imranl8742 5 месяцев назад

@@CodeCraftersCorner thanks for the heads up!

@imranl8742 5 месяцев назад

Quick question you do freelance work? thanks

@CodeCraftersCorner 5 месяцев назад

Sure, open to the opportunities if my workload permits.

@user-kk2ve1un4u 5 месяцев назад

@CodeCraftersCorner what is the difference between InstantID , PhotoMaker & IPadapter ? , I got confused between all of these 🤔

@CodeCraftersCorner 5 месяцев назад

Hi @user-kk2ve1un4u! All three of them are techniques to generate images from a face input image in different styles and poses. They will do the same thing but give you slightly different results. IPAdapter has other uses like it can grab style from an input image and transfer it to the output image. To my knowledge, PhotoMaker and InstantID cannot transfer styles.

@user-kk2ve1un4u 5 месяцев назад

Thanks a lot @@CodeCraftersCorner

@CodeCraftersCorner 5 месяцев назад

You're welcome!

@user-kk2ve1un4u 4 месяца назад

my GPU is Nvidi RTX 3080 and I got an out of memory as shown below , do you know a solution for it ?. torch.cuda.OutOfMemoryError: Allocation on device 0 would exceed allowed memory. (out of memory) Currently allocated : 12.66 GiB Requested : 1.56 GiB Device limit : 16.00 GiB Free (according to CUDA): 0 bytes PyTorch limit (set by user-supplied memory fraction) : 17179869184.00 GiB

@CodeCraftersCorner 4 месяца назад

Hello @user-kk2ve1un4u! I suggest trying the new version. Here is the link: bit.ly/3Ome31I. Hope this one works.

@PyruxNetworks 5 месяцев назад

it is taking like 14gb during generation but at last step causing a 18-19gb vram usage spike. May be its better to wait for official implementation.

@CodeCraftersCorner 5 месяцев назад

Thanks for sharing your experience, @PyruxNetworks! Yes, the VRAM requirement is challenging. Waiting for the official implementation is a better option. Appreciate the support.

@JackTorcello 5 месяцев назад

Help! AttributeError: 'StableDiffusionXLInstantIDPipeline' object has no attribute 'dtype'

@CodeCraftersCorner 5 месяцев назад

Hello @JackTorcello, the only suggestion I found on the topic is "Try to upgrade diffusers to version 0.25.0". The developer has not responded on the issue.

@hudaicihandurmus5414 5 месяцев назад

Thanks again for a very detailed and explanatory tutorial. I did everything you did to the letter, however. ModuleNotFoundError: No module named 'diffusers' Cannot import C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-InstantID-ZHO module for custom nodes: No module named 'diffusers' Import times for custom nodes: 0.0 seconds (IMPORT FAILED): C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-InstantID-ZHO I get a module could not be found error so it cannot be imported. I would appreciate if you can help me where I may be making a mistake.

@sittingmadman 5 месяцев назад

got the same problem: No module named 'diffusers'

@CodeCraftersCorner 5 месяцев назад

Hi @hudaicihandurmus5414! To troubleshoot, please follow these steps: 1. first check if you have the correct requirements.txt file in the ComfyUI-InstantID-ZHO custom node folder. (Go into ComfyUI > Custom Node > ComfyUI-InstantID-ZHO > Open the requirements.txt file). Check and make sure "diffusers" is in the file. 2. Next go to your ComfyUI root folder (where there is the run_cpu.bat and run_nvidia_gpu.bat) file. Open the CMD from this folder by going into the address bar, type CMD and press Enter. 3. Run the command (without quotes) ".venv\Scripts\activate" 4. This will activate the virtual environment. 5. type in "cd ComfyUI\custom_nodes\ComfyUI-InstantID-ZHO" and press Enter 6. This will change directory to ComfyUI-InstantID-ZHO. 7. type in python -m pip install -r requirements.txt 8. press enter. 9. This will install diffusers. A common mistake is not activating the virtual environment and installing the requirements file in the wrong directory. Before running the command, make sure that in the terminal, it says (.venv) at the beginning. If not, do steps 2 and 3 again.

@CodeCraftersCorner 5 месяцев назад

@sittingmadman, please see the response above.

@lilillllii246 4 месяца назад

Error occurred when executing ApplyInstantID:'embedding' ==> I'm getting this error message, does anyone know how to fix it?

@CodeCraftersCorner 4 месяца назад

Hello, @lilillllii246! There's a new version of InstantID now.

@SheRoMan 5 месяцев назад

Any idea how to fix? Error occurred when executing Ipadapter_instantidLoader: 'StableDiffusionXLInstantIDPipeline' object has no attribute 'dtype'

@CodeCraftersCorner 5 месяцев назад

Hello @SheRoMan! Are you perhaps using the load model locally node? Can you try with the load model from hub node? It seems like there is a mismatch with your model and the ip adapter model.

@SheRoMan 5 месяцев назад

@@CodeCraftersCorner okay thanks

@SheRoMan 5 месяцев назад

@@CodeCraftersCorner now i'm getting this error 🥲 Error occurred when executing IDBaseModelLoader_fromhub: Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install accelerate` BTW I install all the requirements.txt as you showed in video with no errors

@CodeCraftersCorner 5 месяцев назад

Maybe a compatibility issue. Try adding 'accelerate' to the requirements.txt file and reinstalling. If the problem persists, you might want to wait for the native ComfyUI-InstantID project. Here's the link for reference: bit.ly/3Ome31I

@SheRoMan 5 месяцев назад

@@CodeCraftersCorner Thank You

@MrTeddi100 4 месяца назад

Error occurred when executing PreviewImage: 'str' object has no attribute 'shape'

@CodeCraftersCorner 4 месяца назад

Hello, @MrTeddi100! This happens when insightface cannot detect a face. You can use the prepare image for insight face node. Here is a link to the solution: bit.ly/4c48GP5

@krupnikova 5 месяцев назад

Error occurred when executing Ipadapter_instantidLoader: 'StableDiffusionXLInstantIDPipeline' object has no attribute 'dtype' File "C:\ComfyUI\ComfyUI\execution.py", line 155, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI\ComfyUI\execution.py", line 85, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI\ComfyUI\execution.py", line 78, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI\ComfyUI\custom_nodes\ComfyUI-InstantID\InstantIDNode.py", line 191, in load_ip_adapter_instantid pipe.load_ip_adapter_instantid(face_adapter) File "C:\ComfyUI\ComfyUI\custom_nodes\ComfyUI-InstantID\pipeline_stable_diffusion_xl_instantid.py", line 156, in load_ip_adapter_instantid self.set_image_proj_model(model_ckpt, image_emb_dim, num_tokens) File "C:\ComfyUI\ComfyUI\custom_nodes\ComfyUI-InstantID\pipeline_stable_diffusion_xl_instantid.py", line 174, in set_image_proj_model self.image_proj_model = image_proj_model.to(self.device, dtype=self.dtype) ^^^^^^^^^^ File "C:\ComfyUI\python_embeded\Lib\site-packages\diffusers\configuration_utils.py", line 137, in __getattr__ raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'")

@CodeCraftersCorner 5 месяцев назад

Hi @krupnikova! It seems like there is a mismatch between the checkpoint and the ipadapter model. Are you perhaps using the load model locally node? If so, can you try with the load from hub node? If this does not work, you may have to wait for the official implementation as it will provide better compatibility.

@musty5551 5 месяцев назад

Did anybody run this on 12GB GPU? Whats the time?

@CodeCraftersCorner 5 месяцев назад

Have you tried the PhotoMaker implementation by ZHO? InstantID takes a little more than twice as much time as PhotoMaker. It can give you a rough estimation.

@JackTorcello 5 месяцев назад

There seems to ba a bug - people using 16Gb VRAM (mine is 8Gb VRAM) - are getting this ERROR, as am I Error occurred when executing Ipadapter_instantidLoader: Allocation on device 0 would exceed allowed memory. (out of memory) Currently allocated : 16.00 GiB Requested : 5.00 MiB Device limit : 8.00 GiB Free (according to CUDA): 0 bytes PyTorch limit (set by user-supplied memory fraction) : 17179869184.00 GiB Win 10, 64Gb, RTX 2070 (using either CUDA or CPU setting)

@CodeCraftersCorner 5 месяцев назад

@JackTorcello Yes, there seems to be a bug.

@johnlenoob6951 5 месяцев назад

Spam my friend !!! Thanks

@CodeCraftersCorner 5 месяцев назад

Thank you, @johnlenoob6951!

@itsmenord1993 4 месяца назад

"You do not have sufficient privilege to perform this operation." 37:08 how can I grant this permission?

@CodeCraftersCorner 4 месяца назад

Hello, @itsmenord1993! You can skip this step and manually copy the checkpoints to the correct folder. Your system may require administrative rights.

@praneethsingh7109 Месяц назад

any idea please help !

@CodeCraftersCorner Месяц назад

Most likely, your credentials are no longer valid. If you are using SSH, then go to GitHub and set up a new one or you can try this in the terminal: git config --global user.email "you@example.com" git config --global user.name "Your Name" You can go to this page for more info: docs.github.com/en/authentication

@praneethsingh7109 Месяц назад

@CodeCraftersCorner thanks for the reply, bro . I've tried this option also, but it says fatal: unable to access could not resolve host: socks I've reinstalled Comfy. Is that a all in one solution. like reinstall windows or some simple solution.

@CodeCraftersCorner Месяц назад

@praneethsingh7109 in that case you can download the project as zip from GitHub and extract it manually into ComfyUI folder. Not sure why the error. You may have to reinstall Git.

@filmyentity 5 месяцев назад

Despite doing step by step the model failed to load..... error - 0.8 seconds (IMPORT FAILED): D:\Stable Diffusion ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-InstantID

@CodeCraftersCorner 5 месяцев назад

Sorry to hear that it did not work, @filmyentity! You may want to create an issue in the Github repo to let the developer know.

@RahulGupta1981 5 месяцев назад

Getting this error Error occurred when executing InsightFaceLoader_Zho: [ONNXRuntimeError] : 7 : INVALID_PROTOBUF : Load model from D:\000AI\00ComfyUI\ComfyUI\custom_nodes\ComfyUI-InstantID\models\antelopev2\1k3d68.onnx failed:Protobuf parsing failed. File "D:\000AI\00ComfyUI\ComfyUI\execution.py", line 155, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\000AI\00ComfyUI\ComfyUI\execution.py", line 85, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\000AI\00ComfyUI\ComfyUI\execution.py", line 78, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\000AI\00ComfyUI\ComfyUI\custom_nodes\ComfyUI-InstantID\InstantIDNode.py", line 71, in load_insight_face_antelopev2 model = FaceAnalysis(name="antelopev2", root=current_directory, providers=[provider + 'ExecutionProvider',]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\000AI\00ComfyUI\python_embeded\Lib\site-packages\insightface\app\face_analysis.py", line 31, in __init__ model = model_zoo.get_model(onnx_file, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\000AI\00ComfyUI\python_embeded\Lib\site-packages\insightface\model_zoo\model_zoo.py", line 96, in get_model model = router.get_model(providers=providers, provider_options=provider_options) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\000AI\00ComfyUI\python_embeded\Lib\site-packages\insightface\model_zoo\model_zoo.py", line 40, in get_model session = PickableInferenceSession(self.onnx_file, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\000AI\00ComfyUI\python_embeded\Lib\site-packages\insightface\model_zoo\model_zoo.py", line 25, in __init__ super().__init__(model_path, **kwargs) File "D:\000AI\00ComfyUI\python_embeded\Lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 419, in __init__ self._create_inference_session(providers, provider_options, disabled_optimizers) File "D:\000AI\00ComfyUI\python_embeded\Lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 452, in _create_inference_session sess = C.InferenceSession(session_options, self._model_path, True, self._read_config_from_model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ please help

@RahulGupta1981 5 месяцев назад

1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\000AI\00ComfyUI\python_embeded\Lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll" how to solve this error

@CodeCraftersCorner 5 месяцев назад

Are you perhaps running on CPU? There a dependency which requires GPU, onnxruntime-gpu. You can try to re-install from scratch. When you reach the step to install dependencies for ComfyUI-InstantID-ZHO, modify the requirements.txt file. Change onnxruntime-gpu to onnxruntime and then do the python -m pip install -r requirements.txt.

@RahulGupta1981 5 месяцев назад

@@CodeCraftersCorner I have a machine with RTX 4070

@RahulGupta1981 5 месяцев назад

running this command python.exe -m pip install onnxruntime-gpu will solve?

@CodeCraftersCorner 5 месяцев назад

hmm, in that case, can you make sure that you have downloaded and replace the 1k3d68.onnx placeholder file with the correct model? It should be around 137mb in size.

@mehradbayat9665 5 месяцев назад

Hello Sharvin, I don't know if my comment keeps getting deleted or I can't see it, anyway, I was wondering if you offer pair programming/tutor services. I am looking for 4 hours/twice a week, it would amount to $120/week, but I can negotiate if you are interested. You are an excellent teacher, would love to discuss further.

@CodeCraftersCorner 5 месяцев назад

Hello Mehrad, Thank you so much for your kind words. I'm open to discussing the details further. Could you please send me an email at CodeCraftersCorner@gmail.com, so we can discuss the details; schedule, pricing, and any other specific requirements you may have.

@JustMaier 5 месяцев назад

If it takes 41 minutes generate an image you might as well just train a Lora or two of yourself in that time…

@CodeCraftersCorner 5 месяцев назад

You are absolutely right, @JustMaier! With this implementation of InstantID, it is better for me to use other techniques.

@andychang9529 5 месяцев назад

ERROR:root:!!! Exception during processing !!! ERROR:root:Traceback (most recent call last): File "E:\ComfyUI\execution.py", line 155, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "E:\ComfyUI\execution.py", line 85, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "E:\ComfyUI\execution.py", line 78, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "E:\ComfyUI odes.py", line 1415, in save_images full_output_folder, filename, counter, subfolder, filename_prefix = folder_paths.get_save_image_path(filename_prefix, self.output_dir, images[0].shape[1], images[0].shape[0]) AttributeError: 'str' object has no attribute 'shape' 😂😂😂

@andychang9529 5 месяцев назад

Sorry, I solved the problem by restarting my computer, 🤣🤣🤣🤣and by the way, you are really awesome

@CodeCraftersCorner 5 месяцев назад

Glad you were able to solve it, @andychang9529!

@andriiB_UA 5 месяцев назад

too lOOOOOOOOOOOOOOOOOng wait for image :(

@CodeCraftersCorner 5 месяцев назад

Yes, @andrewq7125! Waiting for an optimized implementation.

@tommymarcetta9571 5 месяцев назад

you need to stop overexplaining EVERYTHING makes it so painful to spend 2minutes waiting for a cmd command

@CodeCraftersCorner 5 месяцев назад

Thank you for sharing your perspective, @tommymarcetta9571! While you may already be familiar with certain aspects, I aim to help a diverse audience with varying level of expertise. The intention is to ensure that everyone, regardless of their familiarity with the topic, can follow along. I appreciate you feedback and will consider ways to balance the level of detail in the future videos.

@PeterChen-zx3ni 5 месяцев назад

I got this error when executing the insightface node: onnxruntime.capi.onnxruntime_pybind11_state.InvalidProtobuf: [ONNXRuntimeError] : 7 : INVALID_PROTOBUF : Load model from D:\Projects\stable-diffusion\execution\ComfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-InstantID\models\antelopev2\1k3d68.onnx failed:Protobuf parsing failed. Have no idea how to fix it.

@CodeCraftersCorner 5 месяцев назад

Hi @PeterChen-zx3ni! Can you try to re-download the 1k3d68.onnx model? Then replace the current one with the newly downloaded one and try again.

@JackTorcello 5 месяцев назад

Getting stuck at this Error occurred when executing InsightFaceLoader_Zho: File "B:\ComfyUI\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "B:\ComfyUI\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "B:\ComfyUI\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "B:\ComfyUI\custom_nodes\ComfyUI-InstantID-ZHO\InstantIDNode.py", line 71, in load_insight_face_antelopev2 model = FaceAnalysis(name="antelopev2", root=current_directory, providers=[provider + 'ExecutionProvider',]) File "C:\Users\john_\AppData\Local\Programs\Python\Python310\lib\site-packages\insightface\app\face_analysis.py", line 43, in __init__ assert 'detection' in self.models

@CodeCraftersCorner 5 месяцев назад

Hello @JackTorcello, the only suggestion I found on the topic is "Try to upgrade diffusers to version 0.25.0". The developer has not responded on the issue.

@JackTorcello 5 месяцев назад

I get this ERROR - Win 10, RTX 2070 8Gb VRAM - cannot import name 'id_tensor_storage' from 'transformers.pytorch_utils' (C:\Users\john_\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\pytorch_utils.py) - Error occurred when executing IDBaseModelLoader_fromhub

@JackTorcello 5 месяцев назад

The answer:- pip install peft==0.5 and ReStart ComfyUI

@CodeCraftersCorner 5 месяцев назад

@JackTorcello Thank you for posting the solution!