Тёмный

Attention Masking with IPAdapter and ComfyUI 

Latent Vision
Подписаться 22 тыс.
Просмотров 42 тыс.
50% 1

Exciting new feature for the IPAdapter extesion: it's now possible to mask part of the composition to affect only a certain area... And you can use multiple masks for a perfect result. This and much more directly from the developer of the ComfyUI Extension.
You can find a few workflows in the examples directory of the ComfyUI_IPAdapter_Plus extension: github.com/cubiq/ComfyUI_IPAd...
More complex workflows (just download the json format):
Masked conditioning: pastebin.com/DjYg6jMC
Complex Masked conditioning: pastebin.com/PsD13EVK
RGB Masking: pastebin.com/jBB9cAn2
00:00 Intro
00:21 Weight types
02:51 Attention Masking
05:17 Multiple Masks
08:57 Mask Conditioning
10:48 Conclusions
🎵 Background Music
-- "Part A" by Alexander Nakarada (www.serpentsoundstudios.com)
Licensed under Creative Commons BY Attribution 4.0 License
-- "White Gold" by Karl Casey @ White Bat Audio (whitebataudio.com/)
-- "CyberPunk City" by Peritune (peritune.com/)

Опубликовано:

 

6 июл 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 238   
@latentvision
@latentvision 7 месяцев назад
I want to thank everybody for taking the time to write compliments and words of encouragement. I really do appreciate all of them and they honestly motivate me in releasing more videos. Let me know if there are topics you'd like to see covered and thank you all again!
@EH21UTB
@EH21UTB 7 месяцев назад
These are fantastic videos. I am wondering if there is a way to use IPadatper to only transfer color pallet or other facets of an input image (but not the whole). I think for SD 1.5 there is a way to take only the color pallet with the t2iadapters but not with SDXL - maybe you know of a way?
@latentvision
@latentvision 7 месяцев назад
I don't think there's a color controlnet yet for SDXL but you can use img2img with a certain grade of success. Set the colors how you want them laid out with a paint software then use that reference image as base for your img2img with a very high denoise. That should kinda work.@@EH21UTB
@LouisGedo
@LouisGedo 7 месяцев назад
👋
@ruizhu7140
@ruizhu7140 2 месяца назад
​ @LouisGedo Thank you so much for all you efford.Actually I am trying to make a flow in order to let a model wear some specific cloth provided as a picture. I tried lots of times, but the clothe weared by the model generated by the flow always different with the one I provided. I really want to understand how to do it . can you please explain about this .
@jacobharvey1004
@jacobharvey1004 7 месяцев назад
You're such a great example of an open source dev. Always listening to feedback and working with the community.
@ttul
@ttul 7 месяцев назад
I’ve finally gotten into IP Adapter. Combining it with depth and pose control nets and ReActor face swap yields incredible results. For instance, I took photos of my parents and photos of vintage Christmas cards and produced a nice vintage style Christmas card that looks like them as a gift.
@marshy..
@marshy.. 7 месяцев назад
Could you please share your workflow? Must appreciated
@checkmate559
@checkmate559 3 месяца назад
Bro I need to talk with u can u share ur insta id
@nocturne3455
@nocturne3455 7 месяцев назад
IPA Plus has been the most game changing thing I've found yet. It's capabilities are insane. Can't ask for much more.
@enthuesd
@enthuesd 7 месяцев назад
Overnight Latent Vision becomes top SD instructor
@heyitsjoshd
@heyitsjoshd 7 месяцев назад
The merge of styles is insane!
@latent-broadcasting
@latent-broadcasting 7 месяцев назад
I just tested it and it's amazing! The results are impossible to obtain with a normal prompt, this bring so many possibilities. Thanks a lot for your videos!
@8959890
@8959890 7 месяцев назад
This is just mind blowing at this point. I'm really really glad I came across you (and IPadapter) in my AI learning path!
@ooiirraa
@ooiirraa 7 месяцев назад
There's not that many videos yet on your channel, but every video is a diamond. One of the most interesting and valuable content I've met on youtube so far. Thank you VERY much for what you are doing.
@testales
@testales 7 месяцев назад
A wizard in action! :) So this is how you are supposed to work with masks! I had to pause this video several times, so much information in such a short time, well done, very useful!
@mr2ti41
@mr2ti41 7 месяцев назад
You’re now my #1 RU-vidr for ComfyUI . Your channel deserves so much more subs - And it will!!!
@WhySoBroke
@WhySoBroke 7 месяцев назад
Matteo il MAESTRO!!! Many thanks for the great latent wisdom you give us!! ❤️🇲🇽❤️
7 месяцев назад
I am grateful...
@CesarKonn
@CesarKonn 7 месяцев назад
that's beautiful, that's exciting. exquisite, incredible work! you are very honored. Thank you very much for everything, a great mind. you have no idea how many people you're helping, making our projects more fun, easier and better!
@YaBoyTwiz
@YaBoyTwiz 7 месяцев назад
Hey there! I rarely comment on videos, but I feel compelled to express my appreciation for your unique approach. Unlike many creators who merely guide us to mimic their actions, you delve deeper, offering insights into the 'why' and 'how' behind each step. This approach not only makes your content easy to follow but also empowers us to adapt and understand the process, fostering genuine learning. I've eagerly watched all your videos, and the knowledge I've gained is invaluable. Your response to a comment in another video about the tedium of covering basics resonated with me. It's true that many overlook the importance of fundamentals. Your explanations are a rare gem in a sea of superficial tutorials; they enable us to think, not just copy. To alleviate the repetition for you, perhaps consider creating a series of detailed videos on these basic concepts. This could serve as a reference point for your viewers, and it's also a strategy that tends to be favored by the RU-vid algorithm. What captivates me the most, however, is watching your workflow, especially in segments like the anime and pixel art transformations. Your real-time commentary adds immense value. Regardless of how many times a topic has been covered by others, your unique perspective and method of presentation make your videos a must-watch, even on well-trodden subjects."
@latentvision
@latentvision 7 месяцев назад
A comment made by AI for a video about AI😅We live in weird times! I really enjoyed it thanks for the kind words
@YaBoyTwiz
@YaBoyTwiz 7 месяцев назад
I used A.I. to touch it up but its really how i felt
@johnmcaleer6917
@johnmcaleer6917 7 месяцев назад
You are a legend, loving the IpAdapter and your vids are wonderful, simple in style yet so informative ...Love em..You are appreciated..
@andykoala3010
@andykoala3010 7 месяцев назад
Brilliant - thank you for these and for sharing the workflows
@dasomen
@dasomen 7 месяцев назад
Amazing job as usual, what a great new feature update!
@yotraxx
@yotraxx 7 месяцев назад
This... IS... CRAZY !!! Thank you so much for sharing your fantastic work ! I'm using IP+ andd I'm impressed by the results, tanks to you !
@OgdenDigital
@OgdenDigital 5 месяцев назад
Fantastic! A truly superb tool and fantastic explanation. Thank you!
@user-fk4xr4ep3c
@user-fk4xr4ep3c 5 месяцев назад
Just started going through these playlist; This is truly a gem. Thanks much for sharing.
@user-fk4xr4ep3c
@user-fk4xr4ep3c 5 месяцев назад
If you get a chance, do list the machine specs you use for controlNet + animateDiff +IPAdapter? It does take a long time even on a 16GB GPU. TIA
@TheShadowArtCom
@TheShadowArtCom 7 месяцев назад
You, kind Sir, are a treasure. I absolutely love IPadapter. I am very very thankful.
@dck7048
@dck7048 7 месяцев назад
Wonderful content and wonderful tech, thanks for your hard work!
@spider161
@spider161 7 месяцев назад
Amazing! Keep up the incredible work.
@impactframes
@impactframes 7 месяцев назад
This is awesome Bravo. I tested the channel penalty this morning, it improved the result as it handles well weights more than one
@EH21UTB
@EH21UTB 7 месяцев назад
Fantastic! I will have to watch this several times!
@BoolitMagnet
@BoolitMagnet 7 месяцев назад
This is just absolutely amazing!
@Inner-Reflections-AI
@Inner-Reflections-AI 7 месяцев назад
Amazing Work as always!
@Try4Ce
@Try4Ce 7 месяцев назад
This is pure (AI) magic and will help soooooo much in composition! Amazing results in your demonstration, and your tutorial is spot on, very clear to understand. Thanks so much for your hard work!
@julienaubert2422
@julienaubert2422 7 месяцев назад
just to say thank you for you work and dedication !
@petruschka222
@petruschka222 7 месяцев назад
Great job as always!
@comfyuiadrian
@comfyuiadrian 7 месяцев назад
Fantastic work, thank you so much!
@pedrogorilla483
@pedrogorilla483 7 месяцев назад
Wow! You have unleashed one of the best things for Stable Diffusion since ControlNets! Thanks for developing these great tools and showing us how to use them!
@alecubudulecu
@alecubudulecu 7 месяцев назад
Amazing work as always!
@EdwardGu-ic2tn
@EdwardGu-ic2tn 3 месяца назад
I want thank you for your great work, not only this video, but also other videos and the comfyui_adpater_plus, which help me learn great knowledge about how to control the AI model to draw images.
@latentvision
@latentvision 3 месяца назад
thanks! And have fun with AI! 😄
@grebenshyo
@grebenshyo 7 месяцев назад
bravo , matteo! 10/10 questa roba! 🔥
@ceegeevibes1335
@ceegeevibes1335 4 месяца назад
omg. amazing stuff... unbeatable feature.. you are brilliant
@Taimoorabdullah
@Taimoorabdullah 7 месяцев назад
Holy! That was so impressive. Love your videos man! So much to learn and see it in action.
@imKaku
@imKaku 7 месяцев назад
Jesus christ, ive been in love with IPAdapter since its release and this just completely unlocks all the possibilities. This is an insane value tech, thanks a lot for the contribution.
@javierzzz4556
@javierzzz4556 7 месяцев назад
Truly amazing. Many thanks
@RoguishlyHandsome
@RoguishlyHandsome 3 месяца назад
Outstanding
@beveresmoor
@beveresmoor 7 месяцев назад
This is amazing. I cannot express my feeling after seeing your video. This blows my mind. ❤😊
@styrke9272
@styrke9272 7 месяцев назад
That is pretty cool, thanks for the update and the tutorial
@dflfd
@dflfd 4 месяца назад
thank you, this is amazing!
@BernardMaltais
@BernardMaltais 7 месяцев назад
Really awesome stuff! Brilliant!
@Clupea101
@Clupea101 7 месяцев назад
Superb , Awsome work
@LTE18
@LTE18 7 месяцев назад
Thank you for the work. Amazing tool
@stefanguiton
@stefanguiton 7 месяцев назад
Excellent work!
@aerofrost1
@aerofrost1 7 месяцев назад
Thank you for your work with IPAdapter. I've only been using it ever since I found your videos on it. It's so great, being able to have 1 image loras without the need to download others, and can just very quickly create them. The one Issue I've been having is it's been transferring the hair to every character design (I'm using a Harley Quinn reference I made for the adapter image and it's copying the pigtail hairstyle and face on pretty much every character lol)
@brgtubedev001
@brgtubedev001 7 месяцев назад
Your work is unbelievable. This is tremendous and I just can't believe we get to watch you develop in real time these tools that will revolutionize AI image generation.
@enriqueicm7341
@enriqueicm7341 6 месяцев назад
Thanks a lot! it was very very useful!
@Elwandesign
@Elwandesign 7 месяцев назад
I used to love ipadapter now I adore it 😍😍😍
@reekster30
@reekster30 6 месяцев назад
This is awesome - thank you 😎
@yvann.mp4
@yvann.mp4 7 месяцев назад
Incredible, thanks a lot
@pk.9436
@pk.9436 7 месяцев назад
Great Work again 💪
@I_reject_your_reality
@I_reject_your_reality 7 месяцев назад
I agree with others. Mind blowing feature. Thank you! 🤯👌🤘
@TheSleppy
@TheSleppy 7 месяцев назад
This is amazing! Thanks
@Ulayo
@Ulayo 7 месяцев назад
Wow! This is a great update!
@user-ox3xp9lq8j
@user-ox3xp9lq8j 7 месяцев назад
Mateo, you are a GOD! Thank you so much!
@MicheleBrugiolo
@MicheleBrugiolo 7 месяцев назад
Sei un grande!
@user-ui2hw5of9l
@user-ui2hw5of9l 7 месяцев назад
amazing~!! Thank you very much !!
@hleet
@hleet 5 месяцев назад
WOW ! you are the BEST ! It's just so hard just by looking at video but might be able to replicate by doing. Thanks for that man !
@jacekfr3252
@jacekfr3252 7 месяцев назад
wow, great job! Thank you!
@nodewizard
@nodewizard 6 месяцев назад
Gamechanger! There are many, many methods to achieve these end results; however, as we all know, they're tedious and extremely mind-numbingly time-consuming. Matteo's IPAdapter with noise method works the best. Work smarter, not harder!
@Andro-Meta
@Andro-Meta 7 месяцев назад
Thank you so much for your insight :)
@bandinopla
@bandinopla 6 месяцев назад
this is amazing!
@ericren5390
@ericren5390 4 месяца назад
Mateo, this blows my mind, I'm so inspired by your great work, I can't express my gratitude enough. Your guidance hit the mark in a simple and easy to understand way which was definitely what I needed. Thanks again for the great work you do.
@ronnykhalil
@ronnykhalil 7 месяцев назад
Always a treat when Mateo puts out a new video 🙌
@rbscli
@rbscli 7 месяцев назад
amazing! Thank you!
@paulofalca0
@paulofalca0 7 месяцев назад
I love this! :)
@p_p
@p_p 7 месяцев назад
Bella scoperta, un italiano! che bello. Iscritto subito
@andrewqUA
@andrewqUA 7 месяцев назад
Fantastic! .
@florianbecke3076
@florianbecke3076 7 месяцев назад
Completely blow me away! Thanks so much for creating the Adapter and these tutorials! ✌
@ZeroIQ2
@ZeroIQ2 7 месяцев назад
Very cool!
@NHCH
@NHCH 6 месяцев назад
che lavoro della madonna però, grandissimo
@murphylanga
@murphylanga 7 месяцев назад
wow, that is great🥰
@user-ly6cl5rm8u
@user-ly6cl5rm8u 5 месяцев назад
good job🥰
@kempict
@kempict 7 месяцев назад
This tech is unreal! Your channel deserves to blow up. I'm loving your tutorial format.
@koningsbruggen
@koningsbruggen 7 месяцев назад
super cool!
@kunalpuri9492
@kunalpuri9492 7 месяцев назад
Beautiful, simple, explosively relevant. You're inspiring.
@CuBixxx86
@CuBixxx86 7 месяцев назад
superb
@NG2C
@NG2C 7 месяцев назад
Thanks a lot for your work on this most excellent tool. This has given me so much possibilities regarding composition, and easily as well ! Less hassle and much better control/results. Impressive stuff.
@anderswesterlund4191
@anderswesterlund4191 4 месяца назад
thanks king
@cwhiticar1
@cwhiticar1 7 месяцев назад
amazing tools and workflow! Insanely impressive!
@isaactut2520
@isaactut2520 5 месяцев назад
Where do you come from you hero!! Amazing explanation once again! Thank you.
@RamonGuthrie
@RamonGuthrie 7 месяцев назад
Hey great work and equally great videos too, sorry if you have mentioned this before in a previous video, but what is node/model or setting/workflow to focus on the face?
@latentvision
@latentvision 7 месяцев назад
I believe you refer to the IPAdapter face model. I talk about it in the advanced video. It's doesn't need a special node, you just have to download and select the face model
@danmgc
@danmgc 7 месяцев назад
Wow
@bobbyboe
@bobbyboe 7 месяцев назад
Very valid concentrated information... thx a lot! - I wished all these special infos would be provided as "note-nodes" explaining things right in the json-example. It is obvious to me that your knowledge about all these components and how they work together is superior to some other "random-masters" on YT. It is difficult though... to remember all the little facts, like which model needs what other model and so on...
@latentvision
@latentvision 7 месяцев назад
I hear you, the problem with comfy (and all generative ai) is that things move so fast that any documentation is outdated in 3 months (sometimes less). That would mean reviewing all the workflows every now and then and it's a huge amount of work. I'm thinking of writing some articles especially for more complex topics... but do people still read? Everything seems to be video or burst
@bobbyboe
@bobbyboe 7 месяцев назад
@@latentvision You are right Matteo, thank you for your answer. I also know that my "wish" included more work for you... I didnt mean it in a demanding way, I am thankful for any piece of information on a journey into comfy UI. The problem is, that I like to understand things in depth... while it seems to me, that some are ok if if only some nice picture result in the end... and in the beginning of research it is still difficult to seperate the good from useless sources of information. Not many developpers are as good in teaching as you are, or they do not teach at all. I think, much of the information, like - basic relations - will not be outdated so quickly... once the main principles are understood... understanding coming updates can also be challenged :-)
@hentrykulakkattil
@hentrykulakkattil 4 месяца назад
🔥
@laslo67
@laslo67 7 месяцев назад
wow. just that... wow.
@reapicus557
@reapicus557 3 месяца назад
You blew me away with compositing using multiple masks. That is so freaking cool!
@AkedoNiko
@AkedoNiko 7 месяцев назад
damn I had no reason to use comfyUI until NOW, this update is crazy
@MikeLisii
@MikeLisii 7 месяцев назад
Wow, just wow. So detailed explanation and so easy to follow one of the best channels on Comfyui. I am always looking forward to your videos.
@CloakerJosh
@CloakerJosh 6 месяцев назад
I've only recently discovered your content, but I just had to tell you how blown away I am at your knowledge and skill in this field. It's just breathtaking stuff you're getting up to. Kudos to you, and all the brains that make this technology possible. Could you imagine travelling back in time even just 20 years and showing this to people? It'd be science fiction.
@jasemali1987
@jasemali1987 6 месяцев назад
This is yet another great video, thank you so much !!! I have one so many questions as I'm new commer from A1111 to ComfyUi and I just can't have enough of it, it made me feel I'm free and the limits are my imagination. I was wondering, what method is best for IP adaptor, if I want to use many photos for different stuff in my final image without using inpaint of masks, I'm trying to make a robust workflow that can take inputs and get an image that is as close as to the original prompt as possible, can IP adaptor help me with this or it is more like Loras where somthing has to be picked in start to control the outcome. One way I'm thinking to use it is to use it in a looping fashion, like generate an image with basic prompt, use that image in IP adaptor, use new more specific prompt and generate an image, use that image in an IP adaptor with new more specific prompt and so on.. Can this method yield a good results ? It is like using very large prompt with high CFG but without the problem of burning the images.
@latentvision
@latentvision 6 месяцев назад
I would start with the main elements and attention masking, then upscale and inpainting
@seditioussov9622
@seditioussov9622 3 месяца назад
Bro is fuggin Yoda of ComfyUI.
@latentvision
@latentvision 3 месяца назад
thanks for the lol 😆
@Deadgray
@Deadgray 7 месяцев назад
Great job, simply WOW. Little question, can you maybe say something about "full face" adapter?
@latentvision
@latentvision 7 месяцев назад
it is called FULL because it takes the whole 256 vector space to describe the face. As a comparison the plus models use 16 tokens. The result should be a very detailed face.
@Deadgray
@Deadgray 7 месяцев назад
@@latentvision tyvm, so that is why it sometimes needs lower weight in apply. Ok, one more question. In Encode IPAdapter image, best practice is that sum of weights needs to be 1.0 or it's just relative and it can be something like 1.0, 0.8, 0.5? Oh, and 1.0, 0.0, 0.0 gives different result than disconnecting 2nd and 3rd image from input in Encode IPAdapter node, bug or I don't understand how it works?
@latentvision
@latentvision 7 месяцев назад
yeah at the moment you can set any weight (it's relative to the image). a weight of 0.0 is actually 0.00001 because otherwise we would send a zeroed tensor which is not the same as sending no image at all@@Deadgray
@shenjason6619
@shenjason6619 4 месяца назад
Beautiful, simple, explosively relevant. You're inspiring. Love you so much.
@stefanvozd
@stefanvozd 7 месяцев назад
Amazing. Is this workflow from video available somewhere?
@liveactionfezz
@liveactionfezz 7 месяцев назад
This is amazing. Can I upload video sequences to the ip adapter ?
@latentvision
@latentvision 7 месяцев назад
you can send a mask sequence. I'm working also on sending multiple reference images though
Далее
Animations with IPAdapter and ComfyUI
16:07
Просмотров 33 тыс.
LATENT Tricks - Amazing ways to use ComfyUI
21:32
Просмотров 116 тыс.
ПОЮ ЛЕТНИЕ ПЕСНИ🌞
3:16:55
Просмотров 1,7 млн
Dissecting SD3
20:25
Просмотров 15 тыс.
I 3D Printed a $1,224 Chair
23:56
Просмотров 175 тыс.
Making Trading Cards with ComfyUI
20:52
Просмотров 11 тыс.
7 Years of Software Engineering Advice in 18 Minutes
18:32
IPAdapter v2: all the new features!
16:10
Просмотров 70 тыс.
ComfyUI Multi ID Masking With IPADAPTER Workflow
12:31