NEXT-GEN MULTI-CONTROLNET INPAINTING! You’ve NEVER SEEN THIS BEFORE!

Подписаться 150 тыс.

Просмотров 110 тыс.

50% 1

Recently the ControlNet extension for Stable Diffusion was updated with the ability to use multiple ControlNet models on top of each other, which is fantastic because this brand new neural network structure allows you to combine multiple special ai models, and create even better and more precise images than before! In this video, I will not only show you how to best utilize those models together but also give you some special inpainting tricks using ControlNet that I discovered while making this video and I’m sure that you’ve never seen these before! So get ready!
Did you manage to use the multi-controlnet inpainting tricks? Let me know in the comments!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SOCIAL MEDIA LINKS!
✨ Support my work on Patreon: / aitrepreneur
⚔️ Join the Discord server: bit.ly/aitdiscord
🧠 My Second Channel THE MAKER LAIR: bit.ly/themakerlair
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Runpod: bit.ly/runpodAi
Segmentation color spreadsheet: docs.google.com/spreadsheets/...
All ControlNet Videos: • ControlNet
My previous ControlNet video: • CHARACTER TURNAROUND I...
EASY POSING FOR CONTROLNET : • EASY POSING FOR CONTRO...
3D Posing With ControlNet: • 3D POSING For PERFECT ...
My first ControlNet video: • NEXT-GEN NEW IMG2IMG I...
#stablediffusion #controlnet #stablediffusiontutorial
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
WATCH MY MOST POPULAR VIDEOS:
RECOMMENDED WATCHING - My "Stable Diffusion" Playlist:
►► bit.ly/stablediffusion
RECOMMENDED WATCHING - My "Tutorial" Playlist:
►► bit.ly/TuTPlaylist
Disclosure: Bear in mind that some of the links in this post are affiliate links and if you go through them to make a purchase I will earn a commission. Keep in mind that I link these companies and their products because of their quality and not because of the commission I receive from your purchases. The decision is yours, and whether or not you decide to buy something is completely up to you.

Опубликовано:

23 фев 2023

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 231

@Aitrepreneur Год назад

HELLO HUMANS! Thank you for watching & do NOT forget to LIKE and SUBSCRIBE For More Ai Updates. Thx

@Leto2ndAtreides Год назад

Have you seen Corridor Crew's video "Did We Just Change Animation Forever?", that seems super worth experimenting with.

@dimitrishow_D Год назад

i have some cartoon characters , see my profile ....i tried training stable diffusion with this but it cant seem to replacate this...the training only seems to work with things it created itself ..am i doing something wrong or is it that my character is unique and it doesnt have enough reference...when i did kinda get it to worrk with i think astria...it drew it like a 5 year old ..if it is possible to train with your own 2d characters PLEASE make a video about that

@long20014 Год назад

Hi, could you share the excel file about color?

@MissAIchan Год назад

How did you enable the guess mode?

@vi6ddarkking Год назад

We Are Getting So Much Control So Fast. I Honestly Don't Think even 6 month ago anyone thought we would have advanced thim much this quickly.

@wakegary Год назад

and it's exponentially growing. video is a month or two away (or less). then come the apps, the corporate control, the tightening laws on models, the underground trade, the bootleg versions blah blah. it will be fun to watch - we're in the wild wild west phase right now

@cdreid9999 Год назад

This reminds me of when personal computers became available and a lot of us learned to program

@Mocorn Год назад

I can see a quality difference in my output folder from just two weeks back! This is crazy.

@richardgreaney Год назад

This is getting so mind blowing now. There are just so many different possibilities for how to make a good image now. I almost feel like I need to take a step back for a bit, and think about what I would really like to create, then see what technologies are now available that could help me achieve this.

@kinnectar820 Год назад

Holy shit, so much progress in AI image gen in so little time, my dreams of doing my own graphic novels using ML are pretty much fully within grasp using these techniques. What a time to be alive!

@Real28 Год назад

I called it. 6 months ago I said that while it seems like this kind of tech should take a year, it would take half the time. There's just too many people grinding away at these tools simultaneously. Just crazy.

@johannvandebron986 Год назад

Nice! You have the best Stable Diffusion / Automatic 1111 content on YT. Thank you so much for letting us know all this!

@Gxbbzee Год назад

I've been looking at separate tutorials for the past few days, and even those combined didn't give me as good and precise information as this single video did... amazing! Very much appreciated!

@kyoko703 Год назад

With so much "tuning" and manual work, it's pretty safe to say that these "generative" works are more human than anything else and demonstrates that these are just tools at the end of the day.

@dv6165 Год назад

In this case very cumbersome tools for a pretty simple operation

@gara8142 Год назад

@@dv6165 True, but only if we take it at face value, if you wanted to change an image from realisitc to , idk, helltaker style manually, it would take way longer. As with most tools it's a matter of use cases.

@user-zi6rz4op5l Год назад

With Generative AI, you never get the image you wanted, but end with some image which looks pretty after a million random pushing of parameters. Can you get deterministic result on the next attempt. NO. It would be better if these models churn out 2k+ resolution as the upscaling is again a million guess on the parameter buttons 😔😔

@markusm108 Год назад

@@user-zi6rz4op5l you essentially describe what a customer feels when he hires an artist or designer. what these tools do is they put you into a different role - not the artist but the art director.

@Mocorn Год назад

That trick to crudely draw lines to generate edge lighting worked way better than I thought it would. How on earth does it bleed onto the nose like that? This is some wild shit!

@uk3dcom Год назад

I have been trying to do the things you have now solved for hours. Thank you for your experimentation and sharing. The fact that you and a couple of other guys on RU-vid are feeding off each other and pushing this forward to simplify our efforts is really appreciated. Please keep up the good work.☺

@winkletter Год назад

This gives me an idea for an experiment: Comics made with multi ControlNets. One for the frame. Add characters in with OpenPose. Then segmentation for specific objects.

@f0kes32 Год назад

how would you draw the same character in different poses?

@anastasiaklyuch2746 Год назад

@@f0kes32 see previous video ;)

@M.I.F.. Год назад

Charturner....(civitai)

@wakegary Год назад

I just madea Steve Urkel in the style of EC Comics (Tales from the Crypt) and I'm very weirded out. AKA it's awesome

@Strangepaper Год назад

@@wakegary what model for ec comics?

@dreamzdziner8484 Год назад

For someone who had been playing with Controlnet from day one just to blend a foreground character perfectly to a desired background perfectly; this video is a treasure. I tried many combinations but never ever thought of that inpainting trick you showed. You are the absolute best dear friend. 👌💪👍👏🧡

@jurandfantom Год назад

have you managed to make it working? for me it change whole picture and "masked only" other hand make things incorrect.

@user-pf9jv1fl2n Год назад

Can't wait WHAT A TIME TO BE ALIVE AND FIRST!!!

@DESIGNISTASTY Год назад

This is why I love SD because you have total control of what you want to do and how your image will be.

@human-error Год назад

Best controlnet video on the net. Tnx NON-HUMAN !

@bolbolzaboon Год назад

This video right here worth so much that I'm gladly going to join Patreon.

@coda514 Год назад

Controlnet is amazing, and thanks to you I understand it more and more every day. Thank you from the bottom of my heart. Sincerely, your loyal subject

@travelwell6049 Год назад

Interesting. I have not seen anyone talking about controlnet. So it’s great to see. Thanks.

@Dex_1M Год назад

dude, i need to watch this video 10 times with some personal experimentations, this new multi control net is a masterpiece

@Kryptonic83 Год назад

awesome collection of tips, I've been loving playing around with controlnet lately. keep up the great work!

@schenier Год назад

I find that all this shows that this tool can be used by real artists and create little by little an image, from background, to pose, all the way to the lighting

@karl-heinzbiederbick87 Год назад

Wow! Thank you for sharing.

@evil1knight Год назад

Awesome man!!! So much new I didn’t realise you could do!

@mariokotlar303 Год назад

Thank you so much! This was very helpful!

@Apothis1 Год назад

Thankyou so much for all these helpful vids, maes this super easy to understand, really appreciate it

@autonomousreviews2521 Год назад

You never waste my time :D Thank you for the depth and detail.

@fnorgen Год назад

Now this is the level of control I was badly missing back in January!

@lioncrud9096 Год назад

damn, this was like 20 tutorials in one! Awesome content Mr. Aitrepreneur

@Eagleshadow Год назад

Super useful, thanks!

@luke2642 Год назад

Great video, so many useful tips!

@jimdelsol1941 Год назад

Absolutly amazing. Thank you.

@asciikat2571 Год назад

Craaaaaazzzzzzy! Love it, You are the strongest

@alexb6969 Год назад

You r the best! This stuff is so cool! I can't stop to admire this new tool)

@zhizui Год назад

omg!!这真的太有用了！看一次可能都学不完里面的知识

@AscendantStoic Год назад

Fantastic collection of tips & tricks, nice work ;)

@fredmcveigh9877 Год назад

Very informative and inspiring .Thankyou .

@6666daf Год назад

Really good techniques.

@TrancorWD Год назад

Very cool seeing the multi-control net stuff. Last few days I've been adding in support for interactive visualization of control net outputs as a pre-pre-processor. Since it's annoying poking at values without knowing what the outcome will actually be. And I figure, if I'm doing that for fun, other people are probably doing this as well on the sd-webui-controlnet extension team. Cause the capability is all there for feedback from the ControlNet preprocessor in A1111, just a matter of connecting up the hooks for it.

@oblivionronin Год назад

15:41 That image is absolutely insane, i love it !

@aaronhhill Год назад

"Because I'm a madman." Hahahahaha! Love you man, you're great!

@gameswithoutfrontears416 Год назад

Thanks. Wow. Pretty cool stuff. So many possibilities 👍

@krz9000 Год назад

dude...what a treasure chest of a video!!

@OndrejL Год назад

wow bruh great discoveries and thx for the share

@hatonafox5170 Год назад

You sir are my hero!

@joshuajaydan Год назад

You sir are insanely talented. Thanks for sharing.

@GerwaldJensRadsma Год назад

WooooOOOooooW Good as always!

@MrBlitzpunk Год назад

I haven't tried the multiCN, but with a single CN if you use the hed model it's already good for changing the style of a single image, it works kinda like depth map but preserves the detail and lines of the image

@Artishtic Год назад

Thanks for the epic tutorial! If there were only a photopea version of After Effects too.

@HolidayAtHome Год назад

remember the time where txt2 image with 1.4 was the only thing we could do back then =D ?

@estrangeiroemtodaparte Год назад

I remember discovering disco diffusion and thinking it was magical! lol Things are changing fast!

@IceMetalPunk Год назад

Yeah, less than a year ago 😂

@bentp4891 Год назад

Amazing. Probably the most impressive new features since Dreambooth.

@in2thedark Год назад

You are the man! 🤖 thanks for the tips

@joaoguilhermebernacchiviei2103 Год назад

Nice tips and video,from brazil

@OriBengal Год назад

whoa! Totally stands out from the other guys :) -- Great techniques!

@flonixcorn Год назад

Very nice!

@PhilippSeven Год назад

You can Inpaint character on the background much easier: there is a tab for that - “inpaint upload”. Just use depth pic as a mask. No need to draw something, and result is much cleaner.

@fernandoz6329 Год назад

Awesome tricks

@TheAiConqueror Год назад

troll king 👑 no seriously, i love your video, your workflow tricks. I could watch you for hours 😁👍

@Krougher Год назад

That s insane !

@philipZhang86 Год назад

great tutorial~~

@muuuuuud Год назад

Thanks K for the powerful knowledge, have a wonderful weekend! ^__^

@stupidoldgamer Год назад

Hah got there before this video :) It is very very cool!

@DearGeorge3 Год назад

fantastic!

@evylrune Год назад

Damn, the sketch lighting trick is pretty cool.

@garen591 Год назад

Thats really cool. Could you talk about how to change an object perspective too? Say you want a front, top, side or isometric view of an object

@FleischYT Год назад

great tip, appreciated

@ashokp9260 Год назад

Hey this is so incredible... tools for infinite creativity at 0 cost. Also, I feel I am light years behind, if I forget to follow develpments even for a week.

@devnull_ Год назад

Like you didn't already have possibility for "infinite creativity" with pen and paper or photoshop.

@ashokp9260 Год назад

@@devnull_ Like everyone on earth is so artistic like Davinci.

@cruhstin Год назад

Fantastic tips! It would be awesome if you add checkpoints/timestamps to this video so I can quickly go to a spot in the video if I want to review a specific trick you showed off. Keep up the great work 😀

@earthpond8043 Год назад

Bro you keep blowing my mind damn gj

@сверхчеловечек Год назад

oh my goooooooooooooooooood!!!!!!!

@maddercat Год назад

wow, i had no idea this was possible, that's insane...I gotta wrap my head around it, it's difficult even seeing you do it. lol

@bustedd66 Год назад

deforum also added controlnet but i have not seen it covered yet. might be interesting.

@danilo_88 Год назад

This is pretty cool. I love your videos. You could use more models other than just anime and cartoon.

@odawgthat3896 Год назад

Lets gooooo!

@Actual_CT Год назад

finally 3d texture workflow assistance...with precision

@moneyjuice Год назад

that's insane how quick the AI tech is evolving

@megumin4625 Год назад

The multi controlnets are now tabbed. Niiice

@doobertoob4266 Год назад

Lol finally. Guess mode is pretty much what Midjourney does by default

@leowei771 Год назад

Good lord, this is moving so fast that I can barely keep up with all this new stuff.

@Loopa21 Год назад

damm tnx man

@goldenknowledge5914 Год назад

Its crazy. So much things to learn just for one feature. It is indeed the age of AI

@noxious_2.06 Год назад

Ooooooh HANDS !!!!

@hexemeister Год назад

Your channel is awesome, but I am overwhelmed with so much info. Is there a newbie playlist to start from beginning to catch it up?

@jtmcdole Год назад

Now we just need a node-based flow plugin to make the rotoscoping easier.

@victorwijayakusuma Год назад

Thank you for this! YOu are wonderful! by the way how to do the excel thing or is there any other program to see the segmentation list?

@Dex_1M Год назад

i think using 2 control nets, one with the canny or depth, and one with the pose, and playing only with the pose around and not changing the canny or depth, well make you control the characters movement while keeping the details, i assume this is true and if you can get this right, you can make a lot of images, and thus having an animation.

@cesar4729 Год назад

You missed the best sketch trick, were you use colors to add things or transform the picture. For that you need the same picture in controlnet and play around. Is way more powerful than the segmentation trick.

@resonantone3284 Год назад

Installed it yesterday, and boy... I'm still struggling to figure it out. If it's going to do what I think, wow... Why do all the cool toys have to come out when I'm on a deadline?!??!? It's a plot I tell you!

@lntcmusik Год назад

This is great! Thanks for sharing 🙂 Do you have an idea on how to create an animated, let's say, sticker for any messanger using Stable Diffusion? That would be interesting.

@cdreid9999 Год назад

The awesome thing abput nerdimg put over new tech is the constant chamge and radical improvement. The downside is you literally cant keep up with tge change and improvement

@ColoNihilism Год назад

awesome where do we get some here do we get some lighting examplars ?

@rincondesalva Год назад

Awesome video!... Could you please (in any control-net video) tell us which requirements about VRAM specially) should everyone need in order to run in local properly this addon?...I guess my rtx3070 mobile with 8gb is almost uncapable...

@dahozabich 9 месяцев назад

Using a XY plot would help finding the right denoise strength

@Tsero0v0 Год назад

What if we use multiply controlnet and all of them with guess mode or without it? Is there any different?

@jurandfantom Год назад

Interesting thing. ControlNet f up, upscale extension. Even when not active, it still break SD and ultimate SD upscaler. Lucky just turn extension off fix everything :)

@haan3388 Год назад

do you have an in depth vid on the inpaint trick you explained around 5:00?

@benjamininkorea7016 Год назад

Brilliant. The segmentation index is completely crazy, and I never would have found it. I gave up on segmentation almost immediately as useless, but I was wrong! Do you have any workflow yet for altering the appearance of exisitng human faces not from prompts? Especially, I want to use my face in a new scene but not with the same lighting taken in my living room-- but add god rays etc. to it.

@muuuuuud Год назад

Unless I'm mistaken i think Lora is your answer

@Mocorn Год назад

@@muuuuuudor dreambooth or textual inversion or hypernetwork.

@sunlightg Год назад

I agree with the previous commentator. Just train your own lora model with your own face and then use it as you wish. There is a good video in this channel about training LoRa, so just follow the instructions. Just don't forget to read the comments under the video because there are some important things to add :D

@KonstantinRozumny Год назад

Great video! How to add two different characters to the same background?

@sunlightg Год назад

You're really amazing. Thank you very much for your super useful videos, super understandable English, super interesting content. You're just a light in the stable diffusion darkness.