Тёмный

Multi-ControlNet - How I got consistent videos! 

enigmatic_e
Подписаться 36 тыс.
Просмотров 59 тыс.
50% 1

Experimenting with Multi-ControlNet settings to get consistent animations.
HOW TO SUPPORT MY CHANNEL
-Support me by joining my Patreon: / enigmatic_e
_________________________________________________________________________
SOCIAL MEDIA
-Join my discord: / discord
-Instagram: / enigmatic_e
-Tik Tok: / enigmatic_e
-Twitter: / 8bit_e
_________________________________________________________________________
Install ControlNet: • Controlnet 1.1 for Sta...

Опубликовано:

 

8 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 155   
@joshuagreen6581
@joshuagreen6581 Год назад
The corridor crew had some pretty good results with keeping that flashing down with a de-flicker plugin. I keep needing to remind myself that I dont have to do everything in SD. I can still use my other tools.
@enigmatic_e
@enigmatic_e Год назад
I just saw that. Tested the deflickering and it definitely improved it. Showing results maybe in the next video or in a short! You’re right about using other tools!
@thill6482
@thill6482 Год назад
See, this is why I love your channel. You're always trying new things and experimenting while staying humble about it. You're the only channel out here working with AI art generators and After Effects. Maybe word still needs to get around that this is possible, but once it does, your channel will blow uuuppppp!!!! Keep up the great work my friend 🤟
@enigmatic_e
@enigmatic_e Год назад
Comments like these motivate me to keep pushing. Thank you! 🙏🏽
@thill6482
@thill6482 Год назад
@@enigmatic_e of course 🙏🏿🤗
@cerspence
@cerspence Год назад
Super sick ❤
@Modioman69
@Modioman69 Год назад
Nice job man! Thank you for this comparison. I would love to see what you could do using EBsynth for some cool animations with realistic output.
@enigmatic_e
@enigmatic_e Год назад
Yes me too! I will try it soon!
@LegendD112
@LegendD112 Год назад
You are doing a great job experimenting, I am also trying everything I can, I hardly sleep! but it's very exciting!
@enigmatic_e
@enigmatic_e Год назад
I feel you on the hardly sleep 😂
@iamYork_
@iamYork_ Год назад
Sleep is overrated°°°
@loveutube04
@loveutube04 Год назад
I can't believe, you only have 23k subs? You deserve a million subs already.
@enigmatic_e
@enigmatic_e Год назад
I hope this will be the case someday. Thanks for the support. 🙏🏽🙏🏽🙏🏽
@Nekotico
@Nekotico Год назад
dude this is amazing, cant wait to try it, thanks for share, thats so solid output
@realsammyt
@realsammyt Год назад
Great video, really enjoyed following along with your experiments and seeing what did and didn't work for you. The jks are fun too, keep on keepin it fun, light, and learny.
@Amelia_PC
@Amelia_PC Год назад
Awesome! I had ignored the hed model until now. Then I tested it for a comic book purpose and it worked so well. Thanks!
@enigmatic_e
@enigmatic_e Год назад
You mean the deflicker? I have a video about it ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-PeXRFH2I9Is.html
@mohammedrashid1910
@mohammedrashid1910 Год назад
really like the style of the video. not a typical tutorial. just a dude testing out an idea. subbed
@enigmatic_e
@enigmatic_e Год назад
My dude, loved that you see it that way. That’s definitely what my intention is with my videos. I don’t want to come off as I have all the answers, cause I don’t, I’m just messing around trying to figure out what works.
@mohammedrashid1910
@mohammedrashid1910 Год назад
@@enigmatic_e looking forward to more stuff from you. keep it up
@Vampiric_Kai
@Vampiric_Kai Год назад
I've been looking into SD and controlnet to see how it could enhance my Stylized 3D animations recently. Your video has definitely helped me get a better understanding of what can be done with these tools. Also just an unrelated sidenote, I would better describe this as Rotoscoping rather than animation.
@gloxmusic74
@gloxmusic74 Год назад
Nice job bro, you pretty much nailed the consistency there :)
@Felloggs
@Felloggs Год назад
Great vid bro, keep it up!
@Repossessionn
@Repossessionn Год назад
Don't forget to press preview annoator result to see the controlnet preview before hand!
@enigmatic_e
@enigmatic_e Год назад
That’s good to know, thank you!
@hamtsammich
@hamtsammich Год назад
workflow is definitely an important part of using stable diffusion
@maltar5210
@maltar5210 5 месяцев назад
I just ended to follow this video. Bro its great! But I discovered something by accident. I applied all your settings, except the "normal map", cause I don't have it. I was using only canny and I got an excelent image since the first try, the funny part is that I tried to apply normal_bae, cause I couldn't find normal_map (Do I have to download it?). And thinking I was appying both tabs, I forgot to "Enable" the "normal" tab and I got a good result XD. Nice work!
@enigmatic_e
@enigmatic_e 5 месяцев назад
Sorry if anything was confusing. This video is pretty old by AI standards but I'm glad its still helpful.
@maltar5210
@maltar5210 5 месяцев назад
@@enigmatic_e Not at all! Amazing video. In fact I want to do animation using the corridor method, and I was very happy to get nice results. I'm just confused how to get the "normal_map" or it was changed for another thing? Thanks for answer!
@CloudEdwards
@CloudEdwards Год назад
this was really great and helpful;. Thanks Fam!
@aginbayu
@aginbayu Год назад
thank you for this, i'm experiencing the same problem. but this video help me so much!
@enigmatic_e
@enigmatic_e Год назад
🚀🚀🚀🎉🎉🎉
@iamYork_
@iamYork_ Год назад
Wow… impressive results… I need to get on the Controlnet… I just used my animation degree to make a hat… I heard it gets cold on the bread line… haha keep up the good work…
@enigmatic_e
@enigmatic_e Год назад
Try it bro!!
@iamYork_
@iamYork_ Год назад
I think I have to after seeing this... I haven't been meddling much with Stable Different recently but I feel controlnet will lure me back in... I try to get out and it just keeps sucking me back in!!! haha
@enigmatic_e
@enigmatic_e Год назад
@@iamYork_ 😂
@deathseverance
@deathseverance Год назад
Great work bro ^^ , i checked the last video of Corridor and the moment i finished it i thought oh yeah , he sure will watch it and maybe ...... idk i just thought maybe you will talk about it or about the techniques used ( the training model technique for example ); keep it up and we are waiting for your next video bro , Much love .
@enigmatic_e
@enigmatic_e Год назад
Thanks bro! I saw that vid it was great! I’m sure they wished they had controlnet when they first started. I just tested deflickering and it works very well. I will post results or talk about it in new video.
@DJVARAO
@DJVARAO Год назад
You can add another controlnet with eg depth and get more consistent results.
@enigmatic_e
@enigmatic_e Год назад
I gotta try that!
@billMcLatentspace
@billMcLatentspace Год назад
@@enigmatic_e guess mode can make a big difference as well. It's a lot to get to grips with rn
@alieninvasion33
@alieninvasion33 Год назад
thats awesome bro thanks for the video ..hugs from Brasil
@dascodraws6040
@dascodraws6040 Год назад
Very nice! thanks for the demo!
@Mimeniia
@Mimeniia Год назад
Its definately to see all the tweaks and tuning from others that you would miss in your own sleepless, keyboard bashing, cussing time using SD.
@marcorubio8377
@marcorubio8377 Год назад
really good video pal
@enigmatic_e
@enigmatic_e Год назад
Thanks!
@BooooClips
@BooooClips Год назад
Super cool 👍
@a-i-gen
@a-i-gen Год назад
That's cool stuff! Gonna try it myself.
@r4nd0mth0_ghts5
@r4nd0mth0_ghts5 Год назад
Thanks for sharing with us
@RobertJene
@RobertJene Год назад
Stable Diffusion needs to be more stable in other aspect ratios 💯
@alesdanz
@alesdanz Год назад
Hi. I have a question, I have a video in sequences and I took a frame and transformed it with Stable Diffusion and then improved it in Photoshop and got better results. But now I would like this photo created with Stable and Photoshop to follow my video sequence as if it were Ebsynth. And I can't figure out how to do it... Is there a way?
@strangelaw6384
@strangelaw6384 10 месяцев назад
in controlnet tab, choose the option to use your own reference image, and upload your next frame; in the img2img tab, upload the image that you edited. Then, if you tune the denoise well, your generated image will have most of the features that were present in your edited image, but also with the topography and poses of your reference image. Basically, you use the "use your own reference image" functionality to generate the next frame based on the present frame... you start off with the beautifully photoshopped image, and hope that the next images down the process are just as good. If your frames are continuous enough, this should work.
@dan323609
@dan323609 Год назад
You can click preview instead of Generate for preview cnet 😁
@godned74
@godned74 Год назад
Awesome . Iv been trying to turn my self into a werewolf while playing guitar but stable diffusion has the video glitching here and there. This just might be what Iv been missing XD. cheers and thanks.
@luisgarciarios4988
@luisgarciarios4988 Год назад
increible!!!! thanks a lot
@yassiraykhlf5981
@yassiraykhlf5981 Год назад
you my good sir are an ai wizard
@beyou3015
@beyou3015 Год назад
Different videos have its unique "ideal setting" for consistency, just need to find it out by tring different parameters.
@neocaron87
@neocaron87 Год назад
I actually like the left side more. XD Still freaking mindblowing to be able to do this!
@enigmatic_e
@enigmatic_e Год назад
Check out my results here, I was able to remove the jitter ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-PeXRFH2I9Is.html
@chrisdixonstudios
@chrisdixonstudios Год назад
Ok, that is super cool 😎. Thanks for sharing your learned info. ..I wonder if one could do similar with simple drawing flip book images with right seed and settings. Subscribed
@enigmatic_e
@enigmatic_e Год назад
👍🏽
@lioncrud9096
@lioncrud9096 Год назад
3:03 we've all been there smh. hours of tinkering to fix some basic shit
@ronnykhalil
@ronnykhalil Год назад
nice work! thanks for sharing
@enigmatic_e
@enigmatic_e Год назад
Thanks for watching!
@p_p
@p_p Год назад
thank you for sharing your workflow, i would really like to know how ebsynth would improve a scene like your in particular
@enigmatic_e
@enigmatic_e Год назад
I will try it!
@soyguikai
@soyguikai Год назад
barbaro ta bueno el algoritmo de youtube, 50 minutos y me aparece en recomendaciones!
@enigmatic_e
@enigmatic_e Год назад
RU-vid me está echando la mano? Que padre 😂
@alus0l
@alus0l Год назад
I live my life a quarter mile at a time!
@enigmatic_e
@enigmatic_e Год назад
😂
@Statvar
@Statvar Год назад
How did u add black background to the original video? Did u mask every frame manually or is there an effect that does that? thanks for the informative video
@Sharal3D
@Sharal3D Год назад
Please feed to ebsynth 😮. And try what the corridor did the deflicker thingy ?
@DJVARAO
@DJVARAO Год назад
Please share a finished video. I believe you will remake some early videos you did with SD now with controlnet.
@IntiArtDesigns
@IntiArtDesigns Год назад
This was very much not a tutorial of any kind. Cool vid, but totally mismatched/clickbaity title. I've been experimenting with animation, controlnet, gif2gif, ebsynth etc. and really trying to nail down removing those inconsistency errors and it's quite a challenge, so i was hoping for some insights here but was left feeling unsatisfied in that regard. It was interesting watching your workflow, but there was a clear lack of explanation of what you were doing, things were very rushed. Would actually like to see a tutorial at some point though, if you'd consider doing it. I'll tune in.
@enigmatic_e
@enigmatic_e Год назад
I didn’t go over the details because I had already made a video previously where I went through what everything does. This was more of a follow up to that. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-1SIAMGBrtWo.html
@enigmatic_e
@enigmatic_e Год назад
Also thanks for your honesty, I will make note of that for future videos. I’ve had complaints that sometimes I waste time talking about “obvious” things and so I think I may have gone to the other extreme. Again thanks for the feedback.
@IntiArtDesigns
@IntiArtDesigns Год назад
@@enigmatic_e Ah fair enough. Yeah i still think it's best to be slow and simple, forget the elitist fools who would condemn you for helping others, it's arrogant, not everyone is at their level of understanding, what might be obvious to them is not obvious to others and they should learn some respect and allow you to accommodate for everyone. Trust me, explain things as if you were talking to a 5 year old, nobody actually wanting to learn will complain about that, they'll appreciate it, it's not patronizing, it's how a good teacher rolls, because if you can't explain something simply enough, then it usually means you probably don't understand well enough yourself. I'll be checking out some of your other vids and will leave a sub. Best of luck, keep up the good work.
@Samy91700
@Samy91700 Год назад
Thanks a lot for your video! I wanted to ask you, how did you manage to get a decent face for your character with a fullbody picture? I struggle a lot without inpating
@michaelli7000
@michaelli7000 Год назад
great video, do you know how to use preimere to blend the ebsynth results more smoothly?
@vargatibor5094
@vargatibor5094 8 месяцев назад
10/10
@NarimanGafurov
@NarimanGafurov Год назад
Thank yoy bro!
@enigmatic_e
@enigmatic_e Год назад
No problem!
@corknakovastein
@corknakovastein Год назад
Idk what i'm doing wrong, I cannot get consistent images, ive been going step for step through multiple videos, every frame is a different face and way different articles of clothing. only thing the same is the color of clothes.
@haidargzYT
@haidargzYT Год назад
great result for Saitama without CN did you use a Lora or just prompt? he look just like in the anime
@aneebartist7207
@aneebartist7207 Год назад
Please tell me what If I created my own character in photoshop and want my character in different poses , is there is any way to do that. ?
@ar_jams111
@ar_jams111 Год назад
😂 working so long that there was an update is hilarious
@JadhuGhr-lz8en
@JadhuGhr-lz8en Год назад
mat1 and mat2 shapes cannot be multiplied (77x768 and 1024x320)
@bambaboyz
@bambaboyz Год назад
Thanks for the video. Are you processing frame by frame? I can't get my head around this new M2M script option
@enigmatic_e
@enigmatic_e Год назад
No I just export it through the batch tab
@sygagency1514
@sygagency1514 Год назад
dear enigmatic: Did you do the photo-by-photo conversion or did you select all the photos and press something in stable diffusion to do it automatically?
@supikon
@supikon Год назад
Great stuff "E" !! Thx for the share. Do you know if there's a way to batch a sequence with a precompute Normal or Depth map? From 3D render pass for example.
@enigmatic_e
@enigmatic_e Год назад
Mmm I don’t think so, I could be wrong because I’m not too familiar with how precompute works.
@supikon
@supikon Год назад
@@enigmatic_e Thx for your answer! The passes from 3D software works great with controlnet for image génération, they're similar as the preprocess from controlnet. I guess if it's possible to point a folder with precalculated Normal or Zdepth, and use this sequence in place of the preprocessed one.
@SkillsToLearn
@SkillsToLearn Год назад
Good job 👍
@enigmatic_e
@enigmatic_e Год назад
Thanks! 🙏🏽
@UnknownUser-eb1lk
@UnknownUser-eb1lk Год назад
Can you post a quick re-do with ControlNet 1.1? A lot of the UI has changed.
@enigmatic_e
@enigmatic_e Год назад
Yea I’ll look into it
@Veel1
@Veel1 Год назад
@enigmatic_e did you rotoscope the footage before adding a footage path to SD?
@enigmatic_e
@enigmatic_e Год назад
Yes. I then took the generated images into After effects to use the rotoscoped footage as a matte to remove the black background of the Ai generated images
@tomburden
@tomburden Год назад
Is there a way to batch cut the images square? Awesome video thanks!
@enigmatic_e
@enigmatic_e Год назад
Not that I know of
@NimbusAbi
@NimbusAbi Год назад
hi, i am trying to get into the ai animation topic and i have a question, would be cool if you could answer. Why wouldnt you use style transfer on some keyframes of the original footage and then proceed with ebsynth as you did in the older tutorial?
@enigmatic_e
@enigmatic_e Год назад
Hi, style transfer is more patterns that follow a style of an image. This is trying to get a person to look like an animated character. Also ebsynth parts best with subtle movement.
@Edd_Wiz
@Edd_Wiz Год назад
could u scroll a little bit slower, i try to find something for video edit but cant stnd what u setup on tabs(((
@koto9x
@koto9x Год назад
dont create for youtube algorithm, create to add real value and people will support and u can build a real community. not hating tho much respect
@CHARIOTangler
@CHARIOTangler Год назад
Great video! Spongebob ripped off Ren and Stimpy. Also, Ren and Stimpy is VASTLY superior to Spongebob in every way, shape, and conceivable form. Just want to make that crystal clear🤣👍👍
@enigmatic_e
@enigmatic_e Год назад
I totally 💯 percent agree!
@CyberPhonkMusic
@CyberPhonkMusic Год назад
How many hours did I like to render in CONTROLNET?
@enigmatic_e
@enigmatic_e Год назад
about 30 minutes if i remember correctly
@CyberPhonkMusic
@CyberPhonkMusic Год назад
@@enigmatic_e Uoolll, very fast, thanks bro
@fluffycatmedia
@fluffycatmedia Год назад
what did u use to get rid of the background on the vid and what vid format is it?
@enigmatic_e
@enigmatic_e Год назад
I used some background removing plug in. I go over it in this video ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-Jhuf6M_VrBI.html I also did some rotoscoping to clean up some areas.
@corknakovastein
@corknakovastein Год назад
still trying to get control net to work, non of the files pop up for me when I try and activate them, they were all auto installed into the folder they should be in
@enigmatic_e
@enigmatic_e Год назад
This video is outdated. Here’s a newer version Controlnet 1.1 for Stable Diffusion A1111 ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-DIrIL863-LY.html
@corknakovastein
@corknakovastein Год назад
@@enigmatic_e I'll check it out! Thanks
@androidgamerxc
@androidgamerxc Год назад
plz brother i wasted my 5 hours trying to install control net to my stable diffusion automatic 1111 thingy and i cant please tell or make a video of where i can do that
@enigmatic_e
@enigmatic_e Год назад
here is it bro ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-1SIAMGBrtWo.html
@soyguikai
@soyguikai Год назад
incluso el bolso lo mantiene con control net
@ethan2023
@ethan2023 Год назад
I'm not seeing an annotator resolution setting or the canny low and high threshold. Any idea why?
@enigmatic_e
@enigmatic_e Год назад
Do you have the latest update? Not sure why you wouldn’t have it
@ethan2023
@ethan2023 Год назад
@@enigmatic_e it may be my webui is out of date. Thanks for the response.
@JolyLad
@JolyLad Год назад
Cool! Also, what's the name of the song you're using?
@enigmatic_e
@enigmatic_e Год назад
It’s some royalty free music from Envato or Storyblocks can’t remember where it’s from.
@JolyLad
@JolyLad Год назад
@@enigmatic_e Thank you! It was the first song under Chill Hop by Gushito on Storyblocks.
@enigmatic_e
@enigmatic_e Год назад
@@JolyLad nice!
@angelicakauer
@angelicakauer Год назад
my stable doesn't have control net options u.u"
@enigmatic_e
@enigmatic_e Год назад
Go to the video before this to learn how to install this. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-1SIAMGBrtWo.html
@kishorerabha8920
@kishorerabha8920 Год назад
how did you remove the bg?
@HogwartsStudy
@HogwartsStudy Год назад
I need help getting rid of the flicker! Have you redone this with the lora on?
@enigmatic_e
@enigmatic_e Год назад
I use a de flickering plug in by DaVinci studio, there’s a ve on my channel talking about it
@HogwartsStudy
@HogwartsStudy Год назад
@@enigmatic_e i found it and instantly subbed. TY! I'm rendering a new batch now and downloading davinci
@enigmatic_e
@enigmatic_e Год назад
@@HogwartsStudy just know it’s not for the free version unfortunately
@HogwartsStudy
@HogwartsStudy Год назад
@@enigmatic_e aww, i thought i saw someone in the comments say it was.... rip :( thanks anyway. I'll stick around, for science.
@enigmatic_e
@enigmatic_e Год назад
@@HogwartsStudy yea there should be something coming soon, I’m sure of it. And I’ll make a vid about it
@Statvar
@Statvar Год назад
I don't have normal map as an option. How do u download it manually if thats what u did?
@enigmatic_e
@enigmatic_e Год назад
This is an outdated video I would suggest you check out this, ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-DIrIL863-LY.html
@Statvar
@Statvar Год назад
@@enigmatic_e thank you
@user-kl6pg9ie4z
@user-kl6pg9ie4z Год назад
the tutorial is very dramatic but many steps are missing to try to do the steps you did to get the result
@enigmatic_e
@enigmatic_e Год назад
sorry I like dramatic. 😭
@user-kl6pg9ie4z
@user-kl6pg9ie4z Год назад
@@enigmatic_e I like drama also. But how can I get from you more information about that tutorial.? Even if it needs some price. I am ready. Thanks for your answer
@hexabear8311
@hexabear8311 Год назад
With Controlnet installed, there's no need to run the img2img alternative Script anymore?
@enigmatic_e
@enigmatic_e Год назад
Not really. Img2img does give a certain style but it typically stay close to the original footage. Controlnet allows you to push the style a bit more.
@hexabear8311
@hexabear8311 Год назад
@@enigmatic_e Thanks for the fast reply! I saw your new workflow video right after I commented 😁
@themightyflog
@themightyflog Год назад
Why not EBsynth this and get more consistency?
@enigmatic_e
@enigmatic_e Год назад
I have many videos, some on ebsynth. also this video is outdated already.
@themightyflog
@themightyflog Год назад
I saw the temporal kit one you made but it doesn't stack up to tthis one. I think this one still holds pretty good till controlnets get even better.
@bifrostbeberast3246
@bifrostbeberast3246 Год назад
I like how his nipples appear for a couple of frames ^^
@ComradeFer
@ComradeFer Год назад
Bruh Lmaoooo
@koto9x
@koto9x Год назад
thanks for making this video. im 2:11 minutes in though and i feel like you shouldn’t skim through or go so fast. more detailed and elaborative explanations can be super helpful for beginners or people learning. it feels like ur assuming people know what youre doing which defeats the purpose of a tutorial
@life0reader960
@life0reader960 Год назад
IS THIS AN APP
@enigmatic_e
@enigmatic_e Год назад
It’s a browser interface for generating AI art.
Далее
How I Got Hired as a Character Artist For Games
20:52
Просмотров 495 тыс.
I Remade Iron Man VFX With $20
7:44
Просмотров 441 тыс.
🤔 Ok, but what IS ControlNet?
25:31
Просмотров 43 тыс.
Why Are Open Source Alternatives So Bad?
13:06
Просмотров 628 тыс.