Тёмный

3D POSE & HANDS INSIDE Stable Diffusion! Posex & Depth Map! 

Aitrepreneur
Подписаться 155 тыс.
Просмотров 72 тыс.
50% 1

Опубликовано:

 

4 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 186   
@Aitrepreneur
@Aitrepreneur Год назад
HELLO HUMANS! Thank you for watching & do NOT forget to LIKE and SUBSCRIBE For More Ai Updates. Thx
@welton26
@welton26 Год назад
I'm having trouble creating my own depth maps by hand. It would be interesting for you to create a tutorial.
@kamransayah
@kamransayah Год назад
This is exactly what was talking about the other day! Of course you have more freedom with Blender but this is the huge time saver! Thank you K!
@AltimaNEO
@AltimaNEO Год назад
This is cool and all, but I feel like its beating around the bush of what everyone ultimately wants - a fully posable character model within stable diffusion, hands, feet, and skeleton. GIven how fast this stuff is coming out, I can only hope something like this comes soon!
@glitter_fart
@glitter_fart Год назад
:)
@globurim
@globurim Год назад
Yeah, the hands thing is basically just a clipart. But this is progress
@stinkyjutsu
@stinkyjutsu Год назад
All of these new extensions are the process it's taking to work towards a full 3D model. Good tech takes time.
@DomZeal
@DomZeal Год назад
I give it 2 months.
@JonnyCrackers
@JonnyCrackers Год назад
Sure, but that's just how these things go. Eventually we'll get it built in, but this is a pretty simple (if somewhat tedious) solution.
@Oxes
@Oxes Год назад
the phase at this point of things we actually wanted with A.I is stunnig, cant wait for new stuff😮😮😮
@antoninowinowski8458
@antoninowinowski8458 Год назад
I downloaded the latest commit of sd-webui-controlnet and the controlnet tabs (Control Model - 0, Control Model - 1, ..) were missing. You have to enable it in settings.
@Naundob
@Naundob Год назад
Great as always! 👍 Also after a lot of this is fun, this is huge, this is insane you went back to a rather informative thumbnail which is very much appreciated 🙏
@AscendantStoic
@AscendantStoic Год назад
Waiting for your next video on the update/alternate version of the Latent Couple extension that allows you to directly paint masks by color to determine which sub-prompt goes where .. basically kinda like Nvidia Canvas! I tried it and it worked, now I have two versions of the extension in the same drop menu (in case you want to use the original version with the divisions for some reason).
@Aitrepreneur
@Aitrepreneur Год назад
Yes I'm working on it :)
@tetsuooshima832
@tetsuooshima832 Год назад
Hmmm what ? Name of that extension please~~?
@AscendantStoic
@AscendantStoic Год назад
@@tetsuooshima832 It's the (ashen-sensored/stable-diffusion-webui-two-shot)
@Smokeywillz
@Smokeywillz Год назад
Omg….
@tetsuooshima832
@tetsuooshima832 Год назад
@@AscendantStoic thanks, I found a tutorial by Sebastian Kamph to install it properly, it works !! Awesome !
@winkletter
@winkletter Год назад
I was looking at the Posex documentation just a few minutes ago trying to figure out how it's different than the OpenPose Editor. Thanks!
@Aitrepreneur
@Aitrepreneur Год назад
Enjoy ;)
@KingSunny1
@KingSunny1 Год назад
Game changer
@Aitrepreneur
@Aitrepreneur Год назад
I have to agree :)
@Skullivon
@Skullivon Год назад
The game changes so often we might as well be playing Calvinball
@albertoUnreal
@albertoUnreal Год назад
Hahaha game changer, we do that from 30 years
@IceMetalPunk
@IceMetalPunk Год назад
​@@albertoUnreal As someone who's 32 years old, I don't remember AI text to image generation existing when I was a kid 🤔
@albertoUnreal
@albertoUnreal Год назад
@@IceMetalPunk AI exists from 22 years true
@Dmitrii-q6p
@Dmitrii-q6p Год назад
omg, deserve a comment and like. and on top of that super simple explanation.
@zetracakep
@zetracakep Год назад
this one is good, because you dont need long time to pose the hand manually, it really helpfull and the 3d map fix the proble that open pose have that it dont have 3d prepective
@cyrusbastankhah576
@cyrusbastankhah576 Год назад
Your videos are super helpful and my favorite/best resources for all things Ai! Thanks, keep it up!
@Aitrepreneur
@Aitrepreneur Год назад
Thanks I appreciate it! ;)
@KadayiPolokov
@KadayiPolokov Год назад
The speed of changes going on now is kind of insane
@Blastmaster321
@Blastmaster321 Год назад
Looking forward to when you can map the software on top of the other open source software that allows you to track hands and movement from normal cameras
@IceMetalPunk
@IceMetalPunk Год назад
In what way do you mean? You can already generate both an OpenPose skeleton and a depth map from a regular camera image.
@Spaceisprettybig
@Spaceisprettybig Год назад
THIS PROGAM IS MOVING SO FAST.
@NathanLorenzana
@NathanLorenzana Год назад
Yes yes, it was a matter of time! Thank you!
@Aitrepreneur
@Aitrepreneur Год назад
You bet!
@pastuh
@pastuh Год назад
If it was 3d model preview window and transformer, it would be nice for sure :) For now daz3d is winner
@plasmadrone3123
@plasmadrone3123 Год назад
thank you for the videos! I think it's only a matter of time until a new extension for manipulating the fingers come along for Stable Diffusion too :D :D
@BetzVRz
@BetzVRz Год назад
I have the extension installed but the poser does not display when I click the drop down.
@mr.dieharderrz
@mr.dieharderrz Год назад
Me too
@avmsteve
@avmsteve Год назад
And me
@avmsteve
@avmsteve Год назад
Click the send image to control net, then it will appear
@LevendeStreg
@LevendeStreg Год назад
You are absolutely awesome. Thank you. I've been waiting for this. So awesome!🙏
@Aitrepreneur
@Aitrepreneur Год назад
Happy to help!
@LevendeStreg
@LevendeStreg Год назад
@@Aitrepreneur By the way - have you come across Multi ControlNet messing up your images' faces? Because it seems to do that with mine. I've played with it a couple of days. And I can't seem to figure out what's doing it. But the quality of my images and details in the images look terrible when I apply more than one controlnet. Did that happen to you too? It's both locally on my own laptop - but also on sites like RunDiffusion and RunPod...
@sinceredeku
@sinceredeku Год назад
Do you know How mich ram is needed for this? The latent couple mask extension for. Example didnt Worked for my 6gb RAM...
@nio804
@nio804 Год назад
I barely get done testing one extension and there's already a new, improved tool available.
@CHARIOTangler
@CHARIOTangler Год назад
Jesus goddamn christ. I turn around for 1 damn second and there's already a new extension that gets automatic 1111 closer to clipping my toenails and wiping my ass for me😀👍👍👍.
@Aitrepreneur
@Aitrepreneur Год назад
Hahahaha :D
@kallamamran
@kallamamran Год назад
Now we just need a perspective view, locked limb-sizes and working IK and auto-balancing :P
@deathgg7790
@deathgg7790 Год назад
I had empty posex ui only "send image to controlnet"
@Space-O-2001
@Space-O-2001 Год назад
Just an an TLD/ FYI for those who can't be arsed with all of this Aitrepreneur covered a faster way (search for EASY POSING FOR CONTROLNET). One thing that puzzles me is what the head stalks represent in the skeleton, eyebrows ?
@sailaalias3161
@sailaalias3161 Год назад
My man really using Abyss orange Mix Hard for his demos 😂
@Aitrepreneur
@Aitrepreneur Год назад
I have no idea what this is tbh I was just recommended this model for some reason
@kalaMarko
@kalaMarko Год назад
@@Aitrepreneur Surely 😂
@mrrooter601
@mrrooter601 Год назад
I mean... isn't is clear with 2.0 that *"that stuff"* makes normal image generation better?
@lifemarketing9876
@lifemarketing9876 Год назад
It's getting gooder and gooder...This is exciting stuff!
@blurtam188
@blurtam188 Год назад
Are there any depth map libraries of hands?
@Aragonsson727
@Aragonsson727 Год назад
Exactly what I needed!
@tofu_it981
@tofu_it981 Год назад
Could we use the same thing for feet also? 😜
@iddeegee
@iddeegee Год назад
the latest Pose version does not work with the latest WebUI, no fix so far, no 3D Panel visible, one needs to rollback to the prev versions
@freedomgaming9987
@freedomgaming9987 Год назад
Im having a lot of issues as well with everything updated.
@coloryvr
@coloryvr Год назад
Very, very super cool! ....WOW!... Big FANX!!!!
@hirokyouto3054
@hirokyouto3054 Год назад
all hail our lord and savior Ai Overlord!
@myday6074
@myday6074 Год назад
Posex doesn't work for me for some reason. Installed, applied, I can see the tab, but it's empty.
@Aitrepreneur
@Aitrepreneur Год назад
Click on the checkbox "send to controlnet" it should appear
@Its_Asmo
@Its_Asmo Год назад
@@Aitrepreneur Thank you!! Also had this issue
@hogyodoshin
@hogyodoshin Год назад
@@Aitrepreneur Hi, I have tried on 2 different PCs to install it, there no 3d box with a squeletton appearing, checking the "send to controlnet" does not change anything. seems many people have this issue!
@cat-star5403
@cat-star5403 Год назад
Great video, but one question-- I see how you can grab the points and move them, but how do you rotate them, like making the head or waist rotate?
@madebyrasa
@madebyrasa Год назад
super cool, but blender is better for posing with ik, and this plugin doesn't keyoff the nose and eyes, which is required to make character face away from camera
@CerbyBite
@CerbyBite Год назад
what is ik?
@morizanova
@morizanova Год назад
Awesome, next evolution will be holding object depth map library right ?
@Gantz_T
@Gantz_T Год назад
can you make a video showing the best way to take a pre existing image with bad hands and fix them using these tools??
@-Belshazzar-
@-Belshazzar- Год назад
neat, only problem i see is that the 3d space is controlled only by the camera, so you can’t have different 3d perspective for two different open pose skeletons. sure they will have different poses but they will always have the same perspective which is kind of useless for more than one character. instead of of a camera, or in addition to the camera, a rotate skeleton (in 3d space) would be useful
@AZTECMAN
@AZTECMAN Год назад
Give it a week 😅
@IceMetalPunk
@IceMetalPunk Год назад
​@@AZTECMAN Day* at this rate
@AdamMaykov
@AdamMaykov Год назад
3D mode doesn't work
@JonnyCrackers
@JonnyCrackers Год назад
I can't get posex to work at all. I get the posex tab, the only thing that shows up is the checkbox that says "Send this image to ControlNet". Am I missing a prerequisite extension or something?
@cat-star5403
@cat-star5403 Год назад
Click that checkbox and it should appear
@Pianist7137Gaming
@Pianist7137Gaming Год назад
Just installed posex and it doesn't show an image of the skeleton, only one line of text. Does it not work with the latest version? Update: Use 3D openpose instead it works wonders
@francisquebachmann7375
@francisquebachmann7375 Год назад
Thanks
@codecrafted7330
@codecrafted7330 Год назад
its not appearing even though the extension is installed
@xapjna2901
@xapjna2901 Год назад
omg 😂 this is so easy
@khaleefaalhemli1020
@khaleefaalhemli1020 Год назад
hi there thank for the video its amazing , I am doing the same steps you explained in you video but somehow the depth extension disappeared and wont show a gain ant advice please
@wushingshing2012
@wushingshing2012 Год назад
Thanks for the tutorial, it is amazing!! Do anyone know why I tried to send the image to control net from depth library, it just sent the hand but not the open pose?🤔🤔
@mariorancheroni9427
@mariorancheroni9427 Год назад
Good stuff, they should add feet too...
@xanurz
@xanurz Год назад
MVP
@Snafu2346
@Snafu2346 Год назад
What's next? FEET? Hey curious, are those textual inversions subject to the same pickle stuff? I think those pickle scanners only scan the checkpoint model folders right?
@devnull_
@devnull_ Год назад
Probably nothing prevents you from using depth images of feet in that hand library, of course would be better to have categories for each body part.
@Nyxo1000
@Nyxo1000 Год назад
Sadly for me all work but when i generate the images the fingers stills deformed, the pose and the hands posture are perfect but the fingers still looking bad for me. I dont know why i have the same settings as you... Maybe is because im using stable diffusion 1.4?
@freedomgaming9987
@freedomgaming9987 Год назад
Now we just need the Save PNG to save to the Stable Diffusion Outputs Folder as a new Folder "Open Pose."
@angeldart3D
@angeldart3D Год назад
Hi, how can I make appear the Tabs Control Net - 0 - 1 - 2. In my end dont have those and have it updated with all the requeriments, and gradio updated too
@angeldart3D
@angeldart3D Год назад
nvm I solved it, had to setup the parameters in the SETUP of the control net and set multi control net, and add 2 o 3 more :D I let it here if someone else face this issue.
@hogyodoshin
@hogyodoshin Год назад
hi, thanks, but I don't get a squeletton image posex, there is just "send this image to controlnet" and target control number! very disapointing..😁
@CapeBiker
@CapeBiker Год назад
same here... did you manage to fix it ?
@sialiasialis.
@sialiasialis. Год назад
I wonder how well this works with composable LoRA, if at all
@gazorbpazorbian
@gazorbpazorbian Год назад
any idea of how I can train a model to use a 3d render and then add it to stable diffusion to ask for things with the 3d model?
@grillodon
@grillodon Год назад
How can I have different tab for different Control Model (like Model - 1, Model -2, etc.)?
@fernandochapa1433
@fernandochapa1433 Год назад
Hi AI i cant seem to install the models into controlnet, i only get the openpose thing on the preprocess side but it doesnt work there. any ideas on what to do? :(
@nvadito7579
@nvadito7579 Год назад
When I open and close the PoseX window (a few times), the interface freezes and no button responds to clicks. I have to restart the web UI to unfreeze it. Any solution?
@diego.spirit
@diego.spirit Год назад
when I open the poseX tab, only the box to send the image to controlNet appears. Just it
@122jeancarlo
@122jeancarlo Год назад
Im install the extensions, but i cant see it on the WEB UI!! what happen?¿?¿
@christianortel
@christianortel Год назад
how can i add multiple tabs to my control net webui to add the pose and the hand depth together
@MiaBrant-q8y
@MiaBrant-q8y Год назад
Unfortunately I can not seem to get the pose x to run properly inside of stable diffusion, I tried deleting and reinstalling it as well as running the python file inside of it. Running the python file seemed down download what it mentioned in the requirements file but gave me a separate local address to run it from, which I guess is a work around since it will not properly show up but I seem to be able to use it.
@naruto251097
@naruto251097 Год назад
Witch extension is the icons that are in your prompt area?
@thanksfernuthin
@thanksfernuthin Год назад
K! Are you in contact with any of these wizards creating this stuff? I'm still desperate for a tool that allows you to tell it where a character is looking... including eyes. It so desperately wants the characters to look at the camera 95% of the time.
@eldrickzero4885
@eldrickzero4885 Год назад
thats a tag looking_at_viewer
@thanksfernuthin
@thanksfernuthin Год назад
@@eldrickzero4885 Yeah. That's the easy one. Have you tried to get the character looking anywhere else? Every once in a while maybe. But never at the same thing.
@kabirgomez7967
@kabirgomez7967 Год назад
How I solve this error? "AssertionError: extension access disabled because of command line flags" I can't install any extension
@Spoot1RHGL
@Spoot1RHGL Год назад
Would you be so kind and do a top 5 stable diffusion extension video soon?
@elreydelanime12
@elreydelanime12 Год назад
help, when I pass it to controlnet the doll that he designs does not appear, that is, it only appears with a black background. any solution?
@kombi_kawa5507
@kombi_kawa5507 Год назад
Hi I already follow the tutorials but on My posex panel didn't show any skeleton that I can edit. Anybody know the problem?
@Lonil005
@Lonil005 Год назад
I can't seem to rotate hands in the depth map library. Anyone got any clue what to do? The top ultimate top square only displays a "stop sign" icon when hovered.
@FrancisGo.
@FrancisGo. Год назад
💞🙏💞 Thank you so SO much.
@Aitrepreneur
@Aitrepreneur Год назад
Any time!
@sayantandas5375
@sayantandas5375 Год назад
You are the best
@Aitrepreneur
@Aitrepreneur Год назад
Thanks! I Appreciate it ;)
@sinceredeku
@sinceredeku Год назад
I feel like i will need a New GPU in the Not so far future :') Do you have any recommendations for good gpus in the low to middle price section? (Max 450 €)
@AubreyWatt
@AubreyWatt Год назад
Your videos are amazing but I’m having trouble. I updated my web ui and everything broke. I know you made a video with info on how to revert back to a previous version using the hash number but I’ve been looking for two hours and I cannot find it. Please help!!
@JedidiJedidi
@JedidiJedidi Год назад
git reset --hard [hash]
@bethrains3105
@bethrains3105 Год назад
🙏
@alexanpt
@alexanpt Год назад
How do you get multiple Control Models in ControlNet? Mine only doesn't show "Control Model-0 Control Model-1 Control Model-2"
@Nyxo1000
@Nyxo1000 Год назад
Settings, controlnet, enable multicoltrolnet as you desire, apply and restart the ui
@alexanpt
@alexanpt Год назад
@@Nyxo1000 thank you!!
@yvonnek9197
@yvonnek9197 Год назад
I noticed the camera position is lower if use open pose and depth together, any solution on this?
@moosiemoose1337
@moosiemoose1337 Год назад
Make sure the resolution for the images in control net match the resolution your trying to generate
@122jeancarlo
@122jeancarlo Год назад
Guys Deph Library tab dont appears in my UI and also the Posex tab!! its a BUG? i restart the UI and my PC but its still not available, the extensions are installed but are not visible.... Someone know what happen??
@VlogYago
@VlogYago Год назад
4:22 Maybe it took in consideration, maybe she's doing the sign behind her back, we don't know
@otherworldstudio
@otherworldstudio Год назад
why the heck dont you number them?? Or write update in title?
@toshlyra
@toshlyra 8 месяцев назад
posex isnt showing that 3D windows, took me 2 hours to find a older version that works oO
@vi6ddarkking
@vi6ddarkking Год назад
Personally I am Going to stick with the Blender Addon I Am More used to it.
@justinthehedgehog3388
@justinthehedgehog3388 Год назад
Downloaded just fine but no model is there, just a blank box.
@diego.spirit
@diego.spirit Год назад
when I do the tutorial, the hands are dark in color
@hogyodoshin
@hogyodoshin Год назад
Apparently this does not work anymore, you should update..
@TomiTom1234
@TomiTom1234 Год назад
If someone knows how to make a depth map picture of any normal picture??
@JL_____
@JL_____ Год назад
He covered that in on of his previous videos. I think it's the one that says "This Is Huge" in the thumbnail and has two girls with their hands in front of their face
@Smokeywillz
@Smokeywillz Год назад
BROOOOOOOOOOO
@prace2k
@prace2k Год назад
Is it possible to create anime style characters with this? I tried using the blender 3d model for quite a few Anime models and it always tried to make the face Look realistic… is it the same for this method aswell or is it also trained for anime?
@stinkyjutsu
@stinkyjutsu Год назад
It sounds like you need to change your model to an anime based one and add more positive and negative prompts.
@prace2k
@prace2k Год назад
@@stinkyjutsu i already did that and it still tries to generate a realistic face
@stinkyjutsu
@stinkyjutsu Год назад
That's interesting, sorry that I wasn't any help.
@paulodyssey6507
@paulodyssey6507 Год назад
@@prace2k If you're still working on this, that's when you tinker with the prompt to emphasize the anime style.
@xanderfulton3186
@xanderfulton3186 Год назад
My only problem with these open pose models is that they default to full body and what I really want is waist up
@fr0zen1isshadowbanned99
@fr0zen1isshadowbanned99 Год назад
You should be able to drag the lower parts out of Frame and that should be all you need to do :)
@pouletfrite2927
@pouletfrite2927 Год назад
Juste need to wait 1 month for the same with feet 😂
@TeodorAngelov
@TeodorAngelov Год назад
Posex collapser is empty for me.
@AdamMaykov
@AdamMaykov Год назад
Sorry but 3d mode doesn't work
@Max-sq4li
@Max-sq4li Год назад
What about openoutpaint
@Aitrepreneur
@Aitrepreneur Год назад
not terrible not great tbh
@Max-sq4li
@Max-sq4li Год назад
@@Aitrepreneur Well, we trust your point ❤️👍
@mrGrecu
@mrGrecu Год назад
Is there a way to put an image as background to try match the pose manually with the plugin?
@harambae6101
@harambae6101 Год назад
it produces only stickman :D where did i go wrong i wonder
@will2see
@will2see Год назад
hi
@zifnab7691
@zifnab7691 Год назад
We need the same for feet, they are drawn just as bad as the hands by ai.
@Aitrepreneur
@Aitrepreneur Год назад
You can upload your own feet library for that or ask if other people did it
@ratside9485
@ratside9485 Год назад
PoSEX 🤣 has an interesting meaning in German
@blushingbutterfly7742
@blushingbutterfly7742 Год назад
Das ist wirklich unlustig
@Aitrepreneur
@Aitrepreneur Год назад
Which is???
@ratside9485
@ratside9485 Год назад
@@Aitrepreneur A-S e X
@PokettoMusic
@PokettoMusic Год назад
I noticed less joy in your voice, is everything okay?
@TheBlackFisk
@TheBlackFisk Год назад
Anybody working on feet?
@moosiemoose1337
@moosiemoose1337 Год назад
I tried but SD still has issues with feet. SD thought the control net images was the feet from the bottom instead of from the top.
@personmuc943
@personmuc943 7 месяцев назад
Everyone is complaining in the recent comments and yet you ignore them. What about warning us in the title that the extension is outdated and broken instead of ruining people's stable diffusion? Dislike.
Далее
КОГДА НАКРОШИЛ НА ПОЛ #shorts
00:19
I Built a SECRET Lamborghini Dealership!
33:02
Просмотров 12 млн
ВЫЖИЛ В ДРЕВНЕМ ЕГИПТЕ!
13:09
Просмотров 130 тыс.
WOW! NEW ControlNet feature DESTROYS competition!
9:08
Automatic1111 - Depth Library for ControlNet!
4:03
Просмотров 28 тыс.
КОГДА НАКРОШИЛ НА ПОЛ #shorts
00:19