Тёмный
No video :(

ControlNet Deep Dive - OpenPose 1.1: Add Faces and Hands to OpenPose - Detection, Settings, and More 

SiliconThaumaturgy
Подписаться 4,8 тыс.
Просмотров 6 тыс.
50% 1

This video is a comprehensive tutorial for OpenPose in ControlNet 1.1. If you are new to OpenPose, you might want to start with my video for OpenPose 1.0, since this video focuses on the additional face and hand functionality in OpenPose 1.1.
OpenPose 1.0 Tutorial: • ControlNet Deep Dive -...
First, we discuss the five pre-processors for OpenPose as well as what the maps correspond to in terms of anatomy. Next, I show how large faces and hand need to be to get reliably detected and other quirks to detection.
Later, I cover Weight and Control Steps and how they impact your output image. Previously, the single Guidance parameter was used which has been broken down into Starting Control Step and Ending Control step. Charts for the ranges of these parameters that keep face and hand details is provided.
Finally, I put everything together to discuss where OpenPose 1.1 is good and where it still struggles.
Chapters:
Intro: 00:00
Preprocessors: 00:35
Points for OpenPose Face: 01:25
Detection for Faces: 02:22
Points for OpenPose Hands: 05:29
Detection for Hands: 06:10
Weight and Control Steps: 07:46
Ending Control Step: 08:42
Starting Control Step: 09:49
Weight: 10:38
High Resolution Images: 12:35
Review and Discussion: 13:09

Опубликовано:

 

16 авг 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 18   
@sarpsomer
@sarpsomer Год назад
I felt like watching those article videos that they present their projects. Nicely detailed.
@BF-non
@BF-non Год назад
The way you breakdown these videos is clinical. Amazing bro, keep going
@nik-kun9827
@nik-kun9827 Год назад
a video on the workflow of getting perfect hands and anatomy would be great , like mixing depth maps , open pose and best ways to get those maps ( blender rig , photoshop etc) , Very helpful content , almost no one is covering this , can you link if there is official description about different preprocessors
@siliconthaumaturgy7593
@siliconthaumaturgy7593 Год назад
I don't think I could make a video on perfect hands and anatomy in good faith because afaik, especially with hands, it's still a numbers game. Tutorial on multi-controlnet sounds promising. I might look into that. If anywhere has official desciptions of the preprocessors it would be from ControlNet's creator, but I don't think there is. github.com/lllyasviel/ControlNet
@garywkfung
@garywkfung Год назад
There were two things I was really hoping for in 1.1. Reliable hand reproduction (which as you have noted, has failed). And second, reliable reproduce of facial expression/emotion (happy, angry, shouting, rolling eyes etc) I was not able to either. Can you give some tips on whether you are able to?
@siliconthaumaturgy7593
@siliconthaumaturgy7593 Год назад
For facial expressions, you can get some details from the map that help, (mouth position, etc), but prompting is still needed. I've found that active descriptions (yelling, clenched teeth, frowning, etc) are better than passive descriptions (angry, sad, etc). Eye position works sometimes, but I think there are detection issues Some images can do it consistently at high weights, but others with very similar eye positions just don't work
@marschantescorcio1778
@marschantescorcio1778 Год назад
It's a step in the right direction but has a long way to go. Still far too many deformations in the result. Faces I'm not fussed about but hands and limbs are a mixed bag. Also the editor needs some work especially when you're trying to adjust the skeleton. That said I watched a video on DW_Pose preprocessor that generates far more accurate results, may be worth looking into. I still haven't found a good editor or way to generate maps. The few good riggers I've tried sadly don't output to OpenPose.
@LeroyVGANG
@LeroyVGANG Год назад
Tfw your videos are so detailed and well-tested that they take forever to get produced and released 😞
@siliconthaumaturgy7593
@siliconthaumaturgy7593 Год назад
This is the way
@LeroyVGANG
@LeroyVGANG Год назад
@@siliconthaumaturgy7593 This is the way
@tazztone
@tazztone Год назад
are these detections in 3d space? any way to adjust hands manually if detected poorly?
@buddy2665
@buddy2665 Год назад
Bro can you make a video about merging models, mainly i want to know about MBW and what each sliders do when merging models. I was using supermerger and model block weight extension and tried to merge models but due to lowvram i couldn't finish my experiment because it was taking so long to merge and then generate images.😅
@siliconthaumaturgy7593
@siliconthaumaturgy7593 Год назад
I appreciate the suggestion, though honestly I haven't messed around with merging models much so I'm not super confident in my ability to deliver quality content on it.
@kofteburger
@kofteburger Год назад
Is it possible to use existing skeleton poses with a different image for the face? Do I need to manually merge key points with skeleton?
@siliconthaumaturgy7593
@siliconthaumaturgy7593 Год назад
I haven't experimented with that, but it should be possible. However, the basic skeleton has points for eye and ear position, so you would probably need to change or remove those to prevent conflict with the new face.
@genin69
@genin69 Год назад
I still dont know how to use open pose
@The49Halo
@The49Halo 11 месяцев назад
>0:33 🧐 >CIA?
Далее
❌Разве такое возможно? #story
01:00
Why Starbucks Is Struggling
12:06
Просмотров 1,1 млн
I forced EVERYONE to use Linux
22:59
Просмотров 356 тыс.
Japanese web design: weird, but it works. Here's why
11:49
The Greenwich Meridian is in the wrong place
25:07
Просмотров 738 тыс.