Create Consistent, Editable AI Characters & Backgrounds for your Projects! (ComfyUI Tutorial)

Подписаться 66 тыс.

Просмотров 57 тыс.

50% 1

I'll show you how to use ComfyUI to create consistent characters, pose them, automatically integrate them into AI-generated backgrounds and even control their emotions with simple prompts.
If you like my work, please consider supporting me on Patreon: / mickmumpitz
Follow me on Twitter: / mickmumpitz
I developed this ComfyUI workflow in preparation for one of the next AI 3D rendering workflows, in which we will look at animating characters. But you can also use this workflow for many other exciting things: to create children's books, AI movies or one of these AI influencers everyone keeps talking about!
You can download the FREE workflows here: www.patreon.com/posts/new-vid...
Chapters:
00:00 Intro
01:09 Character Sheet
04:49 Loras & Midjourney
05:48 Controllable Characters
10:42 Outro

Опубликовано:

17 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 199

@BobDoyleMedia Месяц назад

Outstanding! Thanks for sharing these workflows so generously!

@xnovamix Месяц назад

This was an amazing tutorial. Thank you!

@dennisliebelt3951 Месяц назад

Hey thanks for your great content. Always enjoy your videos !

@Srcfrvr 22 дня назад

This is amazing. Thanks for everything, brother.

@vrynstudios Месяц назад

Genius work.

@IsiOmoifoJr Месяц назад

Great tutorial. Thanks!

@beker-aman Месяц назад

i dont even remember liking this video, this is mind blowing.

@unterwegschloe1017 3 дня назад

Incredible! Thanks for your work~

@user-zl8yq7jt9f 10 дней назад

Excellent video, congrats and ty

@KapitanAI. Месяц назад

some good stuff right here

@laemon300 13 дней назад

bro, you a lifesaver!

@sake4941 Месяц назад

Very interesting. Not only about workflow but your quick explanations are very great and valuable. Thank you a lot for that !

@tstudying5319 Месяц назад

that is really cool and helpful!!

@farcfoxguerrilha Месяц назад

Very good! Thank you!

@Bloodysugar 18 дней назад

Oh boy this is an amazing workflow ! Thank you so much for sharing !

@ivanprokounin4029 Месяц назад

Dude! God bless your curious mind and a generous heart!

@larziz573 17 дней назад

great work !

@SahiShah-ru3ib Месяц назад

Great work bro that's what i want thinking of creating model for character

@maureenbenner7588 Месяц назад

This workflow worked great for me! thx

@endedbrand2324 27 дней назад

how did you get the workflow he imported into ComfyUI?

@clementfrerebeau5458 12 дней назад

@@endedbrand2324 it's Mickmumpitz_CharacterSheet_v01.json

@alpaykasal2902 23 дня назад

you're so frikkin' awesome.

@mottentotten Месяц назад

Definitely gonna try this! Thanks! 🧀

@pn4960 Месяц назад

The ultimate goal

@hugodom 13 дней назад

Great video and finally a useful tutorial…

@johannezz 6 дней назад

Excellent!

@user-lr4to2lr9r 7 дней назад

真是个相当棒的创意工作流😁

@FabioAngela Месяц назад

very interesting!

@legshots3124 Месяц назад

always doing something unique and helpful content

@Mrim86 Месяц назад

Man, I wish I wasn't so intimidated by that UI. This looks really incredible.

@DaCashRap Месяц назад

Just go ahead and give it a shot. It's not complicated at all once you try it

@davidpenn4024 Месяц назад

Checkout Olivio's Comfy Academy and you can go from 0-competent

@A5h3n. Месяц назад

Yeah try it out. I've only made 2 workflows myself, it is pretty hard, but the workflows the community give out help understand more.

@digitus78 Месяц назад

Just try it. Download some pre-made workflows and play with the settings. Won't even touch another webui now. None are as versatile not even close

@laurosf 29 дней назад

Try it! This is my first day exploring and it's actually very intuitive once you start to understand how things work

@yorkane123 Месяц назад

greate video!

@DiogoVKersting 4 дня назад

very nice

@davidpenn4024 Месяц назад

Top Tier!

@oneshotonepic8319 13 дней назад

Amazing

@ZooDinghy Месяц назад

Jesus Christ! This is awesome! 🎉

@ismgroov4094 Месяц назад

thanks a lot

@WeekendDive Месяц назад

Absolutely fascinating video. So let's say I generate 2 keyframes, one where Hans grabs the cheese, and a second where he is holding the cheese over his head triumphantly. Is there a way within comfy to generate the 12 or so frames inbetween, creating a custom animation out of our custom poses?

@amkire65 Месяц назад

Fantastic, this is the sort of thing I've been after for a while. I suppose when it comes to the consistency of the clothing the simpler the costume the better?

@magicmaxx6346 15 дней назад

Awesome

@vrynstudios Месяц назад

Please write a book or make a UDEMY tutorial. I will join. You know what you do and perfectly. Love the work. Thank you,

@cihatfg Месяц назад

perfect : o

@niaschimnoski882 Месяц назад

I'm commenting so I remember to watch this soon once I have more stamina charged up (just woke up) (been chronically sleepy and cranky for the past like 7 or 8 months 😢)

@lefourbe5596 Месяц назад

Why is that also me X) ?

@o3ulag 13 дней назад

Beautiful

@Ancient_AI 21 день назад

Thank you! I've been trying to figure out a good workflow for this for some time now. Well done.

@FabioAngela Месяц назад

I'd find interesting digging more into the LORA, explaining how to use the saved faces to train lora.

@armaxkovalenko1230 21 день назад

Man, you are simply God! A year ago I tried to do the same thing in A1111, and it didn’t work. What you created is a masterpiece. Thank you!

@Cevherbenn 25 дней назад

Teşekkürler.

@shixiongsong Месяц назад

May I ask what posture editing software you are using, as well as the software for generating hand depth maps

@dannylammy Месяц назад

Very interesting, how does this do when you combine it in conjunction with your previous videos with control net? IIRC there were programs like Stable Projectorz, so wouldn't it be possible to get nearly perfectly consistent characters by projecting character sheets like these onto 3d models? Hmmm...

@chiselpeakstudios2593 Месяц назад

This is amazing! I keep getting an error that says "clip Vision" model not installed.

@Jimwatl 7 дней назад

Hello, thank you for sharing your work. Is it possible to create a Model Sheets from a reference character image ??? and if so, what node would you add? In short, how would you proceed?

@user-sh7sl7ys7b 13 дней назад

Which hardware are you actually using to create those awesome images and videos?

@needsomenice 13 дней назад

Super tutorial, thanks. I have a question, with you in comfyui the photos look super zero distortion, ugly eyes, face or hands. With me, on the other hand, it is always in ComfyUi. What do you do to make everything look this good?

@naturalborngamer169 Месяц назад

I'm not quite there yet...Thx for the vid

@user-bj5cp8qy2p Месяц назад

The best consistent character workflow so far. How about saving separate workflow between sdxl and sd1.5 for easier use?

@marcos13vinicius11 19 дней назад

that's awesome! I've just finished a personal project which this would have been so helpful and I wouldn't have to generate literaly thousands images and compose everithing with photoshop and hour and hours of inpaint and outpaint. I'm looking foward to use it in a new project. Could you show us now how to make it with multiple characters?

@snick9314 Месяц назад

incredible tech, scary how few real artists the industry will probably have in 5 years time. Overall depreciation of quality and interesting character design over time in the interest of turning the cog wheels of consumption content out as fast as possible. 10% will use this for good the rest of it will be used to save money and time in an area where money and more importantly time should be spent on this subject. Awesome tech, horrifying corporate application.

@user-wy4uf3jx4f 27 дней назад

I would like to input an Image instead of the Positive and Negative prompts connected to the Apply ControlNet (Advanced) node. How can I achieve this? The intention is to create an Image -> CharacterSheet, rather than a Text -> CharacterSheet. I would like to use my favorite character, but I'm tired of having to create new characters all the time. I am using the workflow effectively! Thank you.

@juxxcreative 21 день назад

This is very cool. Can you do also this for a very realistic person, please?

@SolveForX Месяц назад

We really need to have different camera angles, though. The character consistency is great, but we need to be able to take this same premise and be able to, like, take a picture or a rendering of a 3D model and get the angle on the consistent character.

@whadoyaneed 11 дней назад

Great tutorial. finally someone, who explained the whole procedure, how to turn the character sheet to actual images. The main problem is still with the background, which is always blurry with AI generated images, makes them unrealistic. If you check real photos, the backgrounds mostly as sharp as the subject, even if you look for photos like ... climber in the mountains or whatever. So there is any way to maintain the sharpness of the background?

@leandrogoethals6599 Месяц назад

Mick how did u display the stats in comfyui is that a extension? U know like the vram and such

@MyBearo 14 дней назад

Hi where can I get the IpAdaptorunified loader node and also the IPAdaptor (also missing in manager) ? Thanks in advance :)

@endedbrand2324 27 дней назад

I got everything, but I don't understand where I can find your Workflow (template), please help!

@MrWiki_ 15 дней назад

amazing vid, i have one little issue, where do i get and put the upscale model at? it seems i am missing this ? edit: nvm i seen the file name so i just google it and found the upscale model and everything runs good.

@Liqwalker123 22 дня назад

So we can create these sheet and then use a image2image faceswap right? im looking for faceswap, same clothes, different poses workflows ^^ need consisten characters, as an exapmple for an comic book

@Mind_ConTroll Месяц назад

Can we add an image prompt instead of a text prompt to use a character we already have? I know it's prolly easy, but I'm new to comfyui.

@moritzryser 22 дня назад

do u think the character creation could be enhance by integrating IPAdapter on top of checkpoint and lora?

@futanari-eo5np Месяц назад

Any help so I get add nodes to get a consistent background with your workflow ?

@torq21 Месяц назад

I just watched the image to 3d model video. I don't see why you couldn't generate multiple views using this method and then generate a more complete 3d model from the output. It would be more like photogrammetry.

@offmybach 25 дней назад

Can this wf be altered to begin with an existing image that you've created instead of text?

@kordou 20 дней назад

Thanks fo this greate tutorial!!! in the second workdlow theese two nodes, CannyEdgePreprocessor DepthAnythingPreprocessor because the ComfyUI Nodes for Inference.Core conficts with lots of elements. trie to install manually alnso bu still nothing. any solution so that we can follow ?

@JussimirPasold 9 дней назад

Hope midjourney releases a pose reference feature with openpose support soon

@PixilGraphics 21 день назад

Thanks you so much, can i download the character as FBX file?

@joedoe6737 26 дней назад

Im having an error on the second workflow, on the first Ksampler : Error occurred when executing KSampler: Expected query, key, and value to have the same dtype, but got query.dtype: struct c10::Half key.dtype: float and value.dtype: float instead. (And gibberish after that...) I don't know what to change...

@JoyDavidson Месяц назад

I just can't believe this is real life.

@SudarshanAshiya Месяц назад

Wow

@itsthejdquest 17 дней назад

Super complicated for someone with no coding or IT experience. Could not figure out how to run the manager as there is no run feature after getting it from github. After seeing the rest of the instructions, I know now I do not have the level of proficiency to do this tutorial. Any resources for learning this kind of thing?

@USBEN. Месяц назад

Automation is soo fun!

@n3bie 27 дней назад

Hey I got these workflows installed in comfy and everything looks great, but I have one little holdup. Where do I get the 4 image files that you're using in the 2nd workflow (the posable character flow) that are briefly showing @6:16? You have them as Face_upscale_00019_.png, Face_upscale_00053_(3).png, pose_2024_04_15_19_23_png, and depth_2024_04_15_19_23_30(11)png, but when you download the workflows it shows them as FaceRefine_00087_(1).pgn, FaceRefine_00059_(3).png, Pose_2024_04_26_16_31_12.png, and depth_2024_04_26_16_31_12(1)png. I've searched for these filenames on the web and can't seem to find them on Get or Huggyface. Not sure where to go from here :/

@alejandrogarcia9472 11 дней назад

Thanks for your amazing tutorial. I've followed all the steps, and I still don't know why, when I start the process, all I get are black images. Can someone help me, please?

@zhaoyongDin 25 дней назад

Killing it with Midjourney! But if you're ready to take things up a notch, Stylar's your go-to. It's like a design powerhouse, especially for interior, 3D, and character work!

@BobDoyleMedia Месяц назад

Your "IPAdapter" node is different than the "Load IPAdapter" node by your expressions. I'm getting an error in my "Load Adapter" mode, and there are no models in the dropdown list there, although I have all IPAdapter models loaded.

@juxxcreative 19 дней назад

Same here. I have tried to download whole model but no luck. Still getting the same error.

@ernienosoul 7 дней назад

@@juxxcreative did you solve that? same error

@juxxcreative 7 дней назад

@@ernienosoul unfortunately no

@ernienosoul 7 дней назад

@@juxxcreative @sam5519 hace 1 día For people facing "IPAdapter model not found." and using ComfyUI from StabilityMatrix. ComfyUI Manager downloads model to StabilityMatrix\Packages\ComfyUI\models\ipadapter, but workflow trying to load model from StabilityMatrix\Models\IpAdapter. What you need to do is copying all models to StabilityMatrix\Models\IpAdapter

@ernienosoul 7 дней назад

it worked for me :)

@reza2kn 10 дней назад

@02:29 "I'm really happy that it's THIS type of moustache!" BRUH!💀🤣 Awesome tutorial and channel btw❤

@gastonm 12 дней назад

Can you create this from an image? i mean if you allready have a character.

@WallyMahar 11 дней назад

What do you call an object character sheet? I would love to create different views so I can apply them in a 3D program. Like a car .

@AcquiredCents День назад

You look way better with the haircut btw. I'm looking for an editor with skills like that, I get some of it.. but stuff like mouths moving gets incredibly difficult for me. I'm behind the curve.. I can edit videos, I can't do characters well.

@xueqinghuang5021 7 дней назад

where to get the "perfect hand v2" lora, thx

@dariodol 11 дней назад

can you load a character from an image? thanks

@vibeshkarayil 10 дней назад

Hi, thanks for putting together this video. As a creator myself I truly appreciate all your efforts. Positively i manage to generate charachter using the first workflow, but got stuck when i got error "Error occurred when executing IPAdapterUnifiedLoader: ClipVision model not found." Similarly when i went to compositing I have the same error. Any pointers on what i could be doing wrong? I downloaded ip adapter models and clip vision models (but renamed them to clip vision 1 and clipvision 2 ) because the instructions was not clear. Could that be the problem?

@vibeshkarayil 9 дней назад

Ok it was actually my bad. I installed ipadapterplus nodes from the comfyui interface which solved the issue! Once again, this is the best tutorial on comfy UI consistent character!

@eddiej.l.christian6754 Месяц назад

Clip vision model not found error What am I missing?

@chiselpeakstudios2593 Месяц назад

same here

@chccreative 29 дней назад

same

@cassianoaraujo78 16 дней назад

I tried to do it in COMFY and I just couldn't... is there a way to develop it directly in Midjourney?

@zaichenhu679 Месяц назад

It seems like the workflow link cannot be opened, and I didn't see your Discord link either.

@yanamorim5747 Месяц назад

looking for a workflow not for generating a scene but to add more detail to a 3D render

@CaptainSnackbar 20 дней назад

as an artist i have to admit this is impressive and if this helps me create stories so be it. i'll still do art but this will speed up the pipline

@hvsciverius 21 день назад

I am no longer wanted to learn AI, I just want cheese!!

@-Belshazzar- Месяц назад

Thank you! Great video. Though I must say, sdxl openpose is very lacking, completely off and not accurate. No matter what you do, it's no where near as accurate as 1.5 which is my main issue with sdxl and why I am a bit fed up with stable diffusion in general

@eddiej.l.christian6754 Месяц назад

Where do I get the Upscale model that's missing in the first workflow?

@stockiom 19 дней назад

me 2 , have you found it ?

@DeanCassady Месяц назад

what happen to your vRam 2:38

@pn4960 Месяц назад

Nice haircut btw

@mohitarora7032 25 дней назад

What if don't want human poses how are we suppose to ger poses of another animals or even aquatic animals

@ottomiranda6786 25 дней назад

I have the same question. Everything works great, but I do not want to generate a human pose. I am trying to generate a teardrop, like a waterdrop but I have not successful