Тёмный

ComfyUI Tutorial+Workflow: Inpainting only on masked area, fast outpainting, and seamless blending 

Elezeta
Подписаться 392
Просмотров 2,8 тыс.
50% 1

This tutorial presents novel nodes and a workflow that allow fast seamless inpainting, outpainting, and inpainting only on a masked area in ComfyUI, similar to the AUTOMATIC1111 feature but with extra flexibility.
The main advantages of inpainting only in a masked area with these nodes are:
- It's much faster than sampling the whole image.
- It enables setting the right amount of context from the image for the prompt to be more accurately represented in the generated picture.
- It enables upscaling before sampling in order to generate more detail, then stitching back in the original picture.
- It enables downscaling before sampling if the area is too large, in order to avoid artifacts such as double heads or double bodies.
- It enables forcing a specific resolution (e.g. 1024x1024 for SDXL models)..
- It doesn't modify the unmasked part of the image, not even passing it through VAE encode and decode.
- The nodes take care of good blending.
The Inpaint Crop and Stitch nodes can be downloaded using ComfyUI-Manager, just look for "Inpaint-CropAndStitch".
The example workflow featured in this video can be downloaded from github.com/lquesada/ComfyUI-I...
I hope you like them!! Subscribe for more :)
The song playing in the background is "The last dial-up handshake", from the album "Last Transmission" of my music project "Elezeta". Check it here: • The last dial-up hands...
#comfyui #stablediffusion #genai #inpainting #tutorial #workflow

Наука

Опубликовано:

 

8 июн 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 30   
@NeonSparks
@NeonSparks День назад
This is exactly what I have been looking for! Amazing, can't wait to try this. Thanks
@elezetamusic
@elezetamusic День назад
@@NeonSparks thank you!! Enjoy!
@skycladsquirrel
@skycladsquirrel 4 дня назад
Perfect. Thank you. Subscribed!
@Daralima.
@Daralima. 17 дней назад
These nodes make inpainting in Comfy super convenient and easy to adjust to your needs. Thank you!
@elezetamusic
@elezetamusic 10 дней назад
Thank you!
@Krashl
@Krashl 21 день назад
Thanks for the work! I use these nodes all the time to inpainting, but I was missing some features like custom sizing and blurring the mask (because this node creates hard mask borders by default), and the abrupt transition was visible on generations. I am very glad that the recent update has improved all of this
@elezetamusic
@elezetamusic 21 день назад
Awesome!! I'm glad that you found it useful. Thanks a lot for commenting.
@MarcSpctr
@MarcSpctr 20 дней назад
seriously great work 👍🏻
@elezetamusic
@elezetamusic 20 дней назад
thank you!! :)
@Pyugles
@Pyugles 20 дней назад
Thank you so much! This is a fantastic set of nodes, and great tutorials on using them! You've definitely gotten a sub from me!
@elezetamusic
@elezetamusic 20 дней назад
thank you!!
@nataliaraz9144
@nataliaraz9144 9 дней назад
brilliant, thank you so much
@elezetamusic
@elezetamusic 8 дней назад
Thank you!
@CemilAL
@CemilAL 20 дней назад
good job 👍
@elezetamusic
@elezetamusic 20 дней назад
Thanks 👍
@831digital
@831digital 6 дней назад
Instead of manually painting the mask in, do you have an example of this working with a detector that generates masks? This would make it more useful for animation.
@elezetamusic
@elezetamusic 5 дней назад
No, but you can easily put it together :) give it a go!
@831digital
@831digital 5 дней назад
@@elezetamusic I tried doing it with SEGS, but SEGS resizes the video and throws an error when trying to feed the mask back to the original. If it's super easy, please share an example.
@mahilkr
@mahilkr 10 дней назад
Hi @Elezeta, excellent work! How can I generate multiple variations of a stitch? Currently, it only works with the repeater set to a value of 1.
@elezetamusic
@elezetamusic 10 дней назад
Hey, please provide more details on what you want to do. If you want to generate multiple images, you could enqueue the job multiple times or in comfyui advanced options, set a higher batch number. If you want to use a repeater node, you'd have to repeat both the image and the masks (not sure if the repeater node can do masks). Not sure if I answered your question. If not, please let me know what you mean by "it only works...". Does it give an error?
@user-rk3wy7bz8h
@user-rk3wy7bz8h 18 дней назад
Hi ,very nice node thank you a lot. I have a question, How can I do upscaling before sampling ,what is the meaning of that or how can I do it? Iam not sure if you mean what I think. I think of cutting an area around a 'Face' and upscale only the face, and stitch the upscaled face back. Can you help me?
@elezetamusic
@elezetamusic 18 дней назад
If you set mode to ranged size or forced size, the cropped image is automatically upscaled (or downscaled) to fit that resolution. Then you sample on it, and then during stitch it is returned to the original size. So you don't have to worry, the node takes care of it for you! You can check it by previewing the cropped image and checking its size
@ARAI96969
@ARAI96969 16 дней назад
Thank you so much for this node! Before this I've never found a way to do inpaint one area without sending the whole image to Encode and spoiling the overall quality.. This Is a god send!! But I do have 1 query on which setting should I do if I wish to inpaint a large area (example 1/4 of the whole image to mask a whole character) and change a character entirely with another lora character, thus creating 2 unique characters interacting Cause if I mask a large area, the output is usually very bad, lacks details and distorted, do I upscale and area, Downscale it or increase size of mask perhaps? Thanks if u have any tips, cause I wish to keep my workflow simple and avoid using segment and auto detect to mask and repaint characters to my lora. I prefer to choose and mask them myself for more control
@ARAI96969
@ARAI96969 16 дней назад
Hi, do u have any tips for inpainting larger areas? Cause I used your settings but it will generate distortions, any advise on good settings would be greatly appreciated
@elezetamusic
@elezetamusic 10 дней назад
@@ARAI96969 well, for larger areas I'd suggest to inpaint the whole area first, then detail the key areas in it with several passes. You could also consider a tiled sampler. There's no magic solution to sample on higher resolutions with high detail in a single go and fast.
@dfhdgsdcrthfjghktygerte
@dfhdgsdcrthfjghktygerte 20 дней назад
I want to erase something from a skin and flood fill it with just one color that maches the surroundings. Is this possible? When i try to use the "skin" or "color" prompt - it inserts faces or random stuff into the masked area.
@elezetamusic
@elezetamusic 20 дней назад
hi! extend the context area enough so you can see where the skin is (e.g. an arm, a leg, whatever) and then type in "an arm", "a leg", or even extend the context area further to show there's a person, and then type a prompt like "a person". that will give the sampler enough context to fill in the gap seamlessly.
@elezetamusic
@elezetamusic 20 дней назад
also, use an inpainting model, they work much better and don't add random stuff in the masked area
@joelandresnavarro9841
@joelandresnavarro9841 20 дней назад
Hello 🙋🏻‍♂️, you could consider improving the compatibility of using these nodes with the comfyui-photoshop extension (NimaNzrii) When sending photoshop, he mentions that the image and the area are not the same size. I don’t know if it’s a problem with your node or rather with the extension for psd
@elezetamusic
@elezetamusic 20 дней назад
Hi, I do not have photoshop and can't install that extension. Anything related to photoshop integration you should reach out to who developed that node. Cheers!
Далее
ComfyUI Outpaint workflow #comfyui  #outpaint  #workflow
4:32
Custom Keyboard From Scratch Part 2
17:13
Просмотров 22 тыс.
Inpaint and Supir Upscale Workflow in ComfyUI
8:54
Просмотров 4,9 тыс.
Free Online Ai Art Generators That Don't Use Discord
8:56
💅🏻Айфон vs Андроид🤮
0:20
Просмотров 740 тыс.