I'm running into an odd issue. I'm following every single step to the T, and sometimes it works just as show here...other times instead of just the face in the masked area I'm getting a scrunched up version of the entire photo in the area instead of just the face.
Yes it's not obvious esp on mine for some reason it calls the dimensions section the "resize" feature, it isn't obvious that you can pick a custom dimension for when you render mask only.
@@subashchandra9557 Two weeks ago, when I wrote the comment, this wasn't common knowledge yet. ;-) Also having to create a fitting depthmap can still be somewhat labor intensive.
Dont work for me i dont know what the problem is in the preview i see a good face but in the last step i turns back to the bad face and the output is just a even worse oversharpend face
@@marksanders3662 Are you using a amd card? if so i think i fixed with --no-half in the command line. But idk since its that long ago and i switched to Nvidia.
the 512x512 inpaint method helped dramatically, but i think the denoising shouldn't be so high if you want to maintain a similar image to before, the less you want to change the lower you should make it. i set mine all the way down to 0.01-0.05 just to add a little detail sometimes. also as far as i know keeping the same prompt isn't always necessary.
Is there an extension that could do this automatically right after generating an image??? (I want to use this for videos, I need the frames to come out good right away)
I'm unable to reproduce similar quality results. Can you share more details on what you did to achieve this level of quality? Are you running in half precision or full precision mode? Did you toggle on the "color corrections after inpainting" option in settings? Where did you get the Lora model for this? I tried all the Ana De Armas Loras in Civitai, but it looks like the one you used in this video was not on Civitai. I suspect that your Lora model is the "magic" here that allows good inpainting results, possibly in conjunction with some settings you have toggled on.
Not sure I can help on the Lora side. But with my vanilla Automatic1111 and custom Checkpoint Merges, I had good results with this workflow: 1. Generate a prompt2image of a lady standing in some wooded/natural setting. Medium distance with a face that was decidedly 'sub-optimal' (I purposely did not do Hi-Rez upscaling). 2. I Upscaled that original 512x768 image in the Extras tab - 2.5x, ESRGAN_4x (I've switched to this from SwinIR_4x), no other upscale settings changed (all default) 3. I copied my entire Positive and Negative Prompt from the Prompt2Img tab over to Inpaint. Then copied my newly upscaled image to Inpaint. Same as he did in his video. 4. I Masked out the model's entire face and a little bit of her hair (but not all of it) 5. Sorry for the ugly formatting, but here are my Inpainting settings: Resize Mode: Just resize Mask Blur: 4, Mask Mode: Inpaint Masked (all defaults) Masked content: **Original** - I'm pretty sure *this* is the critical setting that needs to be selected for this to work. It keeps the original 'bad' face as a reference for general 'composition' when drawing the new face. Otherwise it will try to render the *entire* prompt, body and all, or just doesn't work properly. Inpaint Area: Only Masked (for the reasons he stated in the video, you only want it to focus on rendering your Masked area at the resolution you select below) Only masked padding, pixels: 64 - After some tests, I doubled the 'padding' value from 32 to 64. I found this helped the AI to 'see' the surrounding colour palette better, allowing the new face to 'blend in' better with her neck, shoulders, and overall skin tone Sampling Method: Euler A (same as prompt2img sampler), Sampling Steps: 60 (same as prompt2img) Width: 512 Height: 512 - for the exact reason he gave in the video CFG Scale: 7 (same as prompt2img). I didn't play with this setting, but I think it's fine left at the same level as your original render Denoising strength: 0.3, 0.7. My first attempt was at 0.7 and it was 'ok' or 'roughly Acceptable'. Until I lowered it down to 0.3 and tried again - I had much better results. A more natural fit for her neck and head position. Basically it used the original 'ugly face' as a closer reference point, but was able to render the whole face at 512x512 resolution Seed: -1 Restore Faces: Checked (I did not try it unchecked) And that was it. I think the flexibility probably comes with Denoising and CFG in how the image will look, and what variety you get with multiple renders. But a lower Denoising with a suitable "Only Masked Padding" set high enough to 'see' the surrounding area seemed to really help me get a face that blended in nicely with her body and the overall colour palette. Anyway, that's just my very brief and quick experience trying to fix some images that had 'broken' faces at medium / far model distances. Hope it helps!
@@mkalebornIm gonna try this now. It looks promising! My greatest problem with inpaint is that blurry artifacts is too clear to see when image is upscaled. Any repair for that? sorry for my english. I wrote this for almost 15mins
Amazing tutorial, thanks! Also, while watching it, I noticed the VAE and hypernetwork selection options on the top. I'm just wondering if that is an extension or something, because I don't have those options on my Automatic1111. Where can we find those please? Thanks!
As I understand, it is the area around the masked region that is looked up when it generates new image. So if you set it higher it will try to blend in better, if you set it lower, then it will make more drastic changes. Padding value only works when you set "Inpaint area" to "Only masked" since in the "Whole picture" mode the padding expands to the whole canvas.
I just dragged a copy of a previously generated images. The prompt and config info is stored as metadata in each images you create... so you can just drag them on the prompt feild and load them back in the interface that way.
When i try this, exact the same as you showed, it tries to paint whole prompt to that small area of the face, doesnt work with me, could it be the model i use?