@@marekpietrak8279 Yes, it is! Here is Sebastian ..having fun navigating for us all: Dude, you are surfing the wave of Stable Diffusion tubularly in an endless summer on a perfect wave 🌊. Thanks for keeping us up to speed 🚤 Steps: 20, Sampler: Euler a, CFG scale: 7, Seed: 683630813, Size: 768x768, Model hash: ad2a33c361, Model: v2-1_768-ema-pruned Orrr a little more like young Bob Ross with your quote>>>> surfing the wave of Stable Diffusion tubularly in an endless summer on a perfect wave Steps: 20, Sampler: Euler a, CFG scale: 7, Seed: 10228519, Size: 768x768, Model hash: ad2a33c361, Model: v2-1_768-ema-pruned Imagine the coffee house talk from a group of A.i. enthusiasts and their vernacular after a few cups of espresso 🤩🍮🍻
@@sebastiankamph soo what did da nuclear scientists say when dey finally achieved a safe fusion reaction? ...we got da Stable Diffusion!!! You may use that one anytime 😉
I just get random images with no likeness at all. I'm using A1111 and latest controlnet. Also, I don't see regular words like "depth" and "Style", I get three different versions of depth (depth_leres, depth_midas, depth_zoe) under preprocessor, and for Model I only see (coadapter-style-sd15v1). I tried them all, but nothing works. I'm not putting anything in the prompt or negative, just trying to get it work with the existing image.
This isn't working at all for me. No idea what's going wrong but i'm pretty much just getting noise. Enable is checked on both images. Has this process changed?
I don't see clip_vision of a few others in the preprocessor. what do i do to get them? also i didn't see any yaml files bring downloaded is that related?
how did you put the add lora and hypernetwork as a dropdown up top?? edit: also where do i find clip vision? i haven't found it yet i have everything downloaded
@@dexter0010 just add the name of any settings control you want to be in the top quick bar. Easiest way to find the name of a control is just change the setting then apply and the name of the control will be listed at the top where it shows the changes.
I did what you did but it gives me absolutely no result, i just get a jumbled mess of textures, not even a shape is left, i don't know what i'm doing wrong
Please don't do time (frame) skips while editing your video. Because there are lots of tweaks, sliders, dropdown menus; it is really hard for us to follow the video. I had to stop, go 10 secs back stop, etc... to get the workflow. I mean the video is 6:32 but it took me x2 time because of the skips. Don't get me wrong; learning lot from you as well as from this video. Thanks for everything.
@@Ur3rdiMcFly I disagree, there's already enough RU-vid content with too much energy. I just recently saw someone under a different video of his complement the relaxed presentation style and I agree, it's a lot more soothing watching something like this for technical content.
has anyone got the fp16 safetensors version from webui working? the one from tencent shown in the video works, but the webui version seems to have zero influence on the image generated.
guys i finally discovered the problem a lot of ppl from this comment section had (including myself) - you need to put all control net models to this path "stable-diffusion-webui\extensions\sd-webui-controlnet\models" and NOT to this path -> "stable-diffusion-webui\models\ControlNet" :)
I was getting much worse results until I switched to the deliberate_v2 model that I noticed you were using. What is that model supposed to be? I couldn't find any info on it, just happened to find it for downloading.
small note, canny from T2I works (300mb can replace 700MB), and vision as well, but others looks like not work at all? (i removed color as that one dosn't work as well) do your tests and then delete 700mb files
No, you're the man! Thank you my friend 💲💲💲. Maybe soon I can invest in some stuff to have in the background of the videos too. Did you like the tree? 😁
I don't know what I'm doing wrong, but I always end up with either b/w or sepia images. Changed the weight and navigation settings on both tabs - does not help (( Maybe it only works on square photos? I just wanted to change the vertical photo 720x1280.
Not sure if this is helpful: - I was getting black and white images when I used the light direction for the image to imagine - one solution is to increase denoising strength to 90 or 95% - you can also put 'grayscale' in the 'negative prompt'
@@AZTECMAN, I didn't use any light sources, like the prompt and the negative. I did everything, as in this video, I put a photo of people and used an anime picture in the second model. As a result, it is not done in the anime, and the colors also disappear ( Here the whole point is to change the style of the original picture without resorting to a prompt.
How did you get the ControlNet tabs to be side by side instead of one after another ? It would really help a lot in terms of space on the page and keeping everything neat and in focus.
I am trying to follow this tutorial to the T but all I get are random images that have no resemblance to the two control images. I have a person and a comic style as the two control images and I get landscapes etc as the generation result. It is as if SD is ignoring the controlnet altogether and generating promptless images. Any idea what could be going wrong?
Great sharing, I want to follow this video to do it again but found that I don't have the clip version, how can I get it, is the clip version integrated in the latest sd webui contraolnet?
I have 2 problems: 1 - I get black and white creations 2 - The pose is similar but the character is unrecognizable (I'm trying to use this technique to sylize a couple of portraits but the person in the creation is way more different)
For some reason, it doesn’t work for me as well as it does for you, although I repeated all the steps exactly to the point. If you leave everything as you have, then the pose is taken from the second picture, and not from the first, where the depth is turned on, if you reduce the impact force of the second picture, then the style disappears. Unclear :(
I must admit, I'm having some problems making use of this style transfer. I'm possibly going about this completely wrong but I'm starting with an image of a person and want to apply a style but retain the likeness of the person. I feel like the likeness gets lost in the process.
Thank you for your videos. I'm a Mac user and so I'm out of the games because all developments are done in Windows or Linux (I suppose). I have a Colab payed subscription, though. Is there a maintained ControlNet/Stable Diffusion implementation I can remotely use, as far as you know?
hey, the 1.5 models (canny/depth ext) are much smaller in this download location than the other location you referred to in another controlnet video. what is the difference? will they work the same if i get them all from here?
Is there a way to get it to act more like a filter, rather than a blend of the two images? I'd like to be able to maintain the exact likeness of a portrait while applying the new style onto it. For example, If i uploaded a photo of my face and used a black and white manga drawing as the style reference. It will morph my face. I just want it to look exactly like me but drawn using a manga pen. Is that possible?
Use this way Simply start with a fresh U.I, put your starting picture in the img2img tab, type in some promps about what u want, oil painting or whatever, play with the settings and voila. If u want your picture to be in the SAME style as your drawing, u gotta train a modele using multiples drawing of yours so the I.A can understand your style, then apply that lora to your promps on top of your original photo in the img2img and start generating Same process for doing slideshow videos
For some reason my output image doesn't look like the source models. I have a photo of a woman on one side and a painting of a woman on the other, but my output is some seemingly random image that bears no resemblance to either of them... I get animals, landscapes... what am I missing?
been trying to play with it for two days but there's a problem with Mac and can't play with it yet :( Opened a bug request on Github and waiting for fix. hopefully soon...
The t2 style model works for me, and I tried t2 color: RuntimeError: pixel_unshuffle expects height to be divisible by downscale_factor, but input.size(-2)=257 is not divisible by 8 and t2 canny RuntimeError: pixel_unshuffle expects height to be divisible by downscale_factor, but input.size(-2)=1 is not divisible by 8 Guess for them the workflow is completely different?
I'm not sure if I'm doing something very wrong - followed the same steps, but the image I get out doesn't have anything to do with the input. It's almost like the first model is getting ignored...
I am doing something wrong. The style is not being applied as it happens in your first examples. I can't even get the cartoonish style applied. I am rewatching this video for the 5th time.
I'm trying this out and not having much luck with it. The results tend to be pretty terrible. I wonder if it might be because I'm using the safetensors pruned controlnet models instead of the full size ones.
The examples in your thumbnails are fantastic but the examples you produce in the video looks almost as bad as the ones im getting. Would have rather wanted to see how you accomplished the examples in your thumbnail. So far just like your examples you are producing, its just producing a mess on my side. Not really transferring style. Almost better to just train a lora model and use normal img2img with controlnet is a much better option than this. Unless im missing something and there is a secret setting for the examples in the thumbnail to actually get something that is decent.
It’s interesting, but it seems to change the details of the character’s appearance a bit too much when changing the style. For example, the hair is one color in the original image, but on the output image, the hair contains multiple colors. Also, the outfit becomes different too. And the background seemed to change as well.
@@ackkipfer I also have a 1060 6gb, I keep getting 'CUDA out of memory' errors. I can't do this til I upgrade ☹ Can't do any CLIP vision or multi-control net. And slow at everything else. 45sec-1min for a 512x512 I avg 1 iteration a second on 512x512. Can't go above 1280x720 either, can't do full HD.
what abut new video for beginners about set up from scratch ? I mean full set up cuz lot new changes has came and there are lot videos with them. But if u want to set up from scratch u need look for all of them and don't know what video is up to date what isn't anymore. I hope my point is clear. Thanks) I like ur videos)
I feel you! You could probably get to 95% with my Ultimate guide and then my first ControlNet video. With it all changing so quickly it's hard to make a comprehensive guide.