Style Transfer Adapter for ControlNet (img2img) 

I can not wait to apply this to my AI Animations. This is a huge game changer. Using less in the text prompt area is a step forward for us. Having two images being the only driving factors should help a ton with cohesion/consistency in animation

incredible amount of useful information in this video. thank YOU!!!!!!

Great video :-) Thanx for sharing

Thank you! very interesting!

Thanks for sharing this! Very cool that they’ve added this style option. Excited for your next video on connecting it with eb synth. I’ll watch that next and see what I can do as well. But damn, these Davinci Deflicker/Dirt removal render times are killing me haha

Guidance start is about *when* it starts to take effect.

Really cool thanks for sharing! I wonder what would happen if you put 3d wireframes in the controlnet lines instead of the generated ones, could be very temporally stable

@2:47 thank you so much for that i was thinking of reinstalling controlnet just because of that

Thank your very much

Ur a legend

hi Sir., thanks for making those good videos on style transfer, i have a question , is there a way to change a person's outfit based on a input pattern of picture? using style transfer and inpaint? thanks in advance

Thanks for another informative video. This style transfer feature already makes Photoshop’s Style Transfer neural filter look sad by comparison. It’s clear that Stable Diffusion’s open-source status, enabling all of these new features, is leaving MidJourney and DALL-E in the dust.

Ahhh yeah

Great Video ! Trying to update my xformers, it seemed to install a later version of pytorch that no longer supports cuda, and the version of xformers you used is no longer available, how do I fix this?

It turned Barret into President Shinra 😂

I need help, when I generate the result is way different than the actual image im using.

Hey I was going to tell you how to get after effects to pull in multiple png sequences and autocross fade them. You have to pull them in and make each ebsynth outfolder it's own sequence. Then right click all the sequences, create new composition, in the menu there is an option to crossfade all the imported sequences. Specify with the ebsynth settings. Voila!

Great video man! I been learning so much from your vids. it might be a rookie quesion but I got stuck on the third controlnet model when you choose clip_vision under the preprocessor, I dont seem to have that option. Is it becuase I have to use a certain version of SD? thanks!

love your clear instructions. I'm following along but my system seems to get stalled on the HED and clip vision controlnets. Any tips for when this happens? I keep restarting. Am trying same steps but first only doing one control net at a time to see if it works, and then adding each controlnet after it successfully runs. So far the HED is definitely slow to run. After this will try clip vison/T21style by itself (as one control net tab).

The color adapter works for me, but the style adapter does not. The Guidance Start value doesn't change anything. The result is the same as when ControlNet is turned off. Please tell me how to fix this? Thank you!

this is really a cool way to get it ... thank you!did u explain the way to bring a whole img sequence into comfy to get your great 0:20 result? thx in advance!

any tips on how to build this with ComfyUI?

Nice find bro !! ....yeh consistency is still a problem with video, i find lowering the denoising strength helps but then you lose the style,..its a double edged sword ⚔️

Hello. What about style transfer in images? I'm looking for information about this but haven't found anything. For example, I want to make a series of images of animals. I have a photo of a tiger, a pencil drawing of a horse, a pencil drawing of a bull (but by a different artist), an ink drawing of a wolf, a watercolor drawing of a cheetah... and I want to transform them so that all these images are done in the same style, like as if they were painted by the same artist. Is there any product that can help achieve this goal?

Looks like Gen-1 will have competition…

hi, I have created more than 70 images with stable diffusion, and I would like to know how I can transform these photos into a moving animation with the same photos, could you help me?

Have you looked at the new Ebsynth_Utility extension to A1111?

I am not getting great results like you out of the box, i have to play a lot of slides for starting showing, wondering what i am missing here lol

Thank you! What should we choose as Control Type? All? Also, noticed that generating image with txt2img controlnet with given image it takes veeeeery long time, though my machine is decent. Do you have the same?

i try use this new controlnet extension and get not style in generated result. i remove all prompts (using img2img with 3 controlnets activate: cany + hed + t2iadapter with clip_vision preprocessor), in generating process appears error: "warning: StyleAdapter and cfg/guess mode may not works due to non-batch-cond inference" and generated result appears with not affected style =( frustrating .... i try many denoising strengths in img2img and many weights on controlnet instances without success... not applying the style on final generated result =( try to enable "Enable CFG-Based guidance" in contronet setting too, and still not working =( anyone got this same issue?

Why did you provide a Link for style Adapter, but Not for the clip_vision preprocessor?

Hi! I really ask for help, I'm desperate :( Clip Vision preprocessor is not displayed (automatic1111), and I can't find where to download it. What am I doing wrong?

I made a post about making sure you deal with the ymal files, but I think it got deleted because it linked to Reddit. Anyway, there’s some work to be done if you haven’t.

where do you get clip vision even from?

If I run more than one ControNet tab I get the CUDA out of memory error (8GB of VRAM GPU). Any suggestions?

i dont have the clip_vision prerprocessor where do i download it ??????

This is can make video and free??? I tried disco difussion, thats like trial.

Shows "where to download it" with a list of .pth files.. Then shows his folder where he's got safetensors and yaml files.. Great tutorial.. just making stuff up and not actually showing where or how you installed anything.

не работает!

Ebstynth + SD link