Hi, Ive tried a few Controlnets - the larger ones in filesize seem to really tank the performance (e.g. taking an hour for the image, where I need a minute or so without the CN) and the smaller ones are so-so. Is that first issue a one time thing, does CN need to load some files in the background? E.g. Im always often getting this message for CN modules: "RuntimeError: mat1 and mat2 shapes cannot be multiplied (2x2816 and 2560x1536)" Edit: A restart seems to have helped with the runtime error, maybe it was related to HiRes upscale ...
sadly doesn't work for me, always getting: "ControlNet - WARNING - ControlNet does not support SDXL -- disabling" (using your models and everything up to date)
hello! can you tell me the difference between the SDXL/REFINER from Civit with the _FIX - compared to what is in hugging face as sd_xl_base_1.0.safetensors
Hi! Not totally sure about it - I've tried both models and didn't notice any difference, but I've read somewhere, that the original base model had some issues with the VAE-encoder, so I've also installed the SDXL VAE file from here: huggingface.co/stabilityai/sdxl-vae/tree/main. That doesn't seem to necessary with the new model, but that's just my guess. If someone knows more about it, please leave a comment!
Have you changed anything inside settings > control net ->Config file for Control Net models. I have models/cldm_v15.yaml, not sure if I should change it
You've probably worked this out by now but it's likely to be VAE. There's an automatic function to set VAE in auto1111 but it doesn't work well. Try manually changing the VAE in the settings.
I didn't have this problem, but I've encountered some rare issues with Deforum before, when updating Automatic1111 Controlnet or installing new extensions. In that case you may try to shut down Automatic1111, manually move the Deforum folder from stable-defusion-webui/extensions to a backup folder outside the stable-defusion-webui folder, then restart Automatic1111 and reinstall Deforum from the extensions tab. If everything works, you can delete the old Deforum backup. Anyone else got this problem?
