Finally...I don't need SD3 anymore if this is the case. Who needs to download more SD3 models when this is doing prompt adherence that well...because my disk space is suffering these days.. :D
I took that back. It seems that I need SD3 after all. I cannot get the style I want because of limitation in prompting (like nerdy said in the video). And the prompt adherence is very well only with the raw prompt without including styling prompt. So it is basically useless.
I see small improvements with ELLA but it is not even close to sdxl examples on their github page which they wont release :( edit: oh wait, seems like I used outdated extension, Will try again edit: still very tiny improvement
6:38 Love your sense of humor, Nerdy Rodent :D (pretty sure I would have made similar joke either lol). Also it's amazing that such a simple additional tool on top of the already known one, can make such a huge difference and it shows that these models are actually more powerful that we thought they are. Really impressive new nerdy tech news as of recent 3-6 months to me :)
Unfortunately, this group has stated definitively that they are NOT releasing their SDXL weights. I'm waiting to see what the RPG Dungeon Master group comes up with.
NO SDXL release and NO TRAINING CODE either. I just don't even bother working with such things, as it is just a dead end. edit: feels like they just released it to create hype for something else that they wanna monetize
I installed all the T5 files linked but keep getting a "T5Tokenizer requires the SentencePiece library but it was not found in your environment." error. I re-downloaded the spiece.model file which I assume is the file in question but still get the error. It could be something I'm doing since I'm new to comfy (still learning how to navigate it). Edit: managed to fix it somehow, installed and reinstalled ella, also pip installed sentencepiece and installed the other ELLA add-on in comfy, so if anyone has a similar issue one of those might help (can't be more specific as I genuinely have no idea why it happened or how it was fixed)
I wonder if the SentencePiece Library has to be installed prior to installing the customNode? I am having the same issue but didn't try removing Ella's node and reinstalling it, So I will give that a go now. What worked for me was uninstalling it and then using the Experimental Pip installer to install it from the ComfyUI manager. No clue why that worked.
I see it might not be so profitable to release SDXL version of this technique. 1. It produces the anime style of semi-realistic picture alone (flan-t5-encoder-only gives anime). You need to combine it's output conditioning with clip conditioning. 2. SDXL prompt adherence comparable with Ella on sd1.5. I can't expect Ella adherence will be significantly better for SDXL (didn't see claims on that yet).
A shame it was tencent who came up with this, they stated that sdxl wont be made publicly available, they also didn't release the training process for 1.5. There is a community effort to reverse engineer the training process, hopefully they'll pull it off.
Just tried it. The prompt adherence is good (not as good as SD3), but the quality of SD1.5 is terrible. The SDXL version would probably be a lot better.
@@itycagameplays I've been doing AI images for a long time and the idea of using the SD1.5 model to create hundreds of quick images and improve the one I like in SDXL didn't occur to me, thanks man 🤣
Very impressive, I need to try this out as soon as possible! :) What's the sigma node doing and what kind of impact does it have? Should it use the same sample and scheduler as the KSampler?
ok awesome! thanks @NerdyRodent!. oh I was wondering if you Can make a tutorial on how to install comfyui on Linux?. and What version of Linux do you use for Artificial Intelligence?
How well does it output text and does it work with artist name like art by Picasso ? Also can it run with 8GB of Vram like normal SDXL models can ? Thanks for the great video, it like getting a sneak peak at SD3 capability.
Hey thanks for your videos ;) you are awesome! ... Did you tried it with animediff ? :) do you think it would work? :) maybe even some control-nets would help it with understanding and it can color them correctly :)
@@shirwan The GTX1660s is obsolete for AI due to the scarce 6GB, I recommend the RTX3060 12GB which is very economical due to the launch of the RTX4060
You’ll probably like this one too then! Pixart Sigma - Like ELLA, but for Low VRAM SDXL+ Resolutions in ComfyUI! ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-TQduyxvzX4Q.html
So, this thing is profitable for sd1.5 mostly. The only advantage for SDXL would be support for different languages but for the price of huge space consumption on SSD.
