I am already playing with this for the past week and this is a game changer for story board artists, concept designers and film pre-production! This will make existing workflows way way much more productive. Even film makers can now flesh out their story ideas quickly.
@vas1900 I have absolutely no issues with letting people know that I use AI to create my work. Instead of viewing AI as a threat, why not see its potential instead? I highly suggest you watch Kirby Ferguson's Everything is a Remix 2023 edition which he explains very clearly why Artist's fear of their work being taken over by AI is misguided.
I discovered that if you apply a noise filter layer onto the drawing, the results will be fantastic! Using dry textured brushes also gives much better results. Just to add on, you can create a new image layer, fill it with white, then add a noise filter. Use the Opacity adjustment to control the amount of noise on the sketch and watch the wild results appear. Changing the models/checkpoint types also gives a wide variety of results.
@@HestoySeghuro I'll try to explain the steps as clearly as I can. Create a new image 1024x1024. Create a new paint layer by clicking on the + sign to create "Paint Layer 02". Press Shift+Backspace Key to fill the layer with a color, any will do. Right mouse click on the paint layer 2 and select Add - Add Filter Mask - Choose the last option "Other" drop down triangle and choose Random Noise. Bring it to level 99. That's it you created the noise layer. Switch to live painting generation, slide the strength to 45 and above. In the layer opacity option reduce it down to 15%. Type your prompt, choose your brush and start painting away on Paint Layer 01. Keep adjusting the opacity of the noise layer to see different results. You may also adjust the brightness and contrast to see more variations.
Kinda sad this didn't grab a lot of attention. It's been available for a long time now but some extensions died because they lacked contributors. The live factor is fun
It's too damn complicated is why. I got the main program installed, got the AI plugin up and running and that installed the Comfy thing, but there's no real instructions how to use it, hence I'm here, and this vid veers off into comfy ui, which by itself is some codey thing for nerds
Wow... this is a really amazing AI feature. To be able to upscale the art from literally line drawings to high resolution art in real time... it's really amazing. Thanks for showing this.
I wish to see one day these workflows, combined with reposer and colored segmemt, can help people make their owm cartoon by more accurately generating images of consistent characters/outfit in various poses with higher compositional control. Great video!
The best part is I can just bash together random images together, just put in some images I find on google (or generate it) and comp together a scene, and the live painting does the magic of making it all look seamless!
I have it running on 4GB VRAM (Linux) if you don't mind waiting 20 seconds instead of 2 seconds. People are just too damn impaitent these days. 😁 It's much better doing inpainting in Krita, rather than ComfyUI's mask editor.
Really ?! My MacBook Pro can’t run it.. it took me 2hours to get an image with a prompt. Do you have tips ? The graphics card is 8go, processor i9 and 32go of ram
This is brilliant!! :D I was sad before because a couple of Krita plugins for Stable Diffusion I tried in the past were discontinued... And now thanks to you I learn this one is working and even updated to use the LCM-Lora! I'm so happy! You are the best, Nerdy Rodent!! Thank you very much!! :D
Very cool krita comfyui setup. I had been using a version by someone else but it doesn't have this cool real time stuff or built in ipadapters. Gonna have to check this one out. Thanks a bunch nerdy!
If svd is ever available for commercial use, then I’m sure we’ll see a lot of it! Personally, I think it’s pretty cool. Like some strange auto depth masking movements
I tried this week, and blurgh! I have 3 different ways of running Stable Diffusion and this is by far the messiest and most complex. It offers more but it's just such a headache I'm not sure it's worth the bother? I'm not a paid artiste, I just wanna make pictures an edit em.
This is awesome, stumbled across your channel as we've started to explore ComfyUI over 1111. Krista, Why didn't I know about this earlier? Desperate to move away from Photoshop and Gimp wasn't quite cutting it. If nothing else prompting SD in this way really helps you get a feel for the way the model works, I absolutely love watching the live picture update as I sketch, but also as I update my prompt, add commas etc etc. This is great, thanks for highlighting it.
Thanks Mr Rodent. Finally i can use this properly (already had it installed) but i didn't know how to add the control layers etc. Live diffusion ... where were we again a year ago? Insane progress. xD
Hi all there. I downloaded the plugin and put it in the resources directory as the video said, BUT it doesn't show up in the python manager so i cant procceed. Did anyone have the same problem and how is it fixed. Thanx. And something for Nerdy Rodent i subscribed to the channel a long time ago but today youtbe showed that i wasnt...just a heads up
Everything is cool and beautiful... it's just a pity that in Linux Krita's plugin doesn't support AMD GPUs. You can get around this by installing your own Comfy UI server... but it's too much of a challenge for me. There is no A to Z guide on how to do all this.
One a to z guide: How to Install ComfyUI in 2023 - Ideal for SDXL! ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-2r3uM_b3zA8.html - just remember to install rocm PyTorch 😉
@@NerdyRodent Unfortunately, I'm not a software engineer. The only thing I was able to do was install python and rocm, and then I think I ran CmfyUI... all by pasting lines of code from the Internet into the console. Installing ComfyUI manager was beyond my capabilities... and without it I won't upload Controlnet and so on. The "instructions" I found on the Internet are completely incomprehensible to me. I'm a graphic designer, not a programmer 😅
@@veritaspk that’s fine, this is just basic commands that anyone can run 😀 if you need even more help than the step-by-step video, you can drop me a DM on patreon!
This might be a stupid question but where is the prompt negative?? I know where the prompt negative for the preset is, under settings, but how can you get a per-image negative?
I can't get Krita to see where Comfyui is already installed. I've tried every path, it just can't see it. I'm about ready to uninstall Comfyui and let Krita install it.
Assistant AI Plugin as a mini assistive Drawing for people with Visual impairment, such as I would be extraordinarily benefits, by removing the obstacle-course I had to deal with lapsed Hand to eye coordination, all my life, up till now. I thank you for the tutorial, better get busy creating!
thank you for showing us and how do i get back a previous image?? is there anywhere we can view all the images generated? cos I think i liked one i did four images back but how do i re generate it?
Completely lost me at 5:47. That doesn't seem to be part of the software? I already have Comfy UI as part of the plugin install, so I have no idea what that black screen stuff is? Comfy UI manager? What part of Krita is that? You seem to be talking about a separate software,
As described in the video, you have two options. To install ComfyUI as part of the plug-in, or if you already have ComfyUI installed. The separate software in this case is a standard installation of ComfyUI!
@@NerdyRodent So if already installed with the plugin, how to get to all those options an stuff? *Thinks to himself "Why is everything AI such a headache?"
Yup! You can ignore anything to do with the ComfyUI back end when using Krita and having the plug-in do everything for you 😀 Or, if you want to manage things yourself, go with the ComfyUI install first. The choice is yours!
@@NerdyRodent 2 things putting me off now, 1. it seems Krita developers actively hate AI and want nothing to do with the plugin, and 2. the interface is too big for my 43" 4k monitor (I can't reach the generate button half the time. That's just... ew). I'll try again next year? *shrugs
Hi there and thank u for this amazing video. It seems impossible to use the AI plugin. I went through all the steps and the lengthy download but what I get is an error in the Server configuration which reads "Invalid location: directory is not empty, but no previous installation was found". In the "Core Components" I see only Python as installed but not the other 3. Is there something I missed??
okay this is ... alright, but ... can we change the prompt workflow? I'd like to add in my character as a ip adapter and use a different model etc... this feels difficult to use well, for drawing from scratch?
I installed this and got the plugin running, but every time I try to run a prompt, python quits just before it finishes. So disappointing. Any ideas for a fix? I'm running it on a Studio Mac.
i can get full img generation working, and outline selection generation, they work fine. but whenever I try the realtime drawing it just returns me the stick figure I drew in the first place, rather than a rendered image. I'm confused.
hello! Im having problem runing the plug in using the local server it gives me this issue : invalid location: directory is not empty, but no previous installation was found and wont allow me to install anything :(
Do you know? Could this be done just in Comfy? That way I could set-up a camera, run the workflow through Touchdesigner which would mean I could draw the things on paper, instead of a computer.
I'm a bit confused about the server configuration page. Under core components I see ComfyUI is installed but required models is not, does that rectify by the 10G ComfyUI install? Also under Workloads Stable Diffusion 1.5 is checked but not installed so does that install with the above ComfyUI install if it's checked? I do already have Stable Diffusion on my computer so I wonder if there is some redundancy or if it's a matter of the AI plugin needing it's own copy as there is no integration with a preexisting Stable Diffusion installation? Same with installing checkpoints, I have Realistic Vision and DreamShaper installed in my Stable Diffusion but not separately for the AI plugin and I also have ControlNet installed separately to my stable Diffusion.
Hello i have an issue. When i try to install ComfyUI i get an error "utf-8 codec cant decode byte 0xd0 in position 25: invalid continuation byte". Any thoughts on why this might be happening ?
I think I need a little help with this. I'm trying to do the exact steps you said in the video but for some reason my Comfyui just says "Queued" and nothing is happening. I have no workflow loaded into comfyui because you never said to use one in the video. I also never selected any LCM models or anything because that wasn't said in the video either. Does comfyui not need a workflow? Does it automatically choose a LCM/turbo/lightning model when you click live painting? I guess I'm a little confused as to how this is working. Any help would be appreciated. =]
@@NerdyRodent I totally figured it out! My image was too big. So it must have been getting an error in the backend without me seeing in Krita. I scaled the image size down to something more manageable and it worked. I was having some issues with it not working when I used the selection tool. I just reinstalled krita and used the Local Install so Krita manages everything and it's working flawlessly now. In case anyone else has any issues. Thanks for the video!
I've extracted the archive into the pykrita folder. When you get to the step at 3:34 (where you check AI Image Diffision) you have a bunch of plugins listed there. I have none. Totally empty. Any idea why?
@@NerdyRodent Apparently installing the Ubuntu distro's version of Krita (from the app store) is missing some libraries and doesn't allow plugins. The AppImage from the Krita site works fine- so I'm using that.
nice explanation about this! thank you! do you know if it also works with the confy ui extension installed in automatic1111? or we need a separate confyui installation? it would be great to know for not tu fill to much the HDD!
After allowing Krita to install ComfyUI, is it possible to use ComfyUI independently of Krita and what would the steps be? Is it just a matter of configuring run_nvidia_gpu.bat properly?
there's nothing like this but with a1111? im afraid if i install comfyUI i'll end up with the whole SD+controlNet installed on my PC twice for no reason when someone less ignorant might know how to point the two different frontends to the same models
I use Krita for all my professional work. This is great. Thanks for the video. Does anyone know where the control net models go? They work in Comfy, but the plugin says it can't find the controlnet models.
This is really good, I've been using krita extension in automatic1111 for 3 months and my workflow has improved but this one on comfyui is the next level. Do you know if I could use this extension not interfering with automatic1111?
It’s likely not using your GPU then for some reason, as a guess. Make sure you’ve got your gpu drivers installed and check the issues to see if anyone else is experiencing the same thing.
@@NerdyRodent I think it's working now. It's been a headache. I think that what was happening is that, for some reason, the ram had to handle a lot of stuff for a few minutes before the GPU started kicking in. I don’t have an insane system, just 16 gigs of ram and a 1660 ti, and so I am getting about one render every 20 seconds in the live mode.
@@NerdyRodent no, my problem is that i have 50 gb free in my hard disk and i cant delete anything atm... so i wanted to know the server's weight to know if I have enough space.
@@NerdyRodent i cannot run it on my gpu, it says it cannot launch the server. I tried updating the drivers of my NVIDIA, it didn't work either. Is it because my gpu is too old? Because when i launch it on my cpu, it launches but do not work. Thanks in advance if you know the awnser !
@@NerdyRodent no i'm not this far, i have a GeForce on my laptop it should work. But i gave up and deleted the files to have some Space. It's unfortunate but maybe i'll try again one day
When I try to connect to my Comfyui installation I get an error about missing Controlnet preprocessors, but I have them. In the client.log file I don't see any useful information.. any idea? :(
