Тёмный

Install Stable Diffusion 3 Locally: Step-by-Step with StableSwarmUI & ComfyUI 

pixaroma
Подписаться 13 тыс.
Просмотров 32 тыс.
50% 1

Опубликовано:

 

27 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 128   
@pixaroma
@pixaroma 3 месяца назад
Maybe you can try this AI tool bit.ly/4b7UCT1 to get stunning 8K/10K Stable Diffusion-generated images. Unlock special offer bit.ly/4b9L1v3 for users who need this AI tool.
@SumoBundle
@SumoBundle 3 месяца назад
Wow, this tutorial is mind-blowing! Can't believe all the detailed steps and functionalities. Simply amazing! Great work!
@anseltrust
@anseltrust 2 месяца назад
As a beginner, this tutorial helped me a lot!
@Drakoviche
@Drakoviche 5 дней назад
Got it working and it's my first time using python, git, comfy ui and stable diffusion 3 so I think it's a good tutorial!
@pixaroma
@pixaroma 3 месяца назад
Stable Diffusion 3 models with names including "incl_clips" signify that these models have integrated text encoders. This integration means you do not need to add an extra node for those CLIP models, as the text encoding is already handled within the model itself. This differs from models like "sd3_medium," where an additional node for the text encoders are necessary. So if you use sd3_medium.safetensor then add the clip encoders, for others are not need it from my understanding. CivitAI just banned the SD3 because of the weirds license of stabilityAI, so play around with sd3 but because of the license many people will not be able to improve it or use it for comercial work.
@LouisGedo
@LouisGedo 3 месяца назад
👋
@AaliDGr8
@AaliDGr8 3 месяца назад
How to use with defooocus AND automatic 1111 and please make a tutorial on it????
@pixaroma
@pixaroma 3 месяца назад
I will make it when they update the ui to support it, right now it doesn't support sd3
@AaliDGr8
@AaliDGr8 3 месяца назад
@@pixaroma plz i believe it work for defooocus if not for fooocus but maybe it will work for defooocus as a saftencor SD3 model so how plz teach and i use always not local defooocus but google colab defooocus hmmm??
@pixaroma
@pixaroma 3 месяца назад
@AaliDGr8 I don't use colab since my PC can handle it, the free colab can not handle many interfaces so i prefer to not pay for premium. Anyway the license or sd3 is quite strange, so you are better for now with sdxl.models
@BD_422
@BD_422 3 месяца назад
First of all thank you for the tutorial. My shitty laptop took 6 hours and 30 minutes to generate a single image lol. I knew my computer wasn't going be fast but I expected it to take like 20 minutes or something.
@pixaroma
@pixaroma 3 месяца назад
Depending on the vram on your video card, you can try with a v.1.5 model, it shouldn't take so much if you have a decent video card
@BD_422
@BD_422 3 месяца назад
@@pixaroma Thank you. I will try to do so.
@mccreamark1
@mccreamark1 27 дней назад
Thanks for the tutorial , followed it step by step and managed to get good results even with a GTX1050. Obviously I can't do the complex workflows but I am getting very impressive results .
@ARTICREATOR-SAM
@ARTICREATOR-SAM 3 месяца назад
Thank you for the very complete and comprehensive video and easy and clear teaching
@baheth3elmy16
@baheth3elmy16 3 месяца назад
Best Tutorials on RU-vid!
@JohnPirillo
@JohnPirillo Месяц назад
Thank you. Worked perfectly the first time.
@jhontitor9332
@jhontitor9332 3 месяца назад
Hi, do you think it's worth switching for now since it's just the beginning of SD3 or better wait for more commonity models developpeD? Also I wasn't following what's happening with forge, will it stop to receive updates? I really like the ui similar to A1111 but better. Is is still worth sticking with one of the 2 for future SD3 version or it's time to learn Comfy? Ngl Swarm looks quite weird. Which one would you reccomend between all 4 from now on?
@pixaroma
@pixaroma 3 месяца назад
I will add Thursday a video about that, i will probably continue with a1111 and comfyui
@darkman237
@darkman237 3 месяца назад
You could click on send to and select desktop which will create a shortcut on the desktop.
@pixaroma
@pixaroma 3 месяца назад
Good to know, thanks
@makadi86
@makadi86 3 месяца назад
in 21:30 you changed the "sd3_medium" to "sd3_medium_include_clips" they are the same, just with the second one you can remove the TripleClipLoader node and pass the clip yellow line from the Load checkpoint node instead, the 6 gb model include two clips and the 15 gb one include all the 3 clips.
@pixaroma
@pixaroma 3 месяца назад
Thanks, yeah I found out about that later after I published the video. I didn't have time to do more tests, is the one with 3 clips better then that with 2 and that with one? Theoretical it should but not sure in practice
@makadi86
@makadi86 3 месяца назад
@@pixaromaI didn't download the 15 GB model yet. I only downloaded the 6 GB one and just started testing it right now.
@andrewtran9870
@andrewtran9870 3 месяца назад
anyone else getting "Invalid operation: ComfyUI execution error: Cannot handle this data type: (1, 1, 3),
@pixaroma
@pixaroma 3 месяца назад
Maybe it has something with do with amd, Nvidia usually works better and in video i used Nvidia but for amd are different steps on most ui and some dont support all AMD cards, but since i don't have amd maybe someone else can answer your question
@Zaazu91
@Zaazu91 3 месяца назад
Will you be switching to another UI now that forge is changing to an experimental repo?
@pixaroma
@pixaroma 3 месяца назад
Yeah, since without updates you can not do much for long, i mean it still works but probably other ui will do more improvements in speed and quality so we have to keep up. Alternative are comfyui, swarmui, and automatic1111 , probably i will have all 3 and see how it evolves. I am playing more with comfy ui I saw it can do more advanced stuff. Automatic 1111 doesn't support yet SD3 but because of the license of sd3 probably many will stick with sdxl for a while
@eddystylez
@eddystylez 3 месяца назад
Damn. Did not hear about this. ComfyUI looks powerful but seems like it requires more work to do what can be done faster in the more basic UIs. Maybe I'm wrong I'll have to check it out. Never heard about this SwarmUI until I watched Pixaroma's video.
@touristhawk
@touristhawk 3 месяца назад
i watched video in silent but why downloading clips seperately when there is clips included safetensors?
@pixaroma
@pixaroma 3 месяца назад
I found that about that later, I first found that about later, if you look at my channel is the first video with comfyui, I am learning more about each day, and when I got the workflow from hugging face didnt work until I had all those model, so I shared what it worked for me, later I saw what all meant. Thanks
@mee_ehow5106
@mee_ehow5106 3 месяца назад
So I have a pretty beefy PC sitting at home - RTX 4090 paired with 1/1gbps symetrical network connection. Is there a webserver version of that UI that lets me using this PC as raw horsepower for my webapps instead of paying third parties?
@pixaroma
@pixaroma 3 месяца назад
Honestly I dont know, I only run it locally, but I asked chatgpt same question and gave me a lot of solution but I didnt really understand all that. something like: "Choose a Framework: If you're looking for a specific UI like ComfyUI, check if they provide a server or API version that can be self-hosted. If ComfyUI doesn't offer a server version, you can use frameworks like TensorFlow Serving, Flask, FastAPI, or Django to create your own web server for running AI models. " "Ensure your PC has all necessary software installed. This typically includes Python, CUDA, and the appropriate deep learning libraries (e.g., TensorFlow, PyTorch). Install a web server framework (e.g., Flask or FastAPI). " So really I can't help there, you need to do more research.
@skystranger73
@skystranger73 3 месяца назад
There are also versions for nvidia\amd gpus on huggingface, like Stable Diffusion 3 Medium TensorRT. Is it better to use them or this one ?
@pixaroma
@pixaroma 3 месяца назад
I didn't got to test them, heard that tensor might interfere with other extensions or control net
@spedroxsac403
@spedroxsac403 3 месяца назад
can i use for image to video model and where i will find that model?
@pixaroma
@pixaroma 3 месяца назад
I only tested one model in forge ui, this one, when i test more i will do more tutorials but so far i didn't find some good one, ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-zXxK6IrRvD0.htmlsi=1c84r1Gi27C7Qbwe
@KalponicGames
@KalponicGames 3 месяца назад
does it have seamless tiling on y only or x only here?
@pixaroma
@pixaroma 3 месяца назад
Sorry, I didn't have time to play around with it, after i come back from vacation i will play more with it
@nomorejustice
@nomorejustice 2 месяца назад
nice tutorial man, how to add the sdxl base model for swarmui?
@pixaroma
@pixaroma 2 месяца назад
you can download the models you want and put it in the stableSwarmUI\Models\Stable-Diffusion folder and restart swarmui
@nomorejustice
@nomorejustice 2 месяца назад
@@pixaroma tysm man!
@shamilptashenchuk9529
@shamilptashenchuk9529 3 месяца назад
The model from old SD works in SD3? and Thnk for your video!
@pixaroma
@pixaroma 3 месяца назад
SD3 is just another model like sd.15 or sdxl, you just need the interface updated so it supports that model , comfy ui and swamp update the ui, but a1111 and forge didn't update it yet.
@A.I.Ther_Technology
@A.I.Ther_Technology 3 месяца назад
Hi I have the next issue: Prompt outputs failed validation TripleCLIPLoader: - Value not in list: clip_name1: 'clip_g.safetensors' not in [] - Value not in list: clip_name2: 'clip_l.safetensors' not in [] - Value not in list: clip_name3: 't5xxl_fp8_e4m3fn.safetensors' not in [] Queue size: 0 Extra options even I delete and put it directly to clip node, it doesn't work
@pixaroma
@pixaroma 3 месяца назад
You need those models in clip folder if you are using sd3 medium, and if you have it in that folder and still say is not in the list just select it from Drop down where is that name
@deejmag5348
@deejmag5348 3 месяца назад
I haven’t seen full video but I believe u must have hifi system to run offline… and I wonder why it would be free?
@pixaroma
@pixaroma 3 месяца назад
You need like 8gb of vram to work, and a good Nvidia card help, sdxl and 1.5 model are free for commercial use but sd3 only for personal use, you need a license for commercial like 20$ per month
@TsuneAi
@TsuneAi 3 месяца назад
this is probably a dumb question but, does the portable comfyUI version can be updated? im asking cuz i used to use auto1111 but I stopped using the program like a year ago, in those days I remember I had to install the program manually and i needed to use a cmd command in order to receive updates
@pixaroma
@pixaroma 3 месяца назад
Yeah it can, you have an update bat, but with comfyui manager you can install with the update button from the manager, I used the portable version in the video
@TsuneAi
@TsuneAi 3 месяца назад
​@@pixaroma i was watching while typing and just saw the option in the manager 😅, thanks! very well explained tutorial ^^, btw in your opinion, is comfyui better than auto1111? (or the others), like, in terms of performance, speed, etc?
@pixaroma
@pixaroma 3 месяца назад
It seems that is faster then a1111 once they update a1111 to get better speed like forgeui had probably i will use that also because interface is more friendly and organized, on comfy UI you have more control but can be a mess sometimes with all the nodes. So it they fix it probably i will use a1111 again for normal use and comfy for more custom workflows
@TsuneAi
@TsuneAi 3 месяца назад
@@pixaroma thanks again ^^ i'll do the same then
@rajat8883
@rajat8883 9 дней назад
i am totally new so i dont know a thing, in my case its hanging after tripleCLIPloader and befire prompt, any idea mate? it shows reconnect
@pixaroma
@pixaroma 9 дней назад
Check here discord.com/invite/gggpkVgBf3 there is a channel for swarm also there
@shinigami8671
@shinigami8671 Месяц назад
Everything worked fine until the very end. It was stuck at "Backends are still loading on the server for nearly an hour (even though it only took 5 mins to download and install everything including the model) so I closed it and updated hoping it would fix w.e was causing the issue but the prompt at the top does not go away. It also says "Git failed to upload" in the main UI pannel now.
@pixaroma
@pixaroma Месяц назад
Try maybe to update git, also if you are using comfy UI I started a new series step by step with episodes
@halkive4619
@halkive4619 3 месяца назад
I am a poor man but I will subscribe good fellow.
@LittleCinemaHere
@LittleCinemaHere Месяц назад
Brother can you please help me out here! When I am starting the server the backends are not being able to load . I dont know what the reason is but the error says " The procedure entry point could not located in the dynamic link library StableSwarmUI\dlbackend\comfy\python_embedded\Lib\site-packages\torchaudio\lib\libtorchaudio.pyd"
@pixaroma
@pixaroma Месяц назад
Sorry I switched to comfyui so it doesn't depend on other interface that is why i started the series of tutorials for comfyui, probably from the message it needs some library from torch Maybe something didn't install right, try a fresh reinstall maybe or check their discord server
@LittleCinemaHere
@LittleCinemaHere Месяц назад
@@pixaroma l will try
@___gh0st___
@___gh0st___ 3 дня назад
Thanks a lot for your video. I have an error and can't find solution to solve this issue on redt or anywhere else, any idea? It popsup when trying to generate an image, "stableswarm invalid data unknown param type request sdxlcheckpointmodel error". Ay help woul be grealy appreciated, thanks again
@pixaroma
@pixaroma 3 дня назад
I dont use swarm anymore I switched to comfyui. Seems like a model error, but I dont know much about swarm, I used just when I did the video for sd3, but people use now flux dont use sd3 anymore
@kingson5437
@kingson5437 2 месяца назад
Can i install both this swarmui and automatic 1111 like one in d drive and other in different drive?
@pixaroma
@pixaroma 2 месяца назад
You can install all in different folders is not a problem, i have forge, a1111, and a few duplicates of comfyui that i do tests. For comfyui is portable so i can copy and paste the entire folder and still works
@kingson5437
@kingson5437 2 месяца назад
@@pixaroma thank you
@PatMcDonald41
@PatMcDonald41 2 месяца назад
Probably an obvious question, but why is this so complicated? I can install a heavyweight programme like Visual Basic Studio that is far more straightforward.
@pixaroma
@pixaroma 2 месяца назад
I will start a new series for comfyui with all the steps more simplified. The problem I think it is that is open source and you can see all the code, so if someone make an exe file you can not know what is inside that package what you install, but in exe you can put all the steps and click install and will make it easy, but this way you just copy a code an interface them you need the models to work, it has more control on what you can do and make your own fork flow but that can make the interface more complex.
@PatMcDonald41
@PatMcDonald41 2 месяца назад
@@pixaroma Thank you, that is a good explanation
@myphamgenie
@myphamgenie Месяц назад
How can i solve this problem "TypeError: Failed to fetch"
@pixaroma
@pixaroma Месяц назад
Sorry just saw is on the swarm and comfyui..if you use swarm then you have to see if had an update..for comfyui I started a series of episodes and first one is on installation. Swarm has a discord channel that can help. I switched to comfyui instead of swarm
@Jacksonpole90
@Jacksonpole90 2 месяца назад
Hi could you kindly advise why it only generated random pixel when I generate a photo? What went wrong?
@pixaroma
@pixaroma 2 месяца назад
Can be many causes not sure how your workflow books like if is missing something if you have a bad setting, what UI you use and how the image look like when you say random pixel
@Jacksonpole90
@Jacksonpole90 2 месяца назад
@@pixaroma the image is just noise pixel, can't seems to fix it tho
@pixaroma
@pixaroma 2 месяца назад
It only happens with sd3 model or any other model wokflow, are you using comfyui?
@Jacksonpole90
@Jacksonpole90 2 месяца назад
@@pixaroma I'm using StableswarmUI chef
@pixaroma
@pixaroma 2 месяца назад
@@Jacksonpole90 I suggest to join their discord channel and ask there, maybe someone can help you, i dont have so much experience with swarm, they have a help channel section where you can ask questions, i saw is pretty active discord.gg/q2y38cqjNw
@wiz4rdo
@wiz4rdo 3 месяца назад
Best tutorial for SD3, is it possible do add clip skip to the ui like before?
@pixaroma
@pixaroma 3 месяца назад
If you are talking about comfyui you can see if the node they talk about work for you, i am not at computer this weekend github.com/comfyanonymous/ComfyUI/issues/2223
@wiz4rdo
@wiz4rdo 3 месяца назад
@@pixaroma yees, exactily thank u
@swannschilling474
@swannschilling474 3 месяца назад
Thanks a lot! 🙂
@olayousry8934
@olayousry8934 2 месяца назад
Hey, I receive the below error with the launcher, any help :( ?!! 19:23:29.605 [Error] Self-Start ComfyUI-0 on port 7823 failed. Restarting per configuration AutoRestart=true...
@pixaroma
@pixaroma 2 месяца назад
Not sure why is causing that error, are you using windows, and Nvidia card, with enough vram? I saw online on mac that error. I will work this week on a new comfy ui tutorial from scratch
@victorproff3481
@victorproff3481 2 месяца назад
Is it better than SDXL ?
@pixaroma
@pixaroma 2 месяца назад
At prompt understanding, but worse at people. But because of the license I will stick with sdxl for a while
@farhang-n
@farhang-n 3 месяца назад
Thank's a lot
@rajat8883
@rajat8883 9 дней назад
when i try to qeue promt its showing reconnecting in red again and again, pls help
@pixaroma
@pixaroma 9 дней назад
I use comfyui installed directly not with swarm anymore, maybe check their discord page
@rajat8883
@rajat8883 9 дней назад
@@pixaroma i am totally new so i dont know a thing, in my case its hanging after tripleCLIPloader and befire prompt, any idea mate? it shows reconnect
@pixaroma
@pixaroma 9 дней назад
It is possible you don't have enough vram maybe and it crush if it goes out of memory is hard to tell without more details, screenshots, info from command window, try on discord maybe someone using the same interface can help
@rajat8883
@rajat8883 9 дней назад
@@pixaroma can you drop the link for the same, ill dm you over there?
@biriani2855
@biriani2855 17 дней назад
Somtimes when I tell it to launch it won't launch
@pixaroma
@pixaroma 17 дней назад
Try install.comfyui i have a lot of episodes about that. I dont use swarm anymore
@TheMaxvin
@TheMaxvin 3 месяца назад
What for SwarmUI? No portable, plus SDK(((
@pixaroma
@pixaroma 3 месяца назад
You can use comfyui is portable, or wait for automatic1111 to be updated.
@islamarbaoui855
@islamarbaoui855 3 месяца назад
When I click Generate, : Error Invalid operation: All available backends failed to load the model.
@pixaroma
@pixaroma 3 месяца назад
Try to select the models from the list maybe
@darkman237
@darkman237 3 месяца назад
How well does it do hands and teeth?
@pixaroma
@pixaroma 3 месяца назад
Really bad 😂 if is closeup portrait is ok, but for hands is really bad
@darkman237
@darkman237 3 месяца назад
@@pixaroma Will it take ADetailer? Definitely helps hands and faces
@pixaroma
@pixaroma 3 месяца назад
Not sure yet, I didn't n't have time to test it, sorry
@maxxie5177
@maxxie5177 3 месяца назад
Does anyone know about support for Automatic 1111 ?
@pixaroma
@pixaroma 3 месяца назад
It doesnt support yet, they need to update it to make it work with SD3, so we wait for support.
@AIimageGirl
@AIimageGirl 3 месяца назад
Bless you my Lord pixaroma Infinity, I will start tomorrow my Lord stable Diffusion.
@tapirko1
@tapirko1 3 месяца назад
Thanks!
@pixaroma
@pixaroma 3 месяца назад
Thank you so much for support, appreciate it
@halkive4619
@halkive4619 3 месяца назад
@@pixaroma "I" :p
@pixaroma
@pixaroma 3 месяца назад
​@@halkive4619 It's hard with English, that's why I don't do tutorials with my voice. It's difficult to keep up with grammar when English is not your first language. :D
@halkive4619
@halkive4619 3 месяца назад
@@pixaroma oh man im sorry, I didnt mean it in a rude way. Im so weird....i kinda hesitated on commenting that :/ Mybad brother
@pixaroma
@pixaroma 3 месяца назад
@@halkive4619 don't worry about it :)
@darkman237
@darkman237 3 месяца назад
How much power does it use? Would we get slammed by the electric utility?
@pixaroma
@pixaroma 3 месяца назад
I was able to use it on a 6gb vram rtx2060
@Elysium.4D
@Elysium.4D Месяц назад
'git' is not recognized as an internal or external command, operable program or batch file. Why am i getting this error?
@pixaroma
@pixaroma Месяц назад
Try to install the git software
@GuardMod
@GuardMod 3 месяца назад
شكرًا لك . الشرح رائع وممتع. يسعدني الاشتراك بالقناة
@gmfPimp
@gmfPimp Месяц назад
Thanks for video.
@DouglasRivitti
@DouglasRivitti 3 месяца назад
works with amd gpu?
@pixaroma
@pixaroma 3 месяца назад
with some amd cards comfyui works, but need some extra things, if you search on their page amd you can find some info, always more problems on amd than on nvidia github.com/comfyanonymous/ComfyUI
@Spindonesia
@Spindonesia 3 месяца назад
automatic1111 can or no?
@pixaroma
@pixaroma 3 месяца назад
Not yet, I am waiting for it to be updated, hope will be soon.
@darkman237
@darkman237 3 месяца назад
How well does it do for video clips?
@pixaroma
@pixaroma 3 месяца назад
Not sure if can do yet, didn't test it, is for images is not made for video, and the other extensions like control net doesn't work yet
@Silent-sk6gc
@Silent-sk6gc 3 месяца назад
[Error] Self-Start ComfyUI-0 on port 7825 failed. Restarting per configuration AutoRestart=true... I keep getting this error, Do you know how to fix it.
@pixaroma
@pixaroma 3 месяца назад
Sorry i dont, did you try to update it from the update bat? Or try to reinstall comfyui
Далее
host ALL your AI locally
24:20
Просмотров 1,1 млн
Stable Diffusion Prompt Guide
11:23
Просмотров 32 тыс.
STABLE DIFFUSION 3 NEW LICENSING!
8:27
Просмотров 22 тыс.
Install ComfyUI on Mac (local StableDiffusion)
14:45
Установка Stable Diffusion 3 + ComfyUI
16:58
FLUX 1 Schnell - Local Install Guide / ComfyUI
11:29
Просмотров 134 тыс.
STOP Wasting Time with A1111, Use Forge UI Instead
12:37