Тёмный

Flux ControlNet - Easy Install Guide 

Olivio Sarikas
Подписаться 235 тыс.
Просмотров 31 тыс.
50% 1

Опубликовано:

 

27 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 111   
@OlivioSarikas
@OlivioSarikas 2 месяца назад
Get my 3 WORKFLOWS here: www.patreon.com/posts/flux-controlnet-110607421 My Flux Install Guide: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-tXO6SJ-6Eb8.html My IPAdapter Install Guide: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-KXxk_bGDCzc.html Join my Discord: discord.gg/XKAk7GUzAW
@LouisGedo
@LouisGedo 2 месяца назад
👋 Thanks
@mattolsen5947
@mattolsen5947 2 месяца назад
This is great, very clear! Is it possible to combine ControlNet with IPAdapter to match the style of a reference image?
@leonardomonteiro298
@leonardomonteiro298 2 месяца назад
Thank you so much, especially for the GGUF, not having enough VRAM is like gambling, sometimes it renders in 2 minutes, sometimes it stucks loading because system is running out of memory
@GreenAppelPie
@GreenAppelPie 2 месяца назад
I still like 1111, but comfy is growing because of how you can load workflows
@GenoG
@GenoG Месяц назад
I hated the thought of ComfyUI, but after a couple of days I realized how much more intuitive it is than A1111... If something goes wrong during an A1111 gen, you have to be a "terminal genius" to figure it out... but Comfy shows you what's wrong and actually allows you to literally "connect the dots" better... Pun intended!! Yes, there are still some things missing (easy ADetailer!!) but I'm liking it and I didn't think I would. My 2 cents!! 🤓
@whittone28
@whittone28 2 месяца назад
Thank you Olivio, this is just what I needed. ❤
@hotlineoperator
@hotlineoperator 2 месяца назад
Word "ComfyUI" and "easy" should not use in same context. Nothing is easy in ComfyUI.
@mik3lang3lo
@mik3lang3lo 2 месяца назад
Exactly
@VitaliyHAN
@VitaliyHAN 2 месяца назад
Same. I can program using php, golang, js, python, but ComfyUI is much harder. It is better to be CLI than nodes. 😂
@vannoo67
@vannoo67 2 месяца назад
I don't understand this sentiment. Comfy is arguably harder to setup, but once you have done so and gathered a repository of workflows, it's easy as cake.
@hotlineoperator
@hotlineoperator 2 месяца назад
@@vannoo67 Until you get error messages.
@Elwaves2925
@Elwaves2925 2 месяца назад
@@vannoo67 What's not to understand, you state the issue yourself - "harder to setup, but once you have it done..." Getting it done is where the problems lie ad the manager only goes so far. Even if you get all the nodes installed it doesn't cover models and errors after that. You've basically said that driving a car is easy once you have it built and running, while passing over that you start with a pile of parts on the floor. I say this as someone that uses Forge and Comfy.
@kushalsv
@kushalsv 2 месяца назад
Can you make a video on Forge, now that its soooo much better and has a ton of new features?
@Velanteg
@Velanteg 2 месяца назад
Forge control net not support Flux
@atholsdihgolsrihg
@atholsdihgolsrihg Месяц назад
Controlnets don't work in ForgeUI for those wondering, developer has a bias for comfyui and is toxic node network akin to blender nodes.
@TheGamingR
@TheGamingR 2 месяца назад
Can you do a comfyui flux inpainting tutorial
@APOLOVAILS
@APOLOVAILS Месяц назад
Hey olivio ! One question : is it possibke to have consisten character with flux and comfy ?
@futrstory
@futrstory 2 месяца назад
Thanks as always! Great information!
@KlausMingo
@KlausMingo 2 месяца назад
Watching Olivio while I train my first SDXL LoRA :) How do you show the extension name above the node 6:20? I'm all in with ComfyUI, started with A1111 of course because it's easy, but Comfy is way better and more flexible.
@mirek190
@mirek190 2 месяца назад
you know SDCL is dead? You know Lora training for Flux dev is much easier and you are getting far more better results than with SDXL?
@KlausMingo
@KlausMingo 2 месяца назад
@@mirek190 For sure FLUX is establishing itself as the new supreme generator. But it's very demanding on the hardware. Don't diss SDXL yet, it still gives amazing results.
@mirek190
@mirek190 2 месяца назад
@@KlausMingo yes but how long ... is much harder to train , is different architecture so can not understand prompt as well as flux, Hardware limit is not a big problem (16 GB cards are getting standard for people who are doing something more than watching youtube) people slightly moving on ...
@KlausMingo
@KlausMingo 2 месяца назад
@@mirek190 I see. Well for now I'm stuck with 8GB card :(
@mirek190
@mirek190 2 месяца назад
@@KlausMingo I not blame you ;) Probably If you really wanted to play with AI more seriously you would buy some card at least 16 GB. For instance a years ago I changed my RTX 3060 8GB to used RTX 3090 24 GB for 700e ;)
@antoinesaal2372
@antoinesaal2372 2 месяца назад
Error : No module named 'controlnet_aux' (ControlNet) (I'm using Flux1-dev-Q4_K_S + comfyUI + Controlnet) There is a error during the node "Canny edge" : "Error occurred when executing CannyEdgePreprocessor : No module named 'controlnet_aux' I re-installed ControlNet auxiliary model manually several times, and updated everything. It didn't change anything.
@h4nio575
@h4nio575 Месяц назад
Hi! I did everything like you said, but the xlabs folder is not showing up in my models folder
@AliMzannar007
@AliMzannar007 Месяц назад
same here, did you manage to solve it
@Beauty.and.FashionPhotographer
@Beauty.and.FashionPhotographer 2 месяца назад
Silly Question: its been a while since anyone made an up to date update of which Checkpoint Models can render human faces and bodies the very best in august 2024. You have seen and used so many different ones, which one is your goto model to get 100% real Photos of human beings, disregarding all cartoon stuff in this quest /question. ? is it still juggernaut or realistic or pony? Pony seems to be 10% all cartoon anime in it i saw.... what model would You use? i have tried some Loras of a Singer friend of mine with different checkpoint models. but have not found a number one photo realistic one yet... with or without Lora applied to it
@guillaumegaudin596
@guillaumegaudin596 13 дней назад
Hi! Thanks for the video ! How come we cannot choose the method + sampler like Euler + beta for example with the X labs sampler?
@MarkHuffman-q8m
@MarkHuffman-q8m 9 дней назад
i started comfyui with all the recommended setting but still getting failed to allocate (low VRAM), despite have 16GB of VRAM on my 4070ti. Is there another method to resolve this?
@WillFalcon
@WillFalcon Месяц назад
Does it work SD-Forge? No... it does not
@garen591
@garen591 Час назад
Is this outdated now that Union Pro control net is out?
@choppergirl
@choppergirl 2 месяца назад
I never got ComfyUI to do anything... at all... not even run the demo project... so I just installed FLUX with Pinochio Not a whole lot of options with the web UI that way... like a way to pass it an image to base its generations on. Most of these AI user interfaces and installers... are incredibly... not well thought out, and getting more fractures and spreading out as tree branches to be abandoned... every day. They're all their little fiefdom isolated tools, and not building one big single AI, and then adding talents to it...
@CoconutPete
@CoconutPete 2 месяца назад
I know this may sound dumb, but am still a huge fan of A1111 and SD 1.5... so many options now it gets confusing. Should I scrap A1111 and move to Flux? Will Forge controlnet work as well as with A1111? Just when you get things figured out, something new comes along lol
@JDM-79-TF
@JDM-79-TF 2 месяца назад
Everything seems to work fine for me, but I'm getting no image, just a black square. Any ideas...?
@OlivioSarikas
@OlivioSarikas 2 месяца назад
did you update comfyui and all custom nodes?
@JDM-79-TF
@JDM-79-TF 2 месяца назад
@@OlivioSarikas I did, and the issue was trying to speed things with the fp8 version of Flux. I switched to the full fat one and it worked!
@asaassas1883
@asaassas1883 2 месяца назад
I am not able to download or install controlnet for stable diffusion, neither on my PC nor on my laptop I also tried it on my friends laptop, and it didn’t work Is it because of antivirus? Have anyone faced similar problem? Need help
@mehmetalirende
@mehmetalirende 2 месяца назад
how can we control 2 loras, separately. especially if it is 2 person, and each of them has own lora?
@siroandrearoncadin3028
@siroandrearoncadin3028 2 месяца назад
also interested to know this
@manchumuq
@manchumuq 2 месяца назад
ComfyUI for FLUX, everything else Fooocus, especially inpaints. Tried Forge to work with FLUX, for normal use it works like a charm, but whenever lora and others kick in, it starts to mess up with VRAM which leads to being very unrealiable.
@kesmeby
@kesmeby 2 месяца назад
I'm surprised how little I've heard about Swarm or Forge in the past 6 months. Does anyone out there use them for their daily driver?
@4thObserver
@4thObserver 2 месяца назад
I use Forge Daily. It's been recently updated for Flux, It's new NF4 feature Marginally increases SDXL 1024x1024 generation speed. Flux is still kinda new and is why I haven't jumped on it, Too many caveats to Flux's usage such as being a bit dependent on ComfyUI.
@SpikeColgate
@SpikeColgate 2 месяца назад
Yeah, Forge is great and being actively developed again. But, ControlNet for Flux not totally implemented as yet, but hoping that gets sorted very soon.
@mirek190
@mirek190 2 месяца назад
@@4thObserver nf4 is already outdated. Use Q4 or better Q4k_m
@mirek190
@mirek190 2 месяца назад
@@SpikeColgate ComfyUI has controlnet and IP adapter already for flux ;)
@enespoyraz849
@enespoyraz849 2 месяца назад
Does it work with Multi Controlnet? Also does it work with Depth Anything V2?
@virtual5754
@virtual5754 2 месяца назад
With all this flux hype I would very much appreciate tutorial on how to easily install more vram to be able to run it at all.
@craftygames
@craftygames 2 месяца назад
lol. dude you need money to get more vram. you buy it, buy a better gpu. you can't install vram.
@Elwaves2925
@Elwaves2925 2 месяца назад
The only way to get more VRAM is to buy a graphics card with more. There are tons of tutorials on YT about how to do this.
@dbusmire
@dbusmire Месяц назад
@@craftygames we can download rrraaammm?
@unreal_unit
@unreal_unit Месяц назад
So you cant Control the Denoising strength right?
@Dany-w3g
@Dany-w3g 2 месяца назад
Foocus and Forge!
@ryusuikagaku
@ryusuikagaku 2 месяца назад
can we combine it with inpainting?
@parthwagh3607
@parthwagh3607 Месяц назад
can we use flux dev controlnet for schnell model
@freneticfilms7220
@freneticfilms7220 Месяц назад
I am using Forge. But I have a question: Is Flux really slower than SD1.5 when aiming at higher resolutions? If i want to end up with an 2MP picture, i can render this directly in Flux, SD and SDXL would most likely need to be upscaled or similar techniques. So lets say 1920x1080 render in Flux vs. in SDXL...What is really faster i wonder. By the way no controlnet for Flux in Forge, right?
@rodrimora
@rodrimora 2 месяца назад
Isn't a v3 of the controlnets already available?
@mirek190
@mirek190 2 месяца назад
and IP adapter
@ernstaugust6428
@ernstaugust6428 2 месяца назад
I used v3 and it works.
@jeremiahmason6127
@jeremiahmason6127 2 месяца назад
so far I like A1111 the most, forge is a little faster but it wasn't working with some of the extensions so not really worth a few seconds faster. just now learning comfy ui and boy is it not comfy to learn lol, I can see it having lots of specific uses but not having images for the loras or models is annoying since many are named random things and looking at a picture, list of tags, and having a direct link to its civitai page is faster and more plesent to use in A1111 than trying to rename a bunch of loras to make sense in comfyui
@cekuhnen
@cekuhnen Месяц назад
AllI read is that this is Flux Dev controlNet and not Flux Schnell.
@jason_slab
@jason_slab 2 месяца назад
Thanks for the vid, anyone know how to use img2img and controlnet with the Xlabs sampler?
@aivideos322
@aivideos322 2 месяца назад
Just need animate diff now and we have a new 1.5. :P
@MillennialKiwiGamer
@MillennialKiwiGamer Месяц назад
WHY are there 4 prompt boxes? What do they do? Ugh
@benoitcorvol7482
@benoitcorvol7482 2 месяца назад
Comfyui definitely !
@mirek190
@mirek190 2 месяца назад
Can you test IP adapter for flux?
@hugo_leveille
@hugo_leveille 2 месяца назад
For some reasons, its works but all results looks like a painting, not photo real
@AlastorsNight
@AlastorsNight Месяц назад
I will have to see about installing the low memory models as I can not any renders to complete as I keep getting the "torch.cuda.OutOfMemoryError: Allocation on device" error. This is with a fresh install on a computer with a nVidia 3080 with 32GB of ram.
@Kvision25th
@Kvision25th Месяц назад
Input type (torch.cuda.FloatTensor) and weight type (torch.cuda.HalfTensor) should be the same error from MIdas Depth Map :( dont know how to solve this :(
@Kvision25th
@Kvision25th Месяц назад
NM restart fixed it...
@ShadowWind82
@ShadowWind82 Месяц назад
No folder, that shold be at 1:53 . Done, and redone couple times. Not work.
@HemantkumarSharma-n1s
@HemantkumarSharma-n1s 2 месяца назад
Rtx 3060 8gb vram.....flux won't even move forget about flux controlnet😢
@Dany-w3g
@Dany-w3g 2 месяца назад
I'm using Forge. I have an rtx 3060 12 GB, all models work.
@pieugedher257
@pieugedher257 2 месяца назад
Thanks, unfortunately, I only have 6 VRM
@jasonstetsonofficial
@jasonstetsonofficial 2 месяца назад
FORGE FOR THE WIN
@angryox3102
@angryox3102 2 месяца назад
Just looked it up, looks so much easier. Will definitely give it a try this weekend
@Velanteg
@Velanteg 2 месяца назад
Is it possible to use control net without xlabs sampler? Its very bad and image looks fried like with very high CFG.
@mirek190
@mirek190 2 месяца назад
should works already stock controlnet from comfyui ...
@noonesbiznass5389
@noonesbiznass5389 2 месяца назад
Just turn down the true_gs (true guidance scale) parameter to 1 or less...
@Velanteg
@Velanteg 2 месяца назад
@@noonesbiznass5389 Than happens same what if set cfg to 1 in normal SD - image becomes pale and dark.
@MayOkataChan
@MayOkataChan 2 месяца назад
uh what about a forge tutorial please?
@TBjunk25
@TBjunk25 2 месяца назад
Flux is cool but it’s like 10x slower than SD 1.5
@electronicmusicartcollective
@electronicmusicartcollective 2 месяца назад
CUSHY with Comfyui
@jcvijr
@jcvijr 2 месяца назад
I use ComfyUI 30% of time, but still use A1111 70% of time.
@RayneBlood
@RayneBlood 2 месяца назад
forge, its just faster and easier to use
@JieTie
@JieTie 2 месяца назад
Next vid on how to train custom lora for flux? :) locally :D
@MillennialKiwiGamer
@MillennialKiwiGamer 2 месяца назад
Ugh another Comfy tutorial. Dislike. ForgeUI is better
@aivideos322
@aivideos322 2 месяца назад
lol
@chrisbraeuer9476
@chrisbraeuer9476 2 месяца назад
Comfy is way better, because you can sell workflows...
@perfectionatic
@perfectionatic 2 месяца назад
ComfyUI
Далее
STOP Wasting Time with A1111, Use Forge UI Instead
12:37
ДУБАЙСКАЯ ШОКОЛАДКА 🍫
00:55
Просмотров 2,4 млн
Rate our flexibility 1-10🔥👯‍♀️😈💖
00:12
I Tested SD 3.5 and ComfyUI.exe - Here's What's Best!
11:43
Claude has taken control of my computer...
4:37
Просмотров 887 тыс.
Is SUPER FLUX the Secret to Insane Details?
8:58
Просмотров 27 тыс.
AI images just got WAY too real. FLUX 1.1 deep dive
33:15
Flux ControlNet - How to guide for ComfyUI
16:18
Просмотров 10 тыс.
IPAdapter for Flux - with ComfyUI Workflow
10:36
Просмотров 34 тыс.
ДУБАЙСКАЯ ШОКОЛАДКА 🍫
00:55
Просмотров 2,4 млн