ComfyUI Just Got Better: Finally, a Fix for Flux Upscaling and 2 more Mindblowing ControlNet Models

Подписаться 291

Просмотров 2,1 тыс.

50% 1

Finally, an upscaling solution for Flux users-watch the full guide!
Workflow:
openart.ai/workflows/sneakyrobot/sneaky_robot-gguf_fp8-workflow-plus-controlnet-upscaler-and-controlnet/wUHlwiibPMgVxf7RPZsU
Install ComfyUI:
• Say Goodbye To VRAM Li...
Hyper flux and Workflow indroduction:
• How to Unlock Faster I...
Flux Controlnet:
• How to Run Flux Contro...
The Mistoline Note and the perfection style Nodes has to be manually installed, Here are the steps:
Installing perfection styler:
Go to the custom nodes folder, right click on empty space in the folder and then click on open in terminal.
next copy the following in the terminal and press enter: git clone github.com/Tri...
Restart comfyUI and it will be installed automatically.
Installing Mistoline:
First thing you need to do is to Navigate to the custom note's folder, (ComfyUI_windows_portable\ComfyUI\custom_nodes), right click on empty space inside the folder and select open in terminal. Next paste the following in the terminal that's now open, git clone github.com/The... . Press enter and wait for it to install. After it's done installing close the terminal and start comfyUI again, it will auto install the note automatically on startup,
Model list.
Flux Dev GGUF:
huggingface.co/city96/FLUX.1-dev-gguf/tree/main
Flux Dev fp8:
huggingface.co/XLabs-AI/flux-dev-fp8/blob/main/flux-dev-fp8.safetensors
T5 GGUF Model:
huggingface.co/city96/t5-v1_1-xxl-encoder-gguf/blob/main/t5-v1_1-xxl-encoder-Q4_K_M.gguf
T5 FP8 Model:
huggingface.co/stabilityai/stable-diffusion-3-medium/tree/main
NB: you'll need to login or sign and agree to the terms of stabilityai to download the fp8 model
Clip VIT:
huggingface.co/zer0int/CLIP-GmP-ViT-L-14/blob/main/ViT-L-14-TEXT-detail-improved-hiT-GmP-TE-only-HF.safetensors
Flux hyper model Lora:
huggingface.co/ByteDance/Hyper-SD
Flux dev add detail lora:
huggingface.co/Shakker-Labs/FLUX.1-dev-LoRA-add-details
jasperai/Flux.1-dev-Controlnet-Upscalerr:
huggingface.co/jasperai/Flux.1-dev-Controlnet-Upscaler/blob/main/diffusion_pytorch_model.safetensors
jasperai/Flux.1-dev-Controlnet-Depth:
huggingface.co/jasperai/Flux.1-dev-Controlnet-Depth/blob/main/diffusion_pytorch_model.safetensors
jasperai/Flux.1-dev-Controlnet-Surface-Normals:
huggingface.co/jasperai/Flux.1-dev-Controlnet-Surface-Normals/blob/main/diffusion_pytorch_model.safetensors
Controlnet Depth:
huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Depth/blob/main/diffusion_pytorch_model.safetensors
Contorlnet Canny:
huggingface.co/InstantX/FLUX.1-dev-Controlnet-Canny/blob/main/diffusion_pytorch_model.safetensors
Mistoline Controlnet:
huggingface.co/TheMistoAI/MistoLine_Flux.dev/blob/main/mistoline_flux.dev_v1.safetensors
Mistoline GitHub:
github.com/TheMistoAI/MistoControlNet-Flux-dev
#comfyui #flux

Опубликовано:

6 окт 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 31

@kamaelfleur День назад

thanks for the workflow!. The best so far of all I have tried. the author deserves more subscriptions for quality content

@TheSneakyRobot День назад

Thank you too! Much appreciated.

@kamaelfleur День назад

@@TheSneakyRobotsome suggestions that surfaced during testing: may be we can optimize the process of selecting the downscale factor and upscale multiplier, perhaps with the help of mathematical nodes, make the calculation of these factors automatically based on the original resolution of the image. Based on the specifics of the upscaler, the final resolution for the upscale should not exceed 2k. So you can create switches presets to select for example: 1k1-repaint original, 1500 and 2048 pixels. The idea is that the upscale factor would be set automatically based on the uploaded image. It may be necessary to fix the downscale factor at 0.5.

@TheSneakyRobot День назад

Thats a great Idea. Don't know why I haven't thought of that. Thanx for the Idea!

@TheSneakyRobot День назад

Here's some freebies: Workflow: openart.ai/workflows/sneakyrobot/sneaky_robot-gguf_fp8-workflow-plus-controlnet-upscaler-and-controlnet/wUHlwiibPMgVxf7RPZsU Model list. Flux Dev GGUF: huggingface.co/city96/FLUX.1-dev-gguf/tree/main Flux Dev fp8: huggingface.co/XLabs-AI/flux-dev-fp8/blob/main/flux-dev-fp8.safetensors T5 GGUF Model: huggingface.co/city96/t5-v1_1-xxl-encoder-gguf/blob/main/t5-v1_1-xxl-encoder-Q4_K_M.gguf T5 FP8 Model: huggingface.co/stabilityai/stable-diffusion-3-medium/tree/main NB: you'll need to login or sign and agree to the terms of stabilityai to download the fp8 model Clip VIT: huggingface.co/zer0int/CLIP-GmP-ViT-L-14/blob/main/ViT-L-14-TEXT-detail-improved-hiT-GmP-TE-only-HF.safetensors Flux hyper model Lora: huggingface.co/ByteDance/Hyper-SD Flux dev add detail lora: huggingface.co/Shakker-Labs/FLUX.1-dev-LoRA-add-details jasperai/Flux.1-dev-Controlnet-Upscalerr: huggingface.co/jasperai/Flux.1-dev-Controlnet-Upscaler/blob/main/diffusion_pytorch_model.safetensors jasperai/Flux.1-dev-Controlnet-Depth: huggingface.co/jasperai/Flux.1-dev-Controlnet-Depth/blob/main/diffusion_pytorch_model.safetensors jasperai/Flux.1-dev-Controlnet-Surface-Normals: huggingface.co/jasperai/Flux.1-dev-Controlnet-Surface-Normals/blob/main/diffusion_pytorch_model.safetensors Controlnet Depth: huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Depth/blob/main/diffusion_pytorch_model.safetensors Contorlnet Canny: huggingface.co/InstantX/FLUX.1-dev-Controlnet-Canny/blob/main/diffusion_pytorch_model.safetensors Mistoline Controlnet: huggingface.co/TheMistoAI/MistoLine_Flux.dev/blob/main/mistoline_flux.dev_v1.safetensors Mistoline GitHub: github.com/TheMistoAI/MistoControlNet-Flux-dev

@yiluwididreaming6732 День назад

ahhh...there we go....TA!!!!

@npgolding 22 часа назад

This is so well done!

@TheSneakyRobot 22 часа назад

Thanks'

@ultimategolfarchives4746 15 часов назад

Great stuff man! Thanks for the detailed guide. One potential enhancement suggestion: considering adding a brief, basic demo of a raw workflow at the beginning to set the foundation, before diving into the more detailed workflow. Would help new viewers Great job 👌

@TheSneakyRobot 13 часов назад

Thanks for the suggestion, will do that next time.

@thibaudherbert3144 День назад

Honnestly your workflow is certainly the most well thought / usable / versatile. Most of comfyui workflows on youtube are either not complete or uselessely complexe for no real benefits. Yours is the right balance. The only problem is the upscaler, to me it's not usable for now, way too grainy, the output is worse than original. It's not like a 8x tile super SD upscaler, but thank you for your workflow !

@TheSneakyRobot 23 часа назад

Thanx, Try 4 x upscale with 8 steps. takes a bit longer but removes the grain completely.

@thibaudherbert3144 23 часа назад

@@TheSneakyRobot ok ill try that thx

@thibaudherbert3144 20 часов назад

@@TheSneakyRobot sadely there is a problem with the node under the sdxl prompt styler in text 2 img. It's impossible to download the node even after updating everything etc. I've even fresh install comfyui still does not work i don't know how to correct this or find an alternative. I think it's the perfection styler block

@thibaudherbert3144 20 часов назад

it's apparently caused by ComfyUI-Universal-Style, many people have this problem, but i can't find a way to replace all the missing nodes in your workflow without this node ='( hope you can find an alternative

@TheSneakyRobot 17 часов назад

This is the perfection styler which is part Mile high styler package. you need to manually install it. - Go to the custom nodes folder, right click on empty space in the folder and then click on open in terminal. - next copy the following in the terminal and press enter: git clone github.com/TripleHeadedMonkey/ComfyUI_MileHighStyler.git - Restart comfyUI and it will be installed automatically. The other is the Mistoline which also has to be manualy installed: First thing you need to do is to Navigate to the custom note's folder, (ComfyUI_windows_portable\ComfyUI\custom_nodes), right click on empty space inside the folder and select open in terminal. Next paste the following in the terminal that's now open, git clone github.com/TheMistoAI/MistoControlNet-Flux-dev.git . Press enter and wait for it to install. After it's done installing close the terminal and start comfyUI again, it will auto install the note automatically on startup,

@thibaudherbert3144 20 часов назад

After a fresh install of comfyui your workflow is using many corruped nodes apparently, many nodes are conflicting or can't be used even though i install all the missing nodes, update everything, starting fresh. it's sad cause your worfklow was the best. I even tried to install all the custom nodes manually with git clone but nothing changes. Everything is conflicting

@TheSneakyRobot 19 часов назад

I will try and test it on a clean install of ComfyUI and let you know what conflicts there are and how to fix it, Thanx for letting me know

@TheSneakyRobot 16 часов назад

Opologies for the lengthy explanation. I installed comfy on a different drive, and this is what I found: 1. when you install the nodes don't install all of them at once. - I found that installing 3 nodes at a time works perfectly. - another thing I've noticed is that it takes a while to install some nodes. 2. there are two nodes that's not part of the comfyUi manager and that the perfection styler and mistoline nodes. Install perfection styler: - Go to the custom nodes folder, right click on empty space in the folder and then click on open in terminal. - next copy the following in the terminal and press enter: git clone github.com/TripleHeadedMonkey/ComfyUI_MileHighStyler.git - Restart comfyUI and it will be installed automatically. Install Mistoline: First thing you need to do is to Navigate to the custom note's folder, (ComfyUI_windows_portable\ComfyUI\custom_nodes), right click on empty space inside the folder and select open in terminal. Next paste the following in the terminal that's now open, git clone github.com/TheMistoAI/MistoControlNet-Flux-dev.git . Press enter and wait for it to install. After it's done installing close the terminal and start comfyUI again, it will auto install the note automatically on startup. 3. As for the conflicts: There really isn't any. the only thing I've seen is that some packages have nodes inside them that conflict with each other. you'll be fine as long as those are not in the workflow. I'll clarify in the next video.

@thibaudherbert3144 16 часов назад

@@TheSneakyRobot ok i'll reinstall comfy and try again, thanks for your time, ill let u know if it fixed it or not

@mal-avcisi9783 22 часа назад

hey bro, do you use another comfpyUI version, your toolsbars etc on top etc. looks different ?

@TheSneakyRobot 21 час назад

It's the new comfyUI front end. All you have to do is to update comfy, and in the settings change the menu to top.

@mal-avcisi9783 21 час назад

@@TheSneakyRobot thanks

@AInfectados День назад

Better than SUPIR?

@TheSneakyRobot День назад

As far as I've tested Supir is GPU intensive, Plus it requires a second Checkpoint, preferably a sdxl checkpoint, which will take more or less an hour on a 8GB GPU, and way longer if you use flux to upscale. So Yes, For Low VRam Systems Its better.

@cemilhaci2 19 часов назад

thanks, workflow link not working

@TheSneakyRobot 19 часов назад

Fixed it. here's the workflow. Please let me know how I can improve on it. openart.ai/workflows/sneakyrobot/sneaky_robot-gguf_fp8-workflow-plus-controlnet-upscaler-and-controlnet/wUHlwiibPMgVxf7RPZsU

@cemilhaci2 18 часов назад

Sorry, I solved the problem, false alarm :D

@TheSneakyRobot 13 часов назад

glad it's working.