How Do Stable Video Diffusion?

Подписаться 1,2 тыс.

Просмотров 3,2 тыс.

50% 1

This video provides a guide for creating video clips using ComfyUI with Stable Video Diffusion, including custom workflows that improve upon existing examples, adding upscaling and a great solution for frame interpolation.
* The "Improved" workflows below include tweaks discovered after releasing this video to improve quality of outputs.
Links
Custom Workflows: drive.google.com/drive/folder...
*Improved txt2img2vid Workflow: comfyworkflows.com/workflows/...
*Improved img2vid Workflow: comfyworkflows.com/workflows/...
ComfyUI Github Repo: github.com/comfyanonymous/Com...
ComfyUI img2vid Examples: comfyanonymous.github.io/Comf...
Stability AI img2vid-xt Models: huggingface.co/stabilityai/st...
JuggernautXL Model: civitai.com/models/133005/jug...
Video Helper Suite Node: github.com/Kosinkadink/ComfyU...
How To Install Custom Nodes: stable-diffusion-art.com/comf...
OpenModelDB / LSDIRDAT Upscaler: openmodeldb.info/models/4x-LS...
comfyui_controlnet_aux(optional): github.com/Fannovel16/comfyui...
Flowframes (repo): github.com/n00mkrad/flowframes
Flowframes (itch.io): nmkd.itch.io/flowframes
Chapters
0:00 Overview
0:22 Install ComfyUI
1:02 Download Stable Video Diffusion Models
1:49 Choose a txt2img Model
2:01 ComfyUI's img2vid/txt2img2vid Examples
3:32 Custom txt2img2vid Workflow
5:26 Upscaling in the Custom Workflow
6:08 Running Through the Workflow
8:35 Custom img3vid Workflow
10:08 Frame Interpolation
12:40 Results / Comparison
*Narration created using Elevenlabs' SpeechToSpeech Synthesis

Хобби

Опубликовано:

11 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 10

@ryanbertsch 5 месяцев назад

Appreciate providing all this! Nice work!

@user-ck5sh2um3b 5 месяцев назад

Amazing work thank you !

@JackEvage 7 месяцев назад

Very good. Thanks for making the workflow. -Small note, links in the description are currently cut off/not linking to all your links, so I have to rebuild what you've got manually.- (Is now fixed, thanks!) Other than that, good stuff!

@HowDoTutorials 7 месяцев назад

Thanks for watching! Glad you found it useful. Thank you for pointing out the issue with the links too. I’ll get that sorted. 😅

@neuralplay 7 месяцев назад

Nice video! Let's keep growing! AI is amazing!

@gamingdayshuriken4192 7 месяцев назад

thx

@HowDoTutorials 7 месяцев назад

Thanks for watching!

@onurc.6944 3 месяца назад

When it comes to svd decoder the connection is lost :(

@HowDoTutorials 3 месяца назад

Sorry to hear it's giving you trouble. Here are a couple things to try: 1. Make sure you're using the correct decoder model for your SVD model. (e.g. If using the "xt" model be sure you're using the "xt" decoder) 2. You may be running out of memory. Try lowering the `video_frames` parameter. You might also try using the non-xt model and decoder.

@onurc.6944 3 месяца назад

Thanks ur help :) I can work without image_decoder@@HowDoTutorials