Stable Video Diffusion - RELEASED! - Local Install Guide

Подписаться 229 тыс.

Просмотров 123 тыс.

50% 1

#StableVideoDiffusion Stable Video Diffusion has been Released! This easy Guide shows you how to set everything up. Run Stable Video Diffusion on your Computer today! This Image to Video Render Worflow is super easy to use and gives you stunning results.
#### Links from the Video ####
Download Workflow: drive.google.com/file/d/17UQX...
SVD Model Download: huggingface.co/stabilityai/st...
Enigmatic_e Video: • STABLE VIDEO DIFFUSION...
#### Join and Support me ####
Buy me a Coffee: www.buymeacoffee.com/oliviotu...
Join my Facebook Group: / theairevolution
Joint my Discord Group: / discord
AI Newsletter: oliviotutorials.podia.com/new...
Support me on Patreon: / sarikas
00:00 Intro
01:58 Model Download
03:02 ComfyUI Nodes
04:20 SVD Workflow Explained
06:23 Stable Video Diffusion Thoughts

Хобби

Опубликовано:

1 авг 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 336

@OlivioSarikas 8 месяцев назад

#### Links from the Video #### Download Workflow: drive.google.com/file/d/17UQXmDRvPLLI7c6g76LlZF4BjMuoRHQa/view?usp=sharing SVD Model Download: huggingface.co/stabilityai/stable-video-diffusion-img2vid/tree/main Enigmatic_e Video: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-imyQuIiuRnA.html

@LouisGedo 8 месяцев назад

👋

@DerXavia 8 месяцев назад

hey, you forgot the link to the Comfy UI Manager Extention :)

@hackernoonk4645 8 месяцев назад

that is so cool

@huymaivan8671 7 месяцев назад

Is this possible to install this locally on PC with window 7???

@anonymous14 7 месяцев назад

Please add to this comment that you have to click on RIFE VFI ckpt_name and then select either rife47.pth or rife49.pth There are several comments about people who got an error. thank you.,

@BarbaraBasso 8 месяцев назад

Thank you, Olivio! I was starting to doubt my computer's capabilities after my tests failed yesterday. However, after following this tutorial, everything clicked into place. It turns out that the crucial missing piece was the 'update all' step in my tests. Lesson learned!

@OlivioSarikas 8 месяцев назад

Awesome! Thank you

@aivideos322 8 месяцев назад

This is a good step, as soon as they allow LCM and text input to be added it will be game changing. The stability of the backgrounds is outstanding compared to animated diff but the motion of people is severely lacking as well as no lora support. I have high hopes for this to improve fast however.

@ChronicKPOP 7 месяцев назад

2023 and installs are still crazy. One day, we'll be so advanced, we can click "install" and things will get installed simply... one day.

@JL-sy2me 8 месяцев назад

Finally! That looks so amazing.

@vatoko 7 месяцев назад

Hooray! Happened! I figured it out in just 2 days )) Thank you very much!

@grzesiektg 8 месяцев назад

oh dang, will have to try it now! thanks for the sources! :)

@intangur 8 месяцев назад

Thanks for the guide! Haven't used deforum much lately, and runwayml tends to get pricey. This will be fun to play around with.

@OlivioSarikas 8 месяцев назад

you are welcome. i love these new models :)

@Arshoon 8 месяцев назад

The age of AI never ending shows we can binge is coming.

@OlivioSarikas 8 месяцев назад

Doom Scrollers gonna be doomed 🤣

@Gromst3rr 4 месяца назад

Thank you very much, Olivio!

@loszhor 8 месяцев назад

Thank you for the information.

@eliluong 8 месяцев назад

thanks for the guide!

@flavorbot 3 месяца назад

thanks for the quick and easy breakdown have been putting off learning comfy but this helps a lot

@johnyau4290 7 месяцев назад

Hello, thank you for the tutorial! I'm wondering how I can get the RIFE VF1 and Video Combine nodes?

@touaxiong3452 8 месяцев назад

thank you for the tutorial it help a lot

@matthallett4126 8 месяцев назад

I'm in the process of making a WWII movie trailer with SVD. So fun.

@darrenvarley105 8 месяцев назад

Kinda cool. Can see it being useful for making mini-clips for presentations or youtube vids (more interesting then putting still images I guess).

@amj2048 8 месяцев назад

can't wait to get some free time to check this out

@chardellbrown1821 8 месяцев назад

Ha, I was waiting for your take on the install my friend

@ogrekogrek 6 месяцев назад

thank you Oliviio

@ArtificialBeauties 8 месяцев назад

Thanks for sharing 💗

8 месяцев назад

Cool thank you !

@jaysonwall434 7 месяцев назад

Awesome! So helpful! :) :) :)

@MarcGough 6 месяцев назад

Olivio your attention to detail in sharing these workflows is phenomenal - thank you

@SamBeera 8 месяцев назад

Hi Olivio, thank you so much for this video, its clear step by step, helps someone to follow along and implement it. I have an older GPU - NVIDIA GeForce GTX 1080 Ti, and it takes quite a long time to render the video. How much time does it take on your system?

@KraftyMarketing 3 месяца назад

Thank you very much, awesome tutorial :)

@GibGiab-gc7qm 8 месяцев назад

Thnks man! I will return to see in the comment the hardware needed.. no infos on the net..

@FutonGama 8 месяцев назад

Very nice

@sb6934 8 месяцев назад

Thanks!

@nauseouscustody1440 8 месяцев назад

👍Cool as ever

@sirdrak 8 месяцев назад

An important note: In the video you shows svd and svd_image_decoder as 14 fps and 25 fps models, but that's incorrect... The model for 25 fps video is svd_xt, located in another different hugginface link...

@alexdesouza8696 8 месяцев назад

so what's the difference then?

@JimboSkinner 8 месяцев назад

Oh my gosh you’re right. I just grabbed the model from the post on the Hugging Face homepage and it was the xt version

@PyruxNetworks 8 месяцев назад

in model info it mentioned as "we also finetune the widely used f8-decoder for temporal consistency. For convenience, we additionally provide the model with the standard frame-wise decoder"

@KINGLIFERISM 8 месяцев назад

Not all heros wear capes...

@Finhornify 8 месяцев назад

Thanks for noticing and saying something.

@PCproffesorx 8 месяцев назад

I still havent made the switch to comfy. I have a fairly complex workflow in a1111 that I am sure if I spent enough time could automate in comfy , but I like all the tinkering and inpainting and iterative steps that I use in a1111. In comfy I feel like you setup a workflow and its all done in one shot. I guess I could create a workflow for each step and have it work somewhat the same though.

@stefankrstic2529 5 месяцев назад

I automated my a1111 workflow with nodejs scripts and using a1111 API, but when I look at comfy it looks like you can do all of that in browser without need for coding. Plus everything new always work in comfy first xD So decided to switch today. Time to say bye bye to a1111

@letech5144 6 месяцев назад

Thank you for the detail instruction! I was able to create a 512x512 14 frames rocket video finally (Prompt executed in 599.47 seconds) with my rx580 4gb video card.

@-E42- 8 месяцев назад

thanks man... !

@vladimirrog 6 месяцев назад

Thank you

@jtreedy116 8 месяцев назад

Anyone know if there is a way to choose which direction the resulting video pans left vs right?

@Gh0sty.14 8 месяцев назад

I'm finding it actually works quite well at different resolutions. I've done 512x768, 768x768 etc and they turned out good.

@Steamrick 8 месяцев назад

can it do 1280x720?

@ILLIZID 8 месяцев назад

@@Steamrick Im running it at 2416x1360

@OlivioSarikas 8 месяцев назад

yes, but 576x1024 is the suggested res, because that is what it was trained on. :)

@Gh0sty.14 8 месяцев назад

@@OlivioSarikas Yeah definitely. I ended up trying it because at native resolution I couldn't generate 25 frames without running out of vram lol

@SmartMoneyRyan 6 месяцев назад

@@Gh0sty.14 how much vram?

@Merlinvn82 8 месяцев назад

RTX 3060 with 14 frames model took about 2 mins per render ❤❤❤

@mirek190 8 месяцев назад

with 3090 few seconds ;) ... around 10 seconds

@MatticusNicholas 5 месяцев назад

4070TI Super around 1 minute for the 25 frames model with a multiplier of 4

@MuratAtasoy 4 месяца назад

rtx 3060ti, it take decates :/ because of my image 1024x1024??

@Merlinvn82 4 месяца назад

@@MuratAtasoy check if your GPU is running while generating video.... maybe 8Gb VRAM is not sufficient....

@sb6934 8 месяцев назад

Thanks

@Macatho 8 месяцев назад

Every time you're pronouncing the word "copy" incorrectly, exactly like my boss does 😅love it hah

@niztheshpiz 8 месяцев назад

Is it possible to add this extension to Stable Diffusion automatic1111 workspace?

@Comic_Book_Creator 8 месяцев назад

thank you , I make it work, so now question, how do i manage the animations, right now its like zoomin zoom out ... do there any other workflow where we can add also prompt?

@MatticusNicholas 5 месяцев назад

Thanks for the helpful video. Do you think there is a enhance detail node I can apply at some point in the workflow that will eliminate the blurriness and disfigurement that happens at times?

@lcmiracle 8 месяцев назад

I'm eagerly looking forward to being able to generate my own Warhammer Fantasy Battle movie with nothing but a script I have generated using any random uncensored text-to-text model in a year's time

@4.0.4 8 месяцев назад

Gonna wait for the A1111 version

@Grognakwf 8 месяцев назад

With the 24 frame model I got around 6s/it, 14 frame model around 3s/it. 8gb v-ram, rtx3070

@xXxDisplayNamexXx 8 месяцев назад

I downloaded everything correctly, but my ckpt isn't loading in, despite it being in the right spot. All it gives me is an undefined/null and no option to select any models. I have the paths set up correctly in the YAML file, so I'm not totally sure what the issue is

@Nightmare026 8 месяцев назад

Amazing!!!

@FF_LL_XX 6 месяцев назад

Thanks for the nice tutorial - i have one question - in which node i can change the length of the final video? Best Felix

@Make_a_Splash 8 месяцев назад

Thank you Olivio. I'm loving comfyUI, specially because it is old PC friendly. I'll give it a go.

@OlivioSarikas 8 месяцев назад

comfyUI is like Lego for AI. Makes me feel like a kid in a candy store :)

@user-xx8uu6tm2e 8 месяцев назад

Why I do not have access to the preview video? I need to click on "Queue Prompt" and render it to see

@hogstoothairsoft1967 8 месяцев назад

thx for the video! tried it for a few hours, but without any other modifications it's nothing for me... (like length, prompts, maybe loras)

@wowd-rt7rc 8 месяцев назад

Please help, I've gotten these errors before and gave up in the past with other workflows.. I've attempted with my main Comfyui install and a fresh one. I've run the manager and installed all missing nodes, did an update check, and restarted multiple times. When loading the graph, the following node types were not found: ImageOnlyCheckpointLoader SVD_img2vid_Conditioning FreeU_V2 VideoLinearCFGGuidance Nodes that have failed to load will show as red on the graph.

@michaelharper9174 8 месяцев назад

im having the same problem! when i check for missing nodes nothing shows up :(

@AIVideoZeppelin 6 месяцев назад

Hello. I can't configure it. Where are the downloaded models placed within ComlyUI? In what folder, or how are they installed?

@beatle72298 6 месяцев назад

Has anyone else noticed that when using this default workflow that the output video appears "smooth" or smeared in comparison to the input image? This even happens when starting with a lower resolution image.

@Stormthedude 8 месяцев назад

When loading the graph, the following node types were not found: VHS_VideoCombine

@JonRowlison 7 месяцев назад

I'm taking the leap to ComfyUI... and svd_xt. Is there any way to 'coax' a specific movement (like, only background, only foreground, move an arm but don't trip out like you just took dr*gs?) The motion is generally really nice with this model, but very frustrating sometimes with its choices of WHAT it's going to animate and what is going to stand still... resulting in 20+ runs for one animation that kind of matches what the original hope.

@aLx-gaming-official 7 месяцев назад

I tried to do the steps you have shown, but it seems like i run into some errors... If I try to do the "Update All" it gives me the following error: Failed to update ComfyUI or several extensions / TypeError: Cannot set properties of null (setting 'onclick') If i load the json config it says: When loading the graph, the following node types were not found: RIFE VFI VHS_VideoCombine Seed (rgthree) Nodes that have failed to load will show as red on the graph. How can i fix this?

@whatwherethere 8 месяцев назад

What is the VRAM resource requirement? I expect it is 10GB or greater. Is there a low VRAM solution?

@zobbizobba2088 8 месяцев назад

Would it work on a mac mini ? considering buying one…

@ArcaneRealities 8 месяцев назад

Olivio is there a way to send a folder of images to SVD? I tried a few ways but kept getting errors - I want to take a story board full of a movie and pump it thru without manually doing it 1 at a time

@kendollridenour4853 8 месяцев назад

(Anyone else having problems when they try to update all in the comfy ui manager after i update it continuously says restarting) i just got it working great video i do wish yo explained some parts better

@ScottWinterringer 8 месяцев назад

but what did comfui do that the others didnt here...

@Comic_Book_Creator 8 месяцев назад

also my video comes out 2 se, how can I make it 4 sec?

@Flightrovx 8 месяцев назад

When loading the graph, the following node types were not found: RIFE VFI Seed (rgthree) VHS_VideoCombine Nodes that have failed to load will show as red on the graph.

@tybost 8 месяцев назад

You gotta click on the one already there and change it to RIFE 47 or 49.

@pogiman 8 месяцев назад

what version of Comfy UI are you using? mine dont have that fancy share button

@mirek190 8 месяцев назад

update it

@CyberPhonkMusic 5 месяцев назад

Is there a way to extend a video after it has been created?

@MicahBBurke 8 месяцев назад

Link for ComfyUI manager? Thanks Olivio!

@thoughtlab6000 5 месяцев назад

Did not see the link to the comfyui manager extension. : ) thanks for the vid

@gizmomismo7071 8 месяцев назад

Do anybody know how much VRam you need to run this?

@MyWhyAI 8 месяцев назад

You can run it on 6Gb of VRAM

@mirek190 8 месяцев назад

24 fps model takes 9 GB for me @@MyWhyAI

@hashir 8 месяцев назад

Unfortunately doesn’t work on my M2 Mac MBP. Getting “RuntimeError: Conv3D is not supported on MPS”

@Roninworld 7 месяцев назад

x3 ahah mac

@amirgnia5412 8 месяцев назад

Guys I need your help with this : When loading the graph, the following node types were not found: • SVD_img2vid_Conditioning • VideoLinearCFGGuidance • ImageOnlyCheckpointLoader Nodes that have failed to load will show as red on the graph. PLZZZZZZZZZZZZZZZ

@w_chadly 8 месяцев назад

anybody got this and solved it? Error occurred when executing VHS_VideoCombine: An error occured in the ffmpeg subprocess: Unrecognized option 'crf'. Error splitting the argument list: Option not found

@Bob-em6kn 2 месяца назад

Do we have to install ALL the node?

@metatron3942 8 месяцев назад

Image complexity doesn't seem to matter as long as you have shallow depth field like a distinguishing difference between the foreground person or object and the background such as a clear border.

@OlivioSarikas 8 месяцев назад

true, but what i meant to say is that it won't do a complex dance move or anything like what you see in the deforum and kaiber videos

@openroomxyz 8 месяцев назад

You did not mention how much VRAM requires to work ?

@Eleganttf2 8 месяцев назад

12gb

@neofuturoai 8 месяцев назад

minimum 8GB, 6 if you do smaller image size

@mirek190 8 месяцев назад

for me takes 9 GB 25fps model @@Eleganttf2

@Maltebyte2 5 месяцев назад

Can i use this with a gtx 1080ti? i dont want to train the AI just use it. Thanks!

@Byrdfl3wsNest 8 месяцев назад

Amazing work as always Olivio! - If anyone here is getting an "Error occurred when executing KSampler: unsupported operand type(s) for *=: 'int' and 'NoneType'" and has a solution please let me know. Thanks!

@GBUK666 8 месяцев назад

If you disable FreeU Advanced, problem goes away.

@Byrdfl3wsNest 8 месяцев назад

It works! Thank you@@GBUK666Thank you!!! You legend!!!

@omarei 8 месяцев назад

Do you mean to delete the FreeU node? I did that and still same error. Odd@@GBUK666

@Varibam 8 месяцев назад

Help me Olivio Wan Kenobi, you are my only hope... No matter image i feed into it, all i get is a slight zoom in. Tried cars, People, Beach, a fighting scene etc. I used the exact workflow from the link without changing any settings. I even scaled down the images in gimp to a 1024 x 576 resolution.

@Macieks300 8 месяцев назад

I thought you need 40 GB of VRAM for SD Video to work? How much VRAM do you have, Olivio?

@mirek190 8 месяцев назад

For me takes 9 GB of 24 GB - 24 fps model ( rtx 3090 )

@Roninworld 7 месяцев назад

3050 8 gb vram, 16 ram gb r7 1800x and take me 3 min to create a vid@@mirek190

@ThaMoonwalkerFSDBetaChannel 5 месяцев назад

how do i download what i beed on a macbook?

@kkryptokayden4653 8 месяцев назад

How long can the videos be?

@huyked 8 месяцев назад

What's the minimum requirements in regard to VRAM, RAM, graphics card, etc.?

@baza0 8 месяцев назад

Just did the beach vid. on rtx2070 8gb, took 20min. My card is underclocked 10%. Used the 25fps model listed on Enigmatic_e Video.

@tukanhamen 8 месяцев назад

Can't we just add text to image to the workflow then feed that image to SVD? That could be a temporary solution to text to video until we get official support right?

@Gh0sty.14 8 месяцев назад

Yeah there's a workflow that uses text to generate an image then it uses that for the video. Find the post titled "ComfyUI Update: Stable Video Diffusion on 8GB vram with 25 frames and more" in the SD subreddit and the link they provide includes the workflow.

@johanskaneby 5 месяцев назад

Hey - where is the ComyUI instuction? you said you where going to link?

@lKaos66 Месяц назад

Thanks a lot man. I have a problem: when installing all the missing nodes, all of them install correctly but one: the VHS VideoCombine. I get the same error again and again: "When loading the graph, the following node types were not found: VHS_VideoCombine Nodes that have failed to load will show as red on the graph." I tried to update it, fix it, and even deleting it and reinstalling it, but nothing seems to work for me. Do you know what could it be? Thanks!!

@tcla75 8 месяцев назад

If I install any of the custom nodes that is needed for this workflow my VRAM usage jumps from just under 8GB and about 6 minutes to render to over 10.7 and 23 mins to render (if it didn't crash) and then it crashes because I am using a 1080 ti but then when I uninstall these custom nodes seanlynch ComfyUI Optical Flow, Nuked ComfyUI-N-Nodes and YOUR-WORST-TACO ComfyUI-TacoNodes it goes back down to under 8GB and 3 times faster render. Anyone know why?

@mirek190 8 месяцев назад

time to upgrade 1080 is very old especially for playing with AI ... buy second hand 3090 which are cheap ... rendering video on that card takes few seconds ...

@fahdherati 8 месяцев назад

Ask me for VHS_VideoCombine ? I could not find it in the manager

@AutumnRed 8 месяцев назад

I've tried this but for most pictures all I get is a simple animation that could be done much faster and easier with any mobile phone app for video editing, I hope this AI improves soon though

@Stick3x 8 месяцев назад

Does not work with M1-M2 silicon macs. Get an error.

@CyberPhonkMusic 5 месяцев назад

How do I create longer videos?

@dogewoof6286 7 месяцев назад

thanks Tyson fury

@alecubudulecu 8 месяцев назад

something you didn't mention... I know should be obvious but I didn't get it... where do you put the svd model files after dl from hugging face? just normal models folder same as all the others for SD?