Тёмный

New Image2Video. Stable Video Diffusion 1.1 Tutorial. 

Sebastian Kamph
Подписаться 145 тыс.
Просмотров 58 тыс.
50% 1

SVD 1.1 Tutorial in ComfyUI. How to easily create video from an image through image2video.
Detailed text & image guide for Patreon subscribers here: / turn-with-svd-1-98390700
Download SVD model here huggingface.co/stabilityai/st...
Basic ComfyUI Workflow comfyanonymous.github.io/Comf...
How to install ComfyUI • How to install and use...
Prompt styles for Stable diffusion a1111, Comfy & Vlad/SD.Next: / sebs-hilis-79649068
Get early access to videos and help me, support me on Patreon / sebastiankamph
Chat with me in our community discord: / discord
My Weekly AI Art Challenges • Let's AI Paint - Weekl...
My Stable diffusion workflow to Perfect Images • Revealing my Workflow ...
ControlNet tutorial and install guide • NEW ControlNet for Sta...
Famous Scenes Remade by ControlNet AI • Famous Scenes Remade b...

Хобби

Опубликовано:

 

12 фев 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 117   
@sebastiankamph
@sebastiankamph 5 месяцев назад
Detailed text & image guide for Patreon subscribers here: www.patreon.com/posts/turn-with-svd-1-98390700
@electronicmusicartcollective
@electronicmusicartcollective 5 месяцев назад
pls add the Forge URL, peace
@nemesisone8927
@nemesisone8927 Месяц назад
i wonder if we will be able to select an area that moves in a direction instead of the whole image moving like a camera, this way i could make water move for 4 seconds and dump it into video AI and slow the image down and increase the frames per second and also pump it up to HD cool thing with Video AI is that it fills in the gaps in turn you get longer videos smooth and in slowmotion.
@ShocktorGaming
@ShocktorGaming 5 месяцев назад
Excellent video - I will have to try this out tonight!
@adrianmunevar654
@adrianmunevar654 5 месяцев назад
And today came Sora and boom! 💥 Let's see what the SD team and the others do. Let the competition increase for our benefit 💪🏻😅
@N3_r
@N3_r 5 месяцев назад
😂😂😂
@kaiz0099
@kaiz0099 5 месяцев назад
Great stuff, more ruined fooocus tutorials please. Im also in love with it
@sebastiankamph
@sebastiankamph 5 месяцев назад
I do like it, but there's not a lot to cover on it :D
@ken-cheenshang6829
@ken-cheenshang6829 4 месяца назад
thanks for sharing!!!
@sn0wbr33z3
@sn0wbr33z3 5 месяцев назад
Waiting for someone to train commercially free models
@user-hy1rz9og1d
@user-hy1rz9og1d 5 месяцев назад
As a Newbie in this space may I ask what’s the downpoint of this? I mean that you can’t sell your videos made using their model right? Or there’s more in their strictly agreement?
@ijayraj
@ijayraj 5 месяцев назад
My work flow is not similar as him, do you have the same or different, althought i've perfectly installed everything but still having errors, what can i do in this ?
@Avalon19511
@Avalon19511 5 месяцев назад
What I have noticed about all these image2vid is the length seems to be the problem without having to do any editing, I think I'll wait to mess with these when the length is no longer a issue
@Lv7-L30N
@Lv7-L30N 5 месяцев назад
Thank you
@sebastiankamph
@sebastiankamph 5 месяцев назад
You're welcome!
@JefHarrisnation
@JefHarrisnation 5 месяцев назад
Thanks for this. Question. In the Manager I see you have a process running view, is that a plug in?
@sebastiankamph
@sebastiankamph 5 месяцев назад
Crystools! Made a video on it
@Maltebyte2
@Maltebyte2 5 месяцев назад
Atm is it only capable of outputting a 1sec clip?
@screamingstarprime3503
@screamingstarprime3503 5 месяцев назад
I’m having fun with it. Stumbled upon a trick to use LCM acceleration too. So far, just boils down to seed luck
@HistoryIsAbsurd
@HistoryIsAbsurd 5 месяцев назад
Okay i thought i was crazy lol I had gotten this working one day too but was dumb and lost the JSON file for it and never could get it working again
@ijayraj
@ijayraj 5 месяцев назад
I can't find the files to Download could you please let me know where is it ?
@lorenzo_susca
@lorenzo_susca 4 месяца назад
All very clear, except one thing, in what menu is the node "Video Combine"?
@sebastiankamph
@sebastiankamph 3 месяца назад
VHS - Video helper suite. Custom node.
@rezahasny9036
@rezahasny9036 5 месяцев назад
hello sir, can you give me the tutor how to creat video combine node on there ?
@lilillllii246
@lilillllii246 4 месяца назад
Thank you. Text prompt is not possible?
@pefisplace8483
@pefisplace8483 Месяц назад
Could someone explaine me, why i don´t have the "video combine" I mean the last Window where I can see the clip?? Thx for help
@AlexandrePorto
@AlexandrePorto 3 месяца назад
Can you write text prompts for the videos? And can you extend the videos from the last frame and concatenate?
@sebastiankamph
@sebastiankamph 3 месяца назад
Not by default in SVD. I have seen some workflows that expand on svd with prompting but then it's just running the output with denoising.
@user-pw7ko2jd4j
@user-pw7ko2jd4j 5 месяцев назад
Could you please do a tutorial for automatic1111?
@fluffycatmedia
@fluffycatmedia 5 месяцев назад
if doing this in A1111 - which file would i put the following to work with low vram? pipe.enable_model_cpu_offload() pipe.unet.enable_forward_chunking() frames = pipe(image, decode_chunk_size=2, generator=generator, num_frames=25).frames[0]
@sebastiankamph
@sebastiankamph 5 месяцев назад
What do you mean?
@ijayraj
@ijayraj 5 месяцев назад
bro i'm havign eror but don't know coding could you pleaes help me.
@IlluminatedPathways-s8t
@IlluminatedPathways-s8t Месяц назад
the workflow you show in this video is completly different from the workflow downloadable from the video description. i have managed to install the one in the description but it does not behave anywher like the one you use in this video
@holly11111111
@holly11111111 3 месяца назад
love it! one question, I like how it moves my animation but the faces are distorted, What parameters can I change or play?
@sebastiankamph
@sebastiankamph 3 месяца назад
For SVD, none. You'd need a much more advanced workflow that re-renders the faces. It's all about rendering lots and being lucky.
@Deminii
@Deminii 5 месяцев назад
can u tell name of extension this info system workin at queue prompt and loading % generation?
@amnzk08
@amnzk08 5 месяцев назад
Yeah would like to know too!
@aNgiesSchlauNg
@aNgiesSchlauNg Месяц назад
it takes like 10 minutes to generate the video. Is my computer just old and slow? PC is about 5 years old now.
@felixrosbjo
@felixrosbjo 7 дней назад
Does this work with automatic1111?
@justanothernobody7142
@justanothernobody7142 5 месяцев назад
Does anyone know what the VRAM requirements are for these models?
@ijayraj
@ijayraj 5 месяцев назад
mnimum 4 gb
@justanothernobody7142
@justanothernobody7142 5 месяцев назад
@@ijayraj Ok thanks. I read somewhere that it was 8, 4 seems a bit low to me. I have a 2070 so I have 8 anyway so will give it a go at some point.
@ijayraj
@ijayraj 5 месяцев назад
@@justanothernobody7142 sure good luck bro
@bladechild2449
@bladechild2449 5 месяцев назад
comfy hasn't worked for half a year for me and I kinda gave up on it. just super finicky to get any and all of its many parts working in tandem. I kinda hope a lot of this stuff comes to fooocus. Just soooo much easier.
@sebastiankamph
@sebastiankamph 5 месяцев назад
I understand that fully!
@ijayraj
@ijayraj 5 месяцев назад
My work flow is not similar as him, do you have the same or different, althought i've perfectly installed everything but still having errors, what can i do in this ?
@benharris144
@benharris144 5 месяцев назад
Love your videos sebastian - Always to the point and thoroughly explained. Do you have any plans to cover the Forge WebUI?
@sebastiankamph
@sebastiankamph 5 месяцев назад
Thank you! I just might. What do you think about it?
@benharris144
@benharris144 5 месяцев назад
For me personally, the speed at which it generates SDXL images on my 2080 is so much faster than in a1111. Aside from that, I'm pretty new to all this and am still trying to figure out how to install it so it works with all my existing checkpoints/LoRas.@@sebastiankamph
@ijayraj
@ijayraj 5 месяцев назад
My work flow is not similar as him, do you have the same or different, althought i've perfectly installed everything but still having errors, what can i do in this ?
@DiwaSelvendran
@DiwaSelvendran 5 месяцев назад
Can you make an video AMD installation of SD
@sebastiankamph
@sebastiankamph 5 месяцев назад
I don't have an amd card, and I don't want to fake it :D
@Avalon19511
@Avalon19511 Месяц назад
Silly question but how do you save the video?
@chucknorris8704
@chucknorris8704 5 месяцев назад
Can this be used with A1111 locally???
@alsoeris
@alsoeris 5 месяцев назад
yes
@adrianfels2985
@adrianfels2985 Месяц назад
Am I right with the assumption that you have 0 control over the camera movement? The workflow simply decides what the "camera" has to do by analyzing the input?
@AISign-Lookbook
@AISign-Lookbook 5 месяцев назад
can we use prompt for change?
@sebastiankamph
@sebastiankamph 5 месяцев назад
Sadly not with this.
@uncleben2019
@uncleben2019 5 месяцев назад
I’m guessing you can do text-to-image and then chain that to this workflow to achieve something similar. But yeah it’s just Image to Video for now.
@piechcik52
@piechcik52 5 месяцев назад
Is possible to make longer video?? ~10 seconds
@twilightfilms9436
@twilightfilms9436 5 месяцев назад
Sebastian, have you tried to replicate the image enhancement of Krea or Magnific? I spoke with the CEO of Magnific and he told me they have SDXL running under the hood…..I was just curious to know why no one has ever tried to do it……anyways, thanks for the video!
@sebastiankamph
@sebastiankamph 5 месяцев назад
What you mean is they are replicating image enhancements of stable diffusion ;). It's just SD in a marketing package. No magic.
@ijayraj
@ijayraj 5 месяцев назад
My work flow is not similar as him, do you have the same or different, althought i've perfectly installed everything but still having errors, what can i do in this ?
@inLofiLife
@inLofiLife 2 месяца назад
can I use this for commercials? on yt?
@sebastiankamph
@sebastiankamph 2 месяца назад
Go for it
@ThaMoonwalkerFSDBetaChannel
@ThaMoonwalkerFSDBetaChannel 5 месяцев назад
So i can use this to bring my images to life?
@sebastiankamph
@sebastiankamph 5 месяцев назад
Pretty much
@nikgrid
@nikgrid 5 месяцев назад
@sebastiankamph I've been messing about with Forge...it is FAST. Look forward to your video mate.
@sebastiankamph
@sebastiankamph 5 месяцев назад
Great tip! Also, hi again
@97BuckeyeGuy
@97BuckeyeGuy 5 месяцев назад
I hate it when an "upgrade" isn't a clear upgrade. Thank you.
@unklecualt267
@unklecualt267 8 дней назад
Hey, total noob question. How can you get ComfyUI to run multiple workflows in the queue?
@MVPWendi
@MVPWendi 2 дня назад
Just copy one to another and create super-multi-workflow
@CVSiN
@CVSiN 5 месяцев назад
Doesnt work well at all for me.. used your defaults and I get a model that looks deformed in animation..
@jimhowkings1974
@jimhowkings1974 5 месяцев назад
hi. is there a way to tell it what we want ? or control the animation in any way?
@aegisgfx
@aegisgfx 5 месяцев назад
No and thats the main problem, at this rate it'll be years before anyone has any fine level of control over what comes out of text to video. To me it looks like this tech is pretty much dead on arrival, and I dont see it getting better anytime soon.
@Wobbothe3rd
@Wobbothe3rd 5 месяцев назад
​@aegisgfx it will improve at a rapid pace just like all the other AI tech.
@aegisgfx
@aegisgfx 5 месяцев назад
@@Wobbothe3rd ya Ive been waiting for that, seen no improvements so far
@Voltisvoltis
@Voltisvoltis 2 месяца назад
@@aegisgfx And then Sora, Vidu and Google's video model got announced.
@ArcaneRealities
@ArcaneRealities 5 месяцев назад
while the hamburger did look good it wasn't realistic to the scene unless u where spinning the camera and the hamburger was on a spinning plate - its to bad they can't give us access to a keyword system to control motions for foreground and background - seems like if they did simulations on the results by injecting words into the mix they could find the nodal points that generate consistent action within the results
@VIpown3d
@VIpown3d 5 месяцев назад
AI videos are awesome and absolutely frightening. My god how far they've come
@sebastiankamph
@sebastiankamph 5 месяцев назад
Getting better each new version, just like in the early days of image generation :)
@kaareej
@kaareej 3 месяца назад
I did not see where you put the prompts.
@sebastiankamph
@sebastiankamph 3 месяца назад
There are no prompts for svd
@arsenaliverdiiev1546
@arsenaliverdiiev1546 5 дней назад
hi Sebastian! can you please tell why can I not join your Patreon...I get this message: You can't join this creator's membership. I would pay but I am not allowed to
@sebastiankamph
@sebastiankamph 2 дня назад
Hi, I'm sorry I don't know. Patreon has their own system which I can't control at all
@nadrantalhaalhady1747
@nadrantalhaalhady1747 5 месяцев назад
What is sowtware name?
@arothmanmusic
@arothmanmusic 5 месяцев назад
He's showing Stable Diffusion in ComfyUI.
@Elwaves2925
@Elwaves2925 5 месяцев назад
To be accurate it's Stable Video Diffusion 1.1
@FlyingLotus
@FlyingLotus 5 месяцев назад
nice ! is this possible with automatic1111?
@sebastiankamph
@sebastiankamph 5 месяцев назад
No, but Forge!
@CamiloMonsalve
@CamiloMonsalve 3 месяца назад
Sorry, but I'm having this error: Error occurred when executing LoadImage: cannot identify image file 'H:\\ComfyUI\\ComfyUI_windows_portable\\ComfyUI\\input\\image_sample_1024x576_V01.png' File "H:\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "H:\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "H:\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "H:\ComfyUI\ComfyUI_windows_portable\ComfyUI odes.py", line 1459, in load_image img = Image.open(image_path) ^^^^^^^^^^^^^^^^^^^^^^ File "H:\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\PIL\Image.py", line 3339, in open raise UnidentifiedImageError(msg)
@nicoli3143
@nicoli3143 5 месяцев назад
It's already good enough to replace entire production teams for commercials...
@ijayraj
@ijayraj 5 месяцев назад
My work flow is not similar as him, do you have the same or different, althought i've perfectly installed everything but still having errors, what can i do in this ?
@Ollegruss_Music
@Ollegruss_Music 2 месяца назад
Фэнкс!
@meadow-maker
@meadow-maker 5 месяцев назад
and did you know the the 'gullible' isn't even in the Oxford English Dictionary? 🤣
@aegisgfx
@aegisgfx 5 месяцев назад
The pace of text to video tech has been really slow compared the text to image stuff. I have to say all the txt-video solutions I have seen are incredibly unremarkable, especially compared to the txt-image models which are all phenomenal. Unless the ball gets rolling on txt-video pretty fast, Im calling this technology dead on arrival.
@bladechild2449
@bladechild2449 5 месяцев назад
Image stuff that isn't the new dall e 3 / GPT tech has been practically stale for a year now. Nothing really has improved, and with the release of SDXL it took a bit of a hit because training your own loras and shit for it is as big a pain as it was in the early days of training for SD 1.5
@sebastiankamph
@sebastiankamph 5 месяцев назад
Slower, yes. And video consistency is also much harder to achieve than a still image. Looking back a year from now, I'm sure the comparison will be breathtaking :)
@Bentler
@Bentler 3 месяца назад
​@bladechild2449 I thought it was just me. I took a break for a year and came back and I have been struggling to find anything thats really new.. 2022-early23 was moving so fast.
@luman1109
@luman1109 5 месяцев назад
It's still not great
@robertgoldbornatyout
@robertgoldbornatyout 5 месяцев назад
Hi Sebastan very helpfull upload thanks, but please when are you going to do a help vid all about the new Forge UI - 75% faster than Automatic 1111, and also will the new Forge work on AMD gpus all other useless youtube uploaders seem to all forget about all us, usesers, who don't wont to spend or can not spend lots of money on new hardware just to test out for example the new forge, hope you understand thanks, your channel has always been the best for all my AI Stable Diffusion help thanks, 💯💯💯👍👍👍
@sebastiankamph
@sebastiankamph 5 месяцев назад
Good suggestion! And thank you :)
@robertgoldbornatyout
@robertgoldbornatyout 5 месяцев назад
Thanks Sebastian you're the one who got me into A.I. art But A1111 is still a bit slow on my AMD, would be fantastic for all us penny less AMD users if we all could start using Forge. @@sebastiankamph
@ijayraj
@ijayraj 5 месяцев назад
My work flow is not similar as him, do you have the same or different, althought i've perfectly installed everything but still having errors, what can i do in this ?
@KardinalMoses
@KardinalMoses 5 месяцев назад
I'm the 666th person to have liked this video :D may it bring you luck
@angloland4539
@angloland4539 20 дней назад
@ijayraj
@ijayraj 5 месяцев назад
Great info man, thanks for keeping us upated about new stuffm i followed the whole video but still getting this erroe This one in command prompt """ 0%| | 0/20 [00:02
@sebastiankamph
@sebastiankamph 5 месяцев назад
You don't have enough video/gpu memory. It says out of memory there sadly.
@ijayraj
@ijayraj 5 месяцев назад
@@sebastiankamph I've 4 GB RTX 3050, can't we solve this error?
@ijayraj
@ijayraj 5 месяцев назад
@@sebastiankamph i wants to use this feature 😔
@sebastiankamph
@sebastiankamph 5 месяцев назад
You can use a cloud solution like Thinkdiffusion.com@@ijayraj
@ijayraj
@ijayraj 5 месяцев назад
@@sebastiankamph will try it, thanks man, thanks you very much for the support.
Далее
How to install New StableSwarm Beta.
10:18
Просмотров 47 тыс.
Stable Diffusion 3 IS FINALLY HERE!
16:08
Просмотров 75 тыс.
I'm Excited To see If Kelly Can Meet This Challenge!
00:16
Image2Video. Stable Video Diffusion Tutorial.
12:24
Просмотров 53 тыс.
STABLE VIDEO DIFFUSION | COMFYUI
5:23
Просмотров 42 тыс.
ComfyUI - Best way to convert image to video
9:16
Просмотров 1,7 тыс.
STABLE DIFFUSION 3 NEW LICENSING!
8:27
Просмотров 19 тыс.
How to AI Upscale and Restore images with Supir.
16:31
Будни в пекарне. Часть 7
0:48
Просмотров 2,2 млн
Small Act of Kindness is also a charity
1:00
Просмотров 46 млн
МОЖЕТ ЛИ УКУСИТЬ СОБАКА
0:14
Просмотров 4,1 млн
гороховый СУП
0:57
Просмотров 2,9 млн