Тёмный

Make AMAZING AI Animation with AnimateLCM! // Civitai Vid2Vid Tutorial 

Civitai
Подписаться 14 тыс.
Просмотров 24 тыс.
50% 1

Опубликовано:

 

10 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 112   
@ProfessorLightWAV
@ProfessorLightWAV 6 месяцев назад
I tried it with Machine Delusions' new Animateddiff LCM model, and got the best results so far! Thank you soooo much!!! The IP adapter images really came through fabulously...
@meerar7651
@meerar7651 6 месяцев назад
This man need the best tutor award ❤❤
@civitai
@civitai 6 месяцев назад
Tyler here, much appreciated! Glad you enjoyed the video
@MrArtBOP
@MrArtBOP 6 месяцев назад
Thanks for sharing all that! 😊 Yeah, the curve might be steep, but I'm ready to climb it in several sessions starting from now! 💪"
@SkyOrtizCreative
@SkyOrtizCreative 6 месяцев назад
Fantastic Tutorial as always bro! Once again huge thanks for all of the hard work you and the crew pour into crafting the workflows and instructional share outs. The LCM is something I’ve been meaning to give some sessions to and BOOM here you are with another dialed in workflow. ⚡️⚡️⚡️
@yaahooali
@yaahooali 6 месяцев назад
Thank you, This is the best workflow you can make whatever ✌👌
@civitai
@civitai 6 месяцев назад
Glad you like it!!
@AtalantaHessbrueggen
@AtalantaHessbrueggen 6 месяцев назад
Thank you very much, I will give it a try myself. Keep up the good work!^^
@civitai
@civitai 6 месяцев назад
Thanks for watching!
@christophermoonlightproduction
@christophermoonlightproduction Месяц назад
Okay, I ended up having to do a clean install because my ComfyUI got messed up so bad while I was trying to solve all the errors I was getting. Inner Reflection's model links are out of date and coming up 404. Is there a place that has all of these resources in one place or at least clearly defined so I can get the right ones? I'm not well-versed enough to hunt for them. I tried but there are a lot of different files that are named the same thing and when I've tried to choose, I get errors. Thanks.
@jittthooce
@jittthooce 6 месяцев назад
Im getting the following error when I queue prompt: AnimateLCM_sd15_t2v_lora.safetensors' contains no temporal keys; it is not a valid motion LoRA anyone knows how to fix this?
@civitai
@civitai 6 месяцев назад
Do you have the model in your folder and have you re-selected it from the drop down menu or did you just run it as it was from initial download?
@jittthooce
@jittthooce 6 месяцев назад
@@civitai I have it in the lora folder, and have it re-selected.
@MannyGonzalez
@MannyGonzalez 6 месяцев назад
Same here... I am not sure it is a valid file... for now using a different V1 model (with errors but works) and likely the ones from AnimateDiff itself (like Pan, Tilt, Zoom etc) work. If you figure out how to fix the AnimateLCM Motion Lora error, let us know :D
@christophermoonlightproduction
@christophermoonlightproduction 24 дня назад
Same issue, among many others. I've been trying to get this flow to work for months now. Some of the download links have gone 404.
@sinner2002b
@sinner2002b 6 месяцев назад
Thanks! Just got it working! looks great!
@teealso
@teealso 6 месяцев назад
Appears the Lora is no longer available. Is there a suitable substitute?
@badmanden4602
@badmanden4602 6 месяцев назад
Hi guys! Why does my 10-second video end up being converted to a 1-minute video? There is a 1-minute replay. What should I set up?
@pk.9436
@pk.9436 6 месяцев назад
Great work, thank you pls keep going!
@civitai
@civitai 6 месяцев назад
Thanks for joining us!
@musyc1009
@musyc1009 6 месяцев назад
as always, great and detailed tutorial bro, one issue , i was unable to load the json file onto comfyui, there was no error or anything, just a blank screen, i've tried with different browsers but still couldn't load, but my other workflows loads just fine edited : solved, i found out why , it was indeed loaded, but because the nodes aren't set in the default center view, it was wayyyyyyy of to the right hand corner lol
@civitai
@civitai 6 месяцев назад
lol sorry about that XD
@musyc1009
@musyc1009 6 месяцев назад
@@civitai it’s alright , i laughed so hard lol
@todddyer6946
@todddyer6946 5 месяцев назад
Thank you for posting this note! I am a newb and didn't realize this so I was in the middle of rebuilding the flow from scratch block by block when I stumbled on this and scrolled out, and there it was down there to the right :) I was stuck on creating a separate height and width node for the very first block :)
@masoud.art.videos
@masoud.art.videos 4 месяца назад
Looks like one the key nodes is not longer supported. Efficiency Nodes for ComfyUI Version 2.0+: "This node is originally created by LucianoCirino, but the original repository is no longer maintained and has been forked by a new maintainer. To use the forked version, you should uninstall the original version and REINSTALL this one." Not sure what to do
@civitai
@civitai 4 месяца назад
There is an updated version of the workflow on the download page that should work :)
@jordanvanderwesthuizen4520
@jordanvanderwesthuizen4520 4 месяца назад
Hey, Great video, can't wait to put it into practice ! Just one question. Where do I put the Clip Vision Model for the IPAdapter ? Do I put it into ComfUI>models>IPadapter or do I out it in ComfUI>models>clip ? Thanks!
@civitai
@civitai 4 месяца назад
comfyui > models > clip_vision :)
@vaneses240
@vaneses240 6 месяцев назад
Anybody knows how to solve this error? T2IAdapter.__init__() missing 2 required positional arguments: 'compression_ratio' and 'upscale_algorithm
@christophermoonlightproduction
@christophermoonlightproduction 2 месяца назад
I'm still learning ComfyUI but when I downloaded this template and go to 17:38 I noticed that my PRE TEXT and APP TEXT boxes are missing and the manager didn't find them for me. Is there something simple I'm missing? Thanks.
@civitai
@civitai 2 месяца назад
You can actually just delete those noes now and ONLY use the green prompt box :)
@christophermoonlightproduction
@christophermoonlightproduction 2 месяца назад
@@civitai That's great news. Thank you. I'm learning by the seat of my pants so some of the instructions I follow are Greek to me until I get more familiar. I really appreciate this tutorial, though. I'm creating an animated movie with puppets, miniatures, and 3D models and I really want to have the characters be SD generated. This seems to be the magic bullet for it.
@christophermoonlightproduction
@christophermoonlightproduction 2 месяца назад
@@civitai But now I have to figure out why the Lora Stacker isn't seeing my models, even though the extra model paths do seem to be connected correctly. I'm the worst at this stuff but I'm determined.
@christophermoonlightproduction
@christophermoonlightproduction Месяц назад
Okay, I solved that problem, too. This is intense. I'm still going through each step to make sure I've got everything right before I've generated anything. I really want that face swaper to work. Cheers.
@ganandorf
@ganandorf 6 месяцев назад
Hi, I'm having a few dependencies issues, even after using install missing nodes in comfy manager. 1)I cant find the lcm >> sqrt_linear beta scheduler anywhere, is there a place i can download? 2) When i load the json file it says its missing depthanythingpreprocessor. I downloaded the depthanything file and placed it in my controlnet folder? In effect one of my nodes in the Depth Controlnet group of nodes is red. and finally 3) It says im missing ADE_loopedUniformContextOptions, which im guessing the ContextOptions Loop node? That is red for me in my workflow as well. Thanks for the help!
@civitai
@civitai 6 месяцев назад
Please make sure you update your comfy and all the comfy nodes via the Manager menu and try again :)
@fdn3435
@fdn3435 4 месяца назад
Hi on a 32 frame load cap it's rendering only a few frames in loop O_O Any advice?
@civitai
@civitai 3 месяца назад
32 frames is a very small amount, like exactly a second. You sure it's not correct?
@christophermoonlightproduction
@christophermoonlightproduction 17 дней назад
A month later and I still can't get this to work right.
@RenzGames
@RenzGames 6 месяцев назад
Weird I’m getting memory allocation error with a 4090 and over 10GB vram. Gonna try running less frames, but I wonder is it like WarpFusion where a common troubleshoot was to use less controlnets or prompts? I was only using 2 controlnets.
@civitai
@civitai 6 месяцев назад
It's the HiResFix. You will have to play with the scaling ratio number in that box for how much it upscales.
@Danixrg1
@Danixrg1 6 месяцев назад
When it's on the ksampler, it stays loading for a long time, could it be because the graphics card only has 8 vram?
@civitai
@civitai 6 месяцев назад
That is exactly why 🥲🥲🫠🫠🫣🫣
@DJTide
@DJTide 6 месяцев назад
Im getting this error even though I have the ckpt in the right folder. sd15_t2v_beta.ckpt is not a valid AnimateDiff motion module!
@civitai
@civitai 6 месяцев назад
That's the animateLCM motion model. You have to reselect it in your drop down menu and it should work! If you don't touch it, it's going to try to read my directory
@DJTide
@DJTide 6 месяцев назад
@@civitaidoh, I just realized I needed to update Comfyui LOL
@SathishKumar-bw1ic
@SathishKumar-bw1ic 6 месяцев назад
What is the recommended init video resolution? I am getting memory allocation error on 4060Ti 16GB for 44 sec video @ 360p resolution.
@civitai
@civitai 6 месяцев назад
Hmmmm, I use 512x896 but I have 24gb of vram. Try running less frames at your current resolution and see if you still get the same error. You may just have to break your runs up.
@ehsankholghi
@ehsankholghi 6 месяцев назад
it can happens because of main system ram not VRAM
@sirmeon1231
@sirmeon1231 2 месяца назад
This workflow should be running on 8GB of VRAM if you reduce it to one IPAdapter and one controlnet, most likely not the gif one.
@crashdummyglory
@crashdummyglory 5 месяцев назад
maybe link to the full resolution output video? just the video.
@DJTide
@DJTide 6 месяцев назад
The only way i got reactor to actually start working was to reinstall everything. Took me a few tries but it finally worked 😅
@civitai
@civitai 6 месяцев назад
Glad to hear it!
@user-uo6hn7vr5r
@user-uo6hn7vr5r 6 месяцев назад
I try to add a remove baground node, but cannot make it work. i think it could be a great add to your workflow ! Just one question , how do i desactivate the upscaler ? thanks !
@civitai
@civitai 6 месяцев назад
Just right click on the upscale node and click bypass :)
@IC_Pirate
@IC_Pirate 6 месяцев назад
Is this the chapter #4 of the beguinners guide? I dont think you have explained how to install comfyUI yet, and I think that comfy UI is a more advances technique than A1111? Please correct me if Im wrong. Thanks a lot for all the videos on your channel Im learning a lot :D
@civitai
@civitai 6 месяцев назад
This is a small intermission, part 4 will be uploaded in the next few days. If it's a part of the series it will be in the play list. We're not going into the install for Comfy because it's not beginner friendly. Easy Diffusion and Automatic will be the topics for that beginner series for now :)
@IC_Pirate
@IC_Pirate 6 месяцев назад
@@civitai Thanks so much, looking forward for the next begginer video 😊.
@razikhan998
@razikhan998 6 месяцев назад
Hi great work thanks for your tutorials, i am having an issue when i drag and drop the json file nothing appears and giving me an error of depth anything pre processors and ADE_LoopedUniformContextOptions node missing error
@civitai
@civitai 6 месяцев назад
When you land it in, zoom out. The node tree is elsewhere on the screen, sorry about that XD For those nodes, make sure you install the missing nodes in the Comfy manager or Install AnimateDiff Evolved
@ehsankholghi
@ehsankholghi 6 месяцев назад
which photo of ip adaptor can effect background? and which one effecting character?
@civitai
@civitai 6 месяцев назад
You just have to load two for character and two for background. Doesn't matter which two. But you have to tell the prompt what it's looking at
@MisterCozyMelodies
@MisterCozyMelodies 4 месяца назад
i couldn`t download the workflow, just found a photo
@civitai
@civitai 4 месяца назад
The PNG is the workflow! Just drop the PNG into your ComfyUI workspace and it will load!
@MisterCozyMelodies
@MisterCozyMelodies 4 месяца назад
@@civitai wow, didn`t know, thanks
@MrArtBOP
@MrArtBOP 6 месяцев назад
Is anyone having trouble with installing ReActorFaceSwap? It keeps giving me an error: (IMPORT FAILED) ReActor Node for ComfyUI.
@civitai
@civitai 6 месяцев назад
This is an error some people get that I don't know how to solve unfortunately as I didn't experience it. Hopefully someone can help you out! If not, I'd suggest just scraping the node or disabling the group
@gearonimo75
@gearonimo75 6 месяцев назад
yes, I'm experiencing the same problem@@civitai
@todddyer6946
@todddyer6946 5 месяцев назад
I am getting this same error as well. I had to disable it
@JefHarrisnation
@JefHarrisnation 6 месяцев назад
I watched this so many times! What a great help. I'm new to Comfy and the road has been rocky. I had one question. Is there a way to generate video that doesn't loop?
@civitai
@civitai 6 месяцев назад
AnimateDiff by nature tries to loop. I believe you can change this setting in one of you AnimateDiff nodes
@MauricioRoss
@MauricioRoss 6 месяцев назад
What is the best configuration to set up a pc for this?
@civitai
@civitai 6 месяцев назад
12GB of VRAM is definitely recommended.
@SZERMANFILMS
@SZERMANFILMS 6 месяцев назад
Hello and thank you for your great work. 😃 Is there a possibility of making video with Automatic1111 or is it possible just with Comfy ui? Thank you for your answers.
@civitai
@civitai 6 месяцев назад
It’s possible by using Deforum and different iterations of AnimateDiff in Automatic1111. Truth is though, the best quality renders for animations will most likely come out of ComfyUI at this point due to it’s flexibility and customizable nature 🙏🏽🙏🏽
@SZERMANFILMS
@SZERMANFILMS 6 месяцев назад
@@civitai Thanks 🙏
@lukeofflamenco
@lukeofflamenco 6 месяцев назад
Is this workflow possible if you only have 8GB of Vram?
@civitai
@civitai 6 месяцев назад
Sorry to say, probably not. You could try it with only using a single control net and the highresfix disabled. But no promises :(
@lukeofflamenco
@lukeofflamenco 6 месяцев назад
@@civitai I’ll try thanks
@ComptonArse
@ComptonArse 6 месяцев назад
The link for clip vision model is broken
@civitai
@civitai 6 месяцев назад
Hey! So sorry about that, the entire link didn’t paste! Just fixed it 🙏🏽🙏🏽🫵🏽🫵🏽🫶🏽🫶🏽
@GadrielDemartinos
@GadrielDemartinos 6 месяцев назад
FYI: the landing page of the Clip Vision Model for the IPAdapter link is a 404 Page Not Found.
@civitai
@civitai 6 месяцев назад
I actually just updated the link not too long ago! Please try again 🙏🏽
@MannyGonzalez
@MannyGonzalez 6 месяцев назад
...also, I think it's ALT + DRAG to copy and move a node, not CTRL+Drag
@civitai
@civitai 6 месяцев назад
Sorry, Mac keyboard >_
@AI-Wire
@AI-Wire 6 месяцев назад
Excellent work. Is there a Python code version of this? Code only, with NO GUI?
@civitai
@civitai 6 месяцев назад
There is an AnimateDiff CLI but it's kind of fell to the wayside because of how quickly people create and iterate on the Nodes
@AI-Wire
@AI-Wire 6 месяцев назад
@@civitai Ah, I see. Then what is the best way to automate AI video creation using code only with no GUI?
@kasramohajery4623
@kasramohajery4623 6 месяцев назад
anyone been able to run this workflow with 8GB of vram?
@civitai
@civitai 6 месяцев назад
This workflow seems to make out at around 13.5 GB of VRAM
@razikhan998
@razikhan998 6 месяцев назад
depth anything preprocessor error
@civitai
@civitai 6 месяцев назад
Comfy environment updated?
@kanall103
@kanall103 6 месяцев назад
Someone said that AI gonna to take jobs....not yet... lol
@Ziov1
@Ziov1 6 месяцев назад
the workflow is broken, nodes are not connected
@jboogx.creative
@jboogx.creative 6 месяцев назад
I just went to my profile and downloaded the exact file I uploaded and dragged the json into the ComyUI window to see if it was indeed broken. Everything was connected and everything worked right from the jump. Also no one else has experienced this. I'd suggest installing whatever nodes you're missing or trying again.
@civitai
@civitai 6 месяцев назад
We confirmed as well, the workflow as it's downloadable on the website, works once you drag the json into Comfy and install any missing Nodes via the Manager. If ReActor isn't working for you, just delete that node group as per the tutorial.
@clementsaunier6311
@clementsaunier6311 6 месяцев назад
@@civitai I confirm all is ok with the file
@Ziov1
@Ziov1 6 месяцев назад
Maybe it's my comfyui tried it a few times with same issue, thanks for reply.
@ProfessorLightWAV
@ProfessorLightWAV 6 месяцев назад
@@civitai Amazing workflow, and thank you, but on my computer i had to re-connect the bottom (4th) "Prepare Image for Clip Vision node" to its corresponding "Load Image" node.
@olivierv1993
@olivierv1993 5 месяцев назад
Show me your Loras, I will tell you who you are !
@kanall103
@kanall103 6 месяцев назад
you can image we do all this shit and the end get a crap results
@stupidangrysergal6146
@stupidangrysergal6146 6 месяцев назад
* throwing my pc throug the window coz comfy ui doesent look any comfy*
@MannyGonzalez
@MannyGonzalez 6 месяцев назад
Thank you for this tutorial. Learned a lot. Having a problem with the motion LoRA from LCM Hugging Face ... ComfyUI says it is NOT a valid Motion LoRA :( """ ValueError: 'AnimateLCM_sd15_t2v_lora.safetensors' contains no temporal keys; it is not a valid motion LoRA! """" Any ideas? It works if I use a V1 motion lora (with errors but it still goes though) Thanks again
@civitai
@civitai 6 месяцев назад
Hmmm not sure, maybe try reinstalling and just make sure it's the correct motion module. The LCM lora is used as a regular Lora. Not a motion Lora :)
@joonienyc
@joonienyc 2 месяца назад
u may just have to select lcm lora from ur folder if u have it , if not , download it
@todddyer6946
@todddyer6946 5 месяцев назад
So, I am struggling to get this totally working. I make it to about 65% green bar, and it errors out. Seeing problems with the IP Adaptor; here is my error code text: Error occurred when executing IPAdapterApplyEncoded: InsightFace must be provided for FaceID models. File "C:\AI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\AI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\AI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\AI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 698, in apply_ipadapter raise Exception('InsightFace must be provided for FaceID models.') Anyone have any ideas or get a similar error? Thanks!
@todddyer6946
@todddyer6946 5 месяцев назад
ok, so I am a dummy.. I did not have the right IDAdaptor bin file. Updated that, and now I am making it to 90% green bar and crapping out at section 6 KSampler / Hi res fix section with this error: File "C:\AI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch n\modules\module.py", line 1511, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\AI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch n\modules\module.py", line 1520, in _call_impl return forward_call(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\AI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\comfy\cldm\cldm.py", line 295, in forward assert y.shape[0] == x.shape[0] ^^^^^^^ AttributeError: 'NoneType' object has no attribute 'shape'
@joonienyc
@joonienyc 2 месяца назад
@@todddyer6946 check torch see if any models or lcm models not insert correctly , go over thro the video , u may find some small part that missed read , if u fixed it , should works fine
Далее
Civitai Beginners Guide To AI Art // #1 Core Concepts
11:29
Cute
00:16
Просмотров 3,7 млн
CONSISTENT VID2VID WITH ANIMATEDIFF AND COMFYUI
20:10
CIVITAI STATE OF THE UNION
58:35
Просмотров 254
Animations with IPAdapter and ComfyUI
16:07
Просмотров 35 тыс.
NEW AnimateAnyone LOCALLY. MIND BLOWN!
13:36
Просмотров 56 тыс.
Animation with weight scheduling and IPAdapter
20:50
Просмотров 32 тыс.
Cute
00:16
Просмотров 3,7 млн