Mastering Video to Video in ComfyUI's Stable Diffusion (Without Node Skills)

Подписаться 2,4 тыс.

Просмотров 8 тыс.

50% 1

Creating incredible GIF animations is possible with AnimateDiff and Controlnet in comfyUi. Unleash your creativity by learning how to use this powerful tool without any node difficulties for stable diffusion.
Workflow: drive.google.com/file/d/1JYYf...
Hugging Face Controlnet Models: huggingface.co/lllyasviel/Con...
Huggingface Animatediff Models: huggingface.co/guoyww/animate...
Checkpoint Model: civitai.com/models/134442/hel...
Covert timecode to keyframes: www.omnicalculator.com/other/...
How to make AI animations Stable Diffusion: • Automatic1111 Animated...
(c0nsumption) ControlNets and Video to Video: • ComfyUI AnimateDiff Pr...
Free Projects Source files: goshnii.gumroad.com/
See more familiar ComfyUI Tutorials: • ComfyUI Tutorials / An...

Хобби

Опубликовано:

22 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 68

@budygang9918 4 месяца назад

Insane! Thanks to share your knowledge 🙏🏻

@goshniiAI 4 месяца назад

Thank you for the kind words

@IS-dq4fw 23 дня назад

Thank you so much for the tutorial! I thought it would take me weeks to figure this out. I wish you good luck in everything!

@goshniiAI 23 дня назад

pleasure I could assist you, glad to hear from you.

@samon29 4 месяца назад

Thank you very much for your workflow

@goshniiAI 4 месяца назад

It's very nice of you.

@zhiwei999 5 месяцев назад

Thank you very much for your workflow and careful explanation, I decided to give it a try

@goshniiAI 5 месяцев назад

I'm glad that you found the process and explanation to be helpful. You are very welcome!

@Dwoz_Bgmi 4 месяца назад

thanks man you explained very well , i was so confused

@goshniiAI 4 месяца назад

Thank you for the Feedback, I'm glad you found this helpful!

@user-ug4ss9hr8l 10 дней назад

thanks very much

@goshniiAI 10 дней назад

You are most welcome.

@harithagamagedara5893 4 месяца назад

Thank you so much for the content. Is there any way to change the theme of the video without changing the appearance of the face.

@goshniiAI 4 месяца назад

You are most welcome. You can set themes for your video using the Batch Prompt node. Similar to the Prompt Travel Technique, you can include multiple frame numbers + the prompt to modify your themes, but you might expirience subtle changes in background elements.

@itssannabelle 4 месяца назад

Hey is it OK if I don't have the weight and hight node in comfyu .when I put the workflow they were missing?

@goshniiAI 4 месяца назад

Before generating the video, I recommend manually adding the missing nodes to ensure that the video size is correct. Also, make sure to update both comfyUI and all updates. I hope any of these are helpful

@i_free_man 13 дней назад

Hi, thank you for your tutorial! Everything is clear, but I have an error with Ksampler. Can you help me with that?

@goshniiAI 13 дней назад

I'm glad you found the tutorial helpful. The error could be due to memory constraints. Try reducing the batch size or image resolution to see if that helps. Also, you can make sure make, you have the latest version of ComfyUI and all the necessary nodes updated.

@bubblerlek 13 дней назад

Thank you so much! Sorry I'm new to the comfy ui, for some reason my generation stops at animate diff node. It is green and then it stops.

@goshniiAI 13 дней назад

you are most welcome, we all start some where. First, try checking your VRAM usage to ensure you have enough memory. If that's not the issue, double-check your node connections and settings to make sure everything is set up correctly. Sometimes, simply reloading the workflow or restarting ComfyUI can help too.

@logman121 4 месяца назад

Great explanation. Only the workflow link is not valid anymore. Could you please reuploud your workflow. Thanks a lot!

@goshniiAI 4 месяца назад

Thank you for your feedback, the link has been modified in the description.

@logman121 4 месяца назад

Great, thanks for quick response@@goshniiAI

@lilillllii246 4 месяца назад

Thanks. I ran it, but I keep getting this message "Error occurred when executing LoadImage". What should I do?

@goshniiAI 4 месяца назад

You are welcome. So various reasons like incorrect file path, Video format or memory limitations can cause the Error. First, double-check the file path and confirm that the video format is supported. Also, try resizing or reducing the video's resolution to see if that helps with memory limitations. Most importantly, ensure that there are no broken spline connections to any of the nodes. I hope any of these are helpful.

@discountcode341 3 месяца назад

What to do , if there are red lines around a node, it appeared after I qued the prompt?

@goshniiAI 3 месяца назад

It reveals that you haven't connected the node correctly or that the proper settings are not present. Please review the settings and connections you have to that specific node.

@ADELTUF 2 месяца назад

do you have a tutorial about how to train stable diffusion to generate similar videos to the video you give it as a source? TY

@goshniiAI 2 месяца назад

hello there,I do not currently have a tutorial, but I appreciate the question. It's certainly a topic worth exploring in future content.

@ADELTUF 2 месяца назад

@@goshniiAI yes thats atopic that i still cant find how to jump into, i see people generating realistic videos, so its likely possible to feed the AI with alot of videos and make it cook similar videos just by changing the prompt.

@Dwoz_Bgmi 4 месяца назад

hey please help ! lineart model is not showing in the link

@goshniiAI 4 месяца назад

Thank you for your observation; the link has been updated. Make use of safetensor version.

@YOUTUBECOUSPOLICY 2 месяца назад

i have a core i7 3770 16gb ram and gt 1030 will this work on my system if not which gpu is mini required for using comfy ui🙂

@goshniiAI 2 месяца назад

Your setup should handle Comfy UI, but for smoother performance, particularly with larger projects, I'd consider upgrading your GPU to something like an NVIDIA GTX 1660 or higher this would improve performance. I hope this helps!

@nirdeshshrestha9056 4 месяца назад

Hey man how to load a lora in this workflow?

@goshniiAI 4 месяца назад

This example shows you how to use Lora as a guide. comfyanonymous.github.io/ComfyUI_examples/lora/

@premnathrajendran1364 4 месяца назад

may i know rendering time and requirement spec

@goshniiAI 4 месяца назад

Using an NVIDIA RTX 3060, The rendering took a few hours.

@Dwoz_Bgmi 4 месяца назад

Hey one more problem, i have gtx 1650 graphics card its not enough for this , my process is stucked from 1 hour on 0% , please help me how to load image's in batch , like this tutorial have video tab but its not enough for my pc , so How to add image batch loader node

@goshniiAI 4 месяца назад

If your GPU isn't quite up to the task, consider splitting the workload into smaller batches. This prevents your GPU from being overwhelmed. If you are unsure how to do this, I am certain you might be able to find a resourceful tutorial online to guide you.

@Dwoz_Bgmi 4 месяца назад

@@goshniiAImy gpu creates image to image in 30 seconds maximum, I can manage differently, but I didn't found how to image batch process in comfy ui , many people doing that in tutorial but not showing it how to add that image batch loader Node

@goshniiAI 4 месяца назад

@@Dwoz_Bgmi I fully understand and agree, and I'll keep that in mind for next videos.

@Dwoz_Bgmi 4 месяца назад

@@goshniiAI thanks, im waiting no one made video on image to image batch so it's better topic for next video

@androsandros5849 22 дня назад

When loading the graph, the following node types were not found: ttN text

@goshniiAI 22 дня назад

Hello there, The "ttN text" node might be from a custom node library or an update that you might not have installed yet.

@konradschoeller6213 17 дней назад

This node actually creates errors after installation "import failed". Even with "git clone", same result.

@goshniiAI 17 дней назад

Thanks for bringing this up! There are situations when nodes or modules may not work well together. updating ComfyUI and the nodes to their most recent versions can resolve the problem.

@konradschoeller6213 16 дней назад

@@goshniiAI It did actually. The problem was solved by updating ComfyUI and all extensions. The ttn doesn't have a requirements-file for calling the command " pip install -r requirements.txt", so updating the entire repository was the solution. The only new issue that might create is when certain workflows require older versions like, numpy 1.23 instead of 1.26 for instance. Then its may be best to have several slightly different repositories depending on different workflows.

@arkelss4 5 месяцев назад

Can you upload the workflow in a more simple way , the Google doc is not easy to use , even though it probably is ( I'm guessing click and drop )

@goshniiAI 5 месяцев назад

You are correct, simply drag and drop the file into comfyUi on an empty canvas after downloading. You can also make use of this alternative link: tinyurl.com/msbe8fb3

@arkelss4 5 месяцев назад

@@goshniiAI thank you , save nothing I believe everything will be outdated in a couple months, even comfyui is destined or fated 2 be over taken by a new U.I

@goshniiAI 5 месяцев назад

Thank you for your feedback! Being open to change and staying adaptable is essential.@@arkelss4

@zetaluxs 4 месяца назад

hey. my text box undefined. its about controlnet?

@goshniiAI 4 месяца назад

Hello there, Can you further clarify the issue you're having? I'm having trouble understanding it.

@zetaluxs 4 месяца назад

when I put your folder .json on COMFYUI html, TEXT box undefined. other boxes I fixed all missed ut text box :( @@goshniiAI

@zetaluxs 4 месяца назад

and anyway thanks. I watched 100 videos and you are the one teaching so simple and good. the best wishes@@goshniiAI

@goshniiAI 4 месяца назад

I appreciate your point of view and opinion. it means a lot.@@zetaluxs

@Trending_editzs 3 месяца назад

Is there any way i can sort out my issue😢

@goshniiAI 3 месяца назад

Could you please provide more details about the issue you're facing

@Trending_editzs 3 месяца назад

@@goshniiAI it doesn't move to the last step it make till 2process of turning images into black sketches and stops there

@goshniiAI 3 месяца назад

@@Trending_editzs Double-check your workflow settings and parameters to confirm they are accurate. A minor error may at times cause the entire operation to fail. - Heavy processing operations can put a burden on resources, so monitor your GPU and your Ram - Resize your video to match the same batch size output while keeping the frame size small, the default approach by Inner reflection upscales the Original video. i hope any of these helps. Don't give Up!

@david_ce 4 месяца назад

Hold on bro, Are you a Nigeria?!

@goshniiAI 4 месяца назад

I am actually of Ghanaian descent, but I believe both countries have similarities.

@Bitcoin_Baron 5 дней назад

What is the VAE and what should it be used for? What is the the Animate Path node doing? How do we know which one of the models "is necessary"?? This is unfollowable because you aren't covering the basics.

@goshniiAI 2 дня назад

Hello there, I appreciate your feedback about covering the basics. I’ll make sure to include more foundational explanations in future videos to help everyone follow along more easily. the VAE helps compress and decompress image data, ensuring better quality and detail in the generated images. The Animate Path Node is used to create smooth transitions and animations between different frames How Do We Know Which Models Are Necessary? Some models are better suited for certain types of animations or image styles, you can Refer to the model documentation for specific use cases or try different models and see which one gives you the desired result. i hope this was helpful and keep experimenting!

@user-pd8md1hc5n 4 месяца назад

Hey the link points to thibaud/controlnet-sd21 but i see in the video you're using sd15. Is that why Im getting RuntimeError: mat1 and mat2 shapes cannot be multiplied (1232x768 and 1024x320)?

@goshniiAI 4 месяца назад

please navigate to the manager in comfyUi and select install models. Search for the model name to find the SD15 models as well.