EchoMimic Magic: Audio and Landmarks Bring Portraits to Life! 

Hi there, I tried ton install it for ComfyUI, but could not do so successfully (via Manager + copy paste all missing files from the repo). Could you please make a tutorial for ComfyUI please? 😊

@@IdgrafixCh I am sorry, Comfy is not my cup of tea. It is a standalone install why use Comfyi. Comfy will occupy VRAM for it's own use and then this tool. Standalone means more VRAM available. That's my understanding.

Ha ha ha. True that, let me also start saving. Please could you check the teeth part. Are you happy?

I think eye blinking needs some improvement. Sometime only 1 eye blink.

@@StableAIHub Minor imperfections are ok. It's easy to edit in capcut by applying some effects. What is important for me is the skin texture similar to sadtalker.

@@ChikadorangFrog Right. The quality is good. I wasn't expecting this good for AI.

The processing time can be significantly reduced if you use a 16GB or 24GB VRAM card. Using cloud services can further decrease the rendering time. A few months ago, the major issue was the quality, as the output would get distorted when using realistic images generated with SD. EchoMimic has surprised me with its improvements. I'm happy to see that the quality is getting better, and in due time, the speed will also improve. Unfortunately, I have the most basic laptop that only meets the minimum requirements, which explains the slow speed.

@@StableAIHub I think you'll agree, prices being what they are, most people either have a 12 or 8 gb and I think that is where the optimization focus should be:)

I agree what you said. I hope in due time the processing would be much faster on low VRAM cards.

@@StableAIHub i think devs plan to release a faster version of this in 1 to 2 months

Thank you for your feedback

can you share the bat file?

@@ChikadorangFrog The video publisher added the code for bat file and pinned it, you can copy and paste it in a text file, then change the extension to "bat".

@@TomiTom1234 thx

@@ChikadorangFrog You are welcome. Don't forget to change the paths that need to be changed to match your folders.

I noticed the same. Used the slower version for next video. Did you came across any tool for singing talking head.

@@StableAIHub next release of echomimic would have Pretrained models with better sing performance to be released

We need to keep a watch on ingrid789.github.io/MyTalk/ Looks amazing

@@StableAIHub might be good to combine with Kling AI

The answer is long. Primarily we are using either PIP or CONDA to create virtual environment (VE). Sometimes the dependencies are very specific like some packages, python version... etc which can be easily done using conda. I don't know if this will work without conda. You need to try and let us know plz.

@@StableAIHub Got it. thanks for the info. Cheers, b

It is trained on 512 x 512 dataset. Use upscaler to improve quality.

I always use 4xUltraSharp in Automatic1111. For that you need to extract all frames, upscale and then combine as video. You can refer the following on how to extract frames ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-2M6RC1kJeio.html

@@StableAIHub beard is getting blurry and distorted

@@rahulkathuria8250 Do you have generated video. Please post on github

Check if the solution posted here works? github.com/BadToBest/EchoMimic/issues/102

@@StableAIHub Got it working now from your link but it takes time to render for 5 Seconds of audio on a 12GB Graphics card and 32 GB of RAM over 20 minutes this app is similar to Hallo Time consuming.😥

@@VintageForYou Try the accelerated version which is very fast.

A2V with acceleration is working fine. Please could you share error screen using Drive.

@@StableAIHub Thanks its working fine now. The Gradio is the one that is not working

@@ChikadorangFrog If no one is gonna fix I will see if I can. I am not a programmer so gonna take help from AI. By any chance do you have the old version / earlier release of EchoMimic when it was working

@@ChikadorangFrog Please check the github, I posted the solution. If you can confirm on github, it can be merged in repo

@@StableAIHub i made a mistake by cloning the latest version and copy paste it to the original/old. I no longer have the old working version

Please post the output on github

@@StableAIHub you mean the video, okay but they haven't released the dataset which means they haven't trained bearded guys.