Install on your local PC/laptop: LINKS
Github (for Comfy UI) - github.com/kijai/ComfyUI-Live...
My workflow with assets -openart.ai/workflows/seal_har...
Made with Stable Diffusion and Comfy UI
#hedraai #ai #comfyui
More details about Live Portrait:
LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control is an innovative approach for creating lifelike video animations from a single source image. Here are the key details:
Objective: LivePortrait synthesizes realistic videos by using a single source image as an appearance reference and deriving motion (facial expressions and head pose) from a driving video, audio, text, or other sources.
Framework: Unlike mainstream diffusion-based methods, LivePortrait leverages an implicit-keypoint-based framework. This approach balances computational efficiency and controllability.
Training Data: The model is trained on an extensive dataset of approximately 69 million high-quality frames. A mixed image-video training strategy enhances generalization.
Enhancements:
Compact Implicit Keypoints: These keypoints effectively represent blendshapes, contributing to better generation quality.
Stitching and Retargeting Modules: These modules, implemented with a small MLP, enhance controllability without significant computational overhead.
Performance: LivePortrait achieves remarkable generation speed (12.8ms on an RTX 4090 GPU with PyTorch) even when compared to diffusion-based methods.
6 июл 2024
