Idk why I insist into looking for something out of this channel just to find what I was looking for in here after I downloaded +20GB of something that I didn't need to download... Thanks a lot Sebastian!
Great, as always. I had to use NOT PORTABLE version of ComfyUI to make it work. It's pretty easy to install. It's amazing how fast it's working even on my GTX 3060.
I use Forge WebUI for the most part. I honestly wish we'd get an extension like this but specifically just for the eyes, even if we could just point them in the direction we want without taking it into photoshop and then back into AI tools.
EXACTLY! Read my comment above where I am raging out over us not having SIMPLE solutions like this to manipulate facial EXPRESSIONS via single image guidance input. If they can do it with video, why not with single images?
I had a big memory issues (crashes/freezes when reaching 100%) but it was due to image concatenate multi and video combine nodes that took too much RAM. I just add a save image node at the full images output of the liveportrait node and it solved it (the nodes then took the images on the drive instead of the RAM)
This just isn't working for me. I don't have anything in ComfyUI_windows_portable\ComfyUI\models\insightface\models and I'm missing the top nodes in the first and second rows. Manager can't seem to find them. Please, help.
I need Live Portrait to be more like Hedra with the body moving, the face just moving at enough no more, but it's the first real alternative to HeyGen, though which is now obsolete.
Couldn't get it to work - The following node types were not found: DownloadAndLoadLivePortraitModels LivePortraitProcess Lots of users seem to experience the same issue. This python install madness is so annoying 🤦♂
i wish comfyUI can have this feature: setup this kind node test it, it's success, export it as app export will make installer file for windows/Linux / mac/or even for ios or android or arm if it's met requirement. when install the app from installer it also will install all necessary files so the nodes will work as in ComfyUI without any technical installation like going on in this video....
Hi Sebastian, can we combine two or three models output into 1, like if we want to use Lip-sync and some other model with it, can you show us how it's done. How can we route or make nodes in such a way.
you are the best, I was really impressed when in your sdxl release video you gave the release date in the beginning without worrying about video counts, thanks
Appreciate for the nice tutorial. When I follow the instruction, it generates only 8-second video whatever the length of input is. Can I make output video length same with source video's?
Hello! Please tell me how to fix the error. (Error occurred when executing LivePortraitProcess: LivePortraitProcess.process() missing 1 required positional argument: 'crop_info') Thank you
Its currently only img to video and quite frankly a meme still and not useful outside of memes. The true amazing stuff comes when they release the video to video code. Someone has already tweaked the code and uploaded Gladiator scenes with it in action and its honestly amazing. I cant wait to use it to make videos with it. You can parody and entire movie with a whole different script.
Love this tool, and a great tutorial. However, only the eyes are animating for me?? I have the both the video and target pic sized at 512x512. I've tried different sources and targets, just the eyes are animating
excellent workflow! thank you ... which value is responsible for getting smoother results? most of my tryings are a little bit to much moving around the face ... thx in advance ...
Maybe you should put a disclaimer behind "you can use it for anything". As the licensing for insightface is a mess I guess you can basically just use it for research, right?
good job！ If I turn the live-action video into AI animation, the AI animation dialogue lip sync is not obvious. So, can I use this technique to enhance the mouth movements of animated characters?
Hey guys & gals - this is my entry. I believe our first priority should be to make this 'stuff', the tools of the future, as ACCESSIBLE as possible. To get artists IN we need to be OPEN. And the best way to do that is to flatten the 'learning curve' as fast as humanely possible. * No more gatekeeping! * No more hiding 'workflows' that are out date in a week's time behind paywall! * No more technical jargon!
You know what would be coool and awesome?..if such a Top Expert like You would do a review on what PC package with what Graphic card and what ram and etc etc, would be best for Auto1111 , comfyui and even for creating LLMs . i dont think anyone out there has done one in the last 12 months. i see some people doing multiple Graphic cards to create LLMs, which is fascinating,...for which there is no one , who ever having done a video on youtube yet neither.... i mean...how much faster would such a multiple Card setup be for auto1111 and comfyui... if you would consider ever doing such a video, dont forget to make it for 3 different budgets,..super dirt cheap ..versus middle budgets,...versus unlimited budget packages .... all for home.... so it makes sense to viewers here.... i doubt companies or corporation go to youtube to find such packages... wäre echt toll
It depends on how long u can wait. I see generally people recommend RTX 3060. I also remember reading that an RTX 4090 would be 10x speed of RTX 3050 for generations
The issue I'm running into is I get a squash and stretch on the head, at first I thought it was the resizing node that was doing it but even after removing it I still get it even though I'm using your exact settings, my head is not even as smooth as yours, any thoughts? The image I'm using is 512x512, should the image and video be the same size maybe?
Hey, that's some valuable info, thanks for sharing! :D Just a question, does the LivePortrait standalone have the same control options that ComfyUI has? More? Less ones?
@@juanjesusligero391 it has options for pasting back into the image or just keeping the square as well as a few more things I haven't checked as of yet.
When loading the graph, the following node types were not found: DownloadAndLoadLivePortraitModels LivePortraitProcess Nodes that have failed to load will show as red on the graph.
Noob here: Can someone tell me were i have to put the json-example to open in it in comfyUI... just installed it with some models and the manager. But now i am not sure in which folder i have to put the example or how to open it. I tried dragndrop it in the broswer window, nothing happened, the same when i click "load" in the manager window.
This turorial was great. Thanks. Question: Is there any tool (like this to run locally) to upload an mp3 voiceover and generate the mouth and eye movements to later use in this process? Thanks!
ipadapter, controlnets, reactor and all of the rest ASIDE....what tools are there that can TRANSFER facial expressions like this, with SINGLE IMAGE input? It seems like it would be so easy. If they can do it with a vid, why not with single images? Fuck a "face swap"! We've got that sorted. Now we want to tweak expressions like with these "driver" videos, but using single images. Fuck text prompting out expressions! Fuck fiddling around with laborious and complicated shit. Just a simple image input where the EXPRESSION, (not the facial characteristics), can affect your gens. What's the hold up, tech bro's?
Dude, you can use exactly this (LivePortrait) for only an image by adding a 'video' containing one frame as a source. I'm not sure if you can load an image sequence as a video, but if you can, that would be it. If the node needs a video, you can use FFmpeg to convert an image into a 1-frame video. You could also make a constructive critique in the comfyUI node repo, asking for the feature nicely. Remember, the people making this tech possible are working hard, even if it's not as user-friendly as we'd like yet.
@@juanjesusligero391 Yeah sorry about the frustrated tone in my comment. :/ I actually did try the solution you suggest, but had sub par results. I will look into it further. I used a video editor and drug a few frames from a sequence down to the time line, and let them play together as a video. Still feels like a "hack" or "work around". What I was getting at was that if LivePortrait can make it so that we can manipulate features on a face without going into face swapping, or using loras, or trying to achieve this by other means such as ipadapter and so on and so forth, and can accomplish this with VIDEO, surely it could be done with single images? There are many guides on how to try and "tease out" expressions in images, but this LivePortrait solution is so "direct" and simple. It's what I have been looking for.
@@juanjesusligero391 I mean think about it. You've done a great gen of a face you like. Now you want this face to smile, or "look cheeky", or distraught or whatever. You wanna try a multitude of different things. Various nuances of emotion. With a single image LivePortrait solution you could do so much easier that via traditional methods.
@@MattLind-oi5kg Yeah, I totally understand :) But all this technology is still soo young... Developers are yet trying to figure things out (and most of them are doing this just out of love, since they don't see a single dollar for their contributions), but in the (probably near) future we'll have a lot more control over things like this. Be patient, my friend! ^^
@@jaywv1981 Good tip. I am faffing around with their own webui version and all their "examples" videos work flawlessly but with others you might use, it's hit or miss. I've had some horrendous "I have no mouth but I must scream" moments, haha.
