Тёмный

AniPortrait - AI Audio-Driven Synthesis of Portrait Animations - Local Install! 

Nerdy Rodent
Подписаться 51 тыс.
Просмотров 11 тыс.
50% 1

Using python & AI for animation images is always something I find fun, and there's a new kid on the block - AniPortrait! Using the power of Stable Diffusion, this repo can create animated avatars with fairly minimal effort. There have been quite a few research advances over the years, and this brings us a step closer. Want to install some of the latest, cutting edge, AI research at home? Well now you can, as this will run on consumer hardware too 😃 This step-by-step tutorial will guide you through getting it running locally, meaning you too can be on the cutting edge! Crack that anaconda terminal open once again to begin your journey…
Want to support the channel?
/ nerdyrodent
AniPortrait - github.com/Zej...
AniPortrait paper - arxiv.org/abs/...
Installing Anaconda for MS Windows Beginners - • Anaconda - Python Inst...
RVC WebUI - • RVC Web UI - FREE, Ope...

Опубликовано:

 

4 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 39   
@vi6ddarkking
@vi6ddarkking 6 месяцев назад
Ok, so hear me out. This with SD3 models + Tavern AI text to speech with Llama 3 or Grok derived models. 2024 is shaping out to be a truly fun year.
@jackrabbit1704
@jackrabbit1704 6 месяцев назад
It'd likely take a nasa quantum super computer to run stable diffusion image prompts, a moderate llm, rvc/applio and then this all at the time. But yes, yes please.
@vi6ddarkking
@vi6ddarkking 6 месяцев назад
@@jackrabbit1704 Not really. Anything above a RTX 5070 should be able to handle it comfortably. Considering the Blackwell architecture and the improvements in AI efficiency we're seeing.
@kariannecrysler640
@kariannecrysler640 6 месяцев назад
Here comes Peter cottontail. Hopping down the bunny trail. Hippity hoppity nerdy’s on his way! 🐭🐇
@NerdyRodent
@NerdyRodent 6 месяцев назад
😀
@kariannecrysler640
@kariannecrysler640 6 месяцев назад
@@NerdyRodent 🤘😉💕
@marilynlucas5128
@marilynlucas5128 5 месяцев назад
@@NerdyRodent My suggestion is to try experimenting with fourier transforms to eliminate the flickering in stable diffusion videos as the frequency level. Please do you understand me?
@Sol-zp6kc
@Sol-zp6kc 6 месяцев назад
I wonder if we'll ever get something like LucidSonicDreams but with SD, that would be incredible!
@LaurinkoSattumaa
@LaurinkoSattumaa 6 месяцев назад
Yes!
@NerdyRodent
@NerdyRodent 6 месяцев назад
Maybe one day ☹️
@UnchartedWorlds
@UnchartedWorlds 6 месяцев назад
Fix those eyes to look directly into the camera and this is great!
@leavemealoneandgoaway
@leavemealoneandgoaway 6 месяцев назад
there is software for that too
@marilynlucas5128
@marilynlucas5128 5 месяцев назад
@@leavemealoneandgoaway What is that software? descript?
@MrRaja
@MrRaja 4 месяца назад
If you have Nvidia GPU you can use Nvidia Broadcast on your camera and there is a A.I. function to lock your eyes to camera. even when you are reading something on your monitor or looking down to your keyboard to type your videofeed will show you staring at the camera at all times as long as your eyes are decently visible (bang/too dark).
@marilynlucas5128
@marilynlucas5128 4 месяца назад
@@MrRaja oh? How nice
@DeconvertedMan
@DeconvertedMan 6 месяцев назад
+1 points.
@PrincessSleepyTV
@PrincessSleepyTV 6 месяцев назад
This is so cool!
@NerdyRodent
@NerdyRodent 6 месяцев назад
Can’t wait for a few more papers down the line! 😉
@Trungkhai-z1h
@Trungkhai-z1h 6 месяцев назад
now this tool can make , two hand ,mouse , Natural movements and realistic performances
@AguniAgooni
@AguniAgooni 3 месяца назад
Could you tell me the inference time and you system configuration ? And do you know any near real time talking head models?
@pfbeast
@pfbeast 6 месяцев назад
How to use "instruct pix 2 pix" & "SDXS" in comfyui?
@smtabatabaie
@smtabatabaie 6 месяцев назад
How's the inference time with audio driven mode? is it near real time?
@NerdyRodent
@NerdyRodent 6 месяцев назад
Not even close 😉
@smtabatabaie
@smtabatabaie 6 месяцев назад
@@NerdyRodent Thanks, Do you know any talking head with near real-time inference? Something like D-ID real-time avatars
@NerdyRodent
@NerdyRodent 6 месяцев назад
Where you can do your own custom stuff easily, locally and for free… not that I can think off 🫤
@AguniAgooni
@AguniAgooni 3 месяца назад
@@smtabatabaie Hello, did you find any such near real time talking head models?
@Trungkhai-z1h
@Trungkhai-z1h 6 месяцев назад
How long time we can make out put video 5 nminutes or 10 or 30 minutes if we want
@NerdyRodent
@NerdyRodent 5 месяцев назад
Each video can be as long as you have the hardware for!
@wsx256
@wsx256 6 месяцев назад
Strabismus attack
@LouisGedo
@LouisGedo 6 месяцев назад
Hi
@Trungkhai-z1h
@Trungkhai-z1h 6 месяцев назад
and any tool can make voice clone and train voice , thanks
@NerdyRodent
@NerdyRodent 6 месяцев назад
Do you mean like the example in this video?
@sinayagubi8805
@sinayagubi8805 6 месяцев назад
we want a speaking rodent in the corner of your videos. ahaha
@NerdyRodent
@NerdyRodent 6 месяцев назад
Ikr!
@el-_-grando-_-_-scabandri
@el-_-grando-_-_-scabandri 6 месяцев назад
creepy
@LilShepherdBoy
@LilShepherdBoy 6 месяцев назад
Now this is actually very cool. Must be great for people that want to do VTuber content but don't want to go through the whole rigmarole of setting one up. - Jesus Christ loves you 💙 He has a plan and a purpose for your life, plans to prosper you and not to harm you, plans to give you hope and a future. Jesus Christ loves you 💙
@fernandodiaz8231
@fernandodiaz8231 5 месяцев назад
Thank you for the information. I would like to ask if you know some Colab options or Kaggle notenook for AniPortrait
@RhapsHayden
@RhapsHayden 4 месяца назад
Ugh I forgot to create an environment and screwed up Comfyui. Took me all day to fix it😂. I'll try it again tomorrow because I need this
Далее
23 AI Tools You Won't Believe are Free
25:19
Просмотров 2 млн
Обменялись песнями с POLI
00:18
Просмотров 956 тыс.
I Remade YouTube From Scratch Using Just Bash
17:51
Просмотров 19 тыс.
Adobe is horrible. So I tried the alternative
25:30
I coded one project EVERY WEEK for a YEAR
13:13
Просмотров 647 тыс.