Updated AI Voice Cloning with RVC Inference - Tortoise with RVC Local Installation

Подписаться 32 тыс.

Просмотров 94 тыс.

50% 1

Links referenced in the video:
AI Voice Cloning Repo - github.com/Jar...
How to get RVC Voice Models - • How to Get AI Voice Mo...
How to Train a Tortoise Voice - • Local AI Voice Cloning...
RVC/Voice Changer Playlist - • AI Voice Changer
Hardware for my PC:
Graphics Card - amzn.to/3pcREux
CPU - amzn.to/43O66Ir
Cooler - amzn.to/3p98TwX
RAM - amzn.to/3NBAsIq
SSD Storage - amzn.to/42NgMFR
Power Supply (PSU) - amzn.to/430bIhy
PC Case - amzn.to/447499T
Mother Board - amzn.to/3CziMXI
Alternative prebuilds to my PC:
Corsair Vengeance i7400 - amzn.to/3p64r22
MSI MPG Velox - amzn.to/42MnJHl
Cheapest and PC recommended:
Cyberpower 3060 - amzn.to/3XjtZoP
Come join The Learning Journey!
Discord - / discord
Github - github.com/Jar...
TikTok - / jarodsjourney
If you found anything helpful, please consider supporting me and the content I am trying to produce!
www.buymeacoff...

Опубликовано:

30 сен 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 309

@AmrAbdeen 7 дней назад

doesnt work for me. when i hit generate it gives error message error No RVC configuration found, check configs folder. If rvc.json does not exist, please change a setting in the RVC area to create one.

@Mkm-f9r 7 месяцев назад

Is it possible if you can make a google colab or paperspace version for people who don't have high end GPUs?

@JakaJaka-kx2qj 7 месяцев назад

I hope soo

@The-Game-Making-Guild 7 месяцев назад

I did made it

@JakaJaka-kx2qj 7 месяцев назад

@@The-Game-Making-Guild Where's that ?

@The-Game-Making-Guild 7 месяцев назад

@@JakaJaka-kx2qj I can't send it here due to RU-vid blocking links

@The-Game-Making-Guild 7 месяцев назад

九千 colab.research.google.com/drive/19MWwqyiHSyOtQB8hqrVyajHvDdzUnshd

@어슬렁어슬렁호시탐탐 8 месяцев назад

The tts program that becomes rvc gives me great happiness.

@yashkhd1100 8 месяцев назад

Thanks mate..!! You are one of the youtuber..who knows about AI Voice inside out. I'm a pro dev but not into AI space. I find all these stuff exciting. Want to explore all voice related stuff but have time constraints. It will be great if you can make an Udemy course covering all aspect of Text to Speech..will definitely like to purchase it..

@Jarods_Journey 8 месяцев назад

Appreciate it! I've got something in the works so will probably announce it on my channel whenever I get things sorted!

@TweetykachuDenzelAbaya 10 дней назад

Maingat kong sinunod ang mga tagubilin ngunit nabigo itong mai-load ang mga form ☢☢☢☢

@Dreem200 4 месяца назад

C:\Windows\System32>runtime\python.exe infer-web.py --pycmd runtime\python.exe --port 7897 The system cannot find the path specified. Pls how to fix this

@georgelaskosofficial 7 месяцев назад

*Bro your job is outstanding...* I have one question please. What i need to do to have Greek Language? Even i loaded my Greek Samples and wrote in Greek in Text box.. all sounds wrong. 😂😅

@panosjr_greece 7 месяцев назад

I need it too.. @jarods journey

@DeDoodles 8 месяцев назад

Thanks for the amazing work you've put in. Im loving the results of your RVC update. Is there a way to turn off rvc in your audiobook maker. And use the output from the new tortoise rvc instead of the audiobook makers built in rvc.

@Jarods_Journey 8 месяцев назад

I appreciate it and I'm glad you're finding these things useful. It does not unfortunately. I will have to update the audiobook maker to put that into account as several things have changed since the initial release, just in case you want to disable/enable RVC. Thanks for the support 🙏!

@Gwynbleiddsanity 6 месяцев назад

just when i was starting to miss the gcollab rvc now i finally have it downloaded on my pc thank you so much

@nicolaykoriagin 8 месяцев назад

Oh JEEZ. This is simply incredible! I can't stress how impressed I am. You did an amazing job by combining these two technologies together! I mean... damn, god bless IT guys like you. This is outstanding. I have a one question though... is it possible to make a proper sound-based text-to-speech on languages other than English? Like, I don't know, if it would be possible to select or type the language locale in a new input field before clicking generate, so the system will recognize it's not the basic English. Just wondering what some of the favorite characters would sound like in translation, with their voices. :)

@Artholos 8 месяцев назад

PARTY TIME! Jarod you’re the best! The hero we needed 🎉

@Jarods_Journey 8 месяцев назад

Thank you thank you Artholos :)!

@BroadwayCJ97 3 месяца назад

'runtime\python.exe' is not recognized as an internal or external command, operable program or batch file. Press any key to continue . . . I downloaded the zip file, extracted it, clicked start and this popped up. If I press a key it closes. What am I doing wrong?

@D-5000m 3 месяца назад

same issues here, did you downloaded the ver 3?

@joseijosei 6 месяцев назад

Does it work for Spanish?

@Mowgi 8 месяцев назад

Awesome! I've taken a pause on AI for a bit to focus on some other things, but I'm excited for all the neat things waiting for me when I come back to it. Love your content!

@Jarods_Journey 8 месяцев назад

All good, gotta do what you gotta do! AI will be here, bigger and better whenever you return to it. Appreciate it!

@9ALiTY 6 месяцев назад

7zip won't extract it, says unsupported compression type.

@vmfox2152 7 месяцев назад

Great work. Thank you. But I have another question: What would have to be changed to be able to use other voice languages?

@mcfcmandem 7 часов назад

Generations very slow on a laptop 4050 gpu, any fixes?

@RobertJene 8 месяцев назад

2:07 yes I need all those models thank you. It's like when I purchase an audio fx plugin and if it doesn't come with presets... I'm mad. I need some presets to help with my workflow. Voice models means I have choices for some of my videos where I don't have to train a model if I don't want to.

@aniversext 7 месяцев назад

How many languages it support?

@panosjr_greece 7 месяцев назад

I am interested to Greek also .

@eduardovanelli2261 3 дня назад

Hey man, thanks for this, finally one that works, But, there a video where you teach how to customize emotions for TTS?

@toaalta 6 месяцев назад

mine says the .wav isnt being recognized

@toaalta 6 месяцев назад

Error opening './voices/me//downloa.wav': Format not recognised.

@AbdullahNiazi7177 8 месяцев назад

ModuleNotFoundError: No module named 'bark' ModuleNotFoundError: No module named 'vall_e' RVC options are not showing in the UI ..?? Some guidance please.

@streamology 3 месяца назад

a tutorial that requires tutorials in order to watch... terrible

@emailyarabrandao 6 месяцев назад

hi. is this the best voice clonig app out there? i would like clone my grandmas voice (she has passed away) to make my mom a virtual card. i would like the voice to be perfect though. thanks.

@Jarods_Journey 6 месяцев назад

Hey there, sorry to hear about that. This software is pretty good, but it's not perfect and requires a lot of audio data. If you don't want to bother with getting all of this setup, I would recommend eleven labs as the best paid option for voice cloning in this case.

@emailyarabrandao 5 месяцев назад

i am ok with following the steps. i was wondering if this is the best out there to learn at the moment. one other question please, how do i convert mp3 or wav file into the PHP extension? i have a ton of audios from her in those formats. i didnt find any software online to do that. thanks.@@Jarods_Journey

@JimmyWatford-pu4ww 8 месяцев назад

hi is arabic supported

@HambaAllahseriaL 29 дней назад

Very useful, may you always be healthy and blessed. Thank you for the tutorial, I am using it

@fekra-ads 8 месяцев назад

File "ctypes\__init__.py", line 374, in __init__ FileNotFoundError: Could not find module 'C:\Users\ahmad\OneDrive\سطح المكتب\ai-voice-cloning untime\Lib\site-packages\torchaudio\lib\libtorchaudio.pyd' (or one of its dependencies). Try using the full path with constructor syntax. how i can fix it?

@FlorianKMusic 7 месяцев назад

have the same error

@hehe42069-k 12 дней назад

seems to give me all kinds of errors, first not installing a venv, then OOM, and not loading RVC correctly.

@CH_Nisar Месяц назад

First of all Thank you so much for all of these which you are sharing with us without any cost. So now please suggest me best and the most best voice cloning AI for local use. i am RTX3060 12GB and core i7 14th gen. Thank you in advance.

@neatgameplay2780 2 месяца назад

I get this error when attempting to generate something "RuntimeError: Possible latent mismatch: click the "(Re)Compute Voice Latents" button and then try again. Error: Sizes of tensors must match except in dimension 1. Expected size 1 but got size 2 for tensor number 2 in the list." - but how can the size be equal to 1 if the least minimum allowed is 2?

@Zencat420 3 месяца назад

This is awesome, excellent work! Sorry for the dumb question, but how can I access this from other computers on my network? ip address:7860 is refusing a connection, and I can't seem to figure out why. Disabling firewall does not fix the problem and I"m a bit stumped. Many thanks in advance!

@chad5893 3 месяца назад

Hey, great tuto. I'm getting a CUDA out of memory error after I go through everything and hit generate. Ive got a 4080. Any suggestions? EDIT: I've got 16GB of dedicated GPU mem, running start.bat allocates 4.8GB and then running Generate blows past 15GB then throws up the error. 2ND EDIT: Reduced the samples to 8 and now it works...lol...no more edits I promise.

@BareillyFRS 3 месяца назад

why there is need of your voice sample if you already put model of your voice

@anti-dreamstansunited3391 7 месяцев назад

I got error extracting, I've downloaded 7zip. Any idea why?

@panosjr_greece 7 месяцев назад

Me too... Use winrar to extract it.

@northwestrepair 7 месяцев назад

how to train it to speak like morgan freeman ?

@GraveUypo 8 месяцев назад

How much is a coffee? Is this enough for a coffee?

@Jarods_Journey 8 месяцев назад

Haha thanks grave! That should be more than enough to cover a coffee here. Appreciate it!

@grahamulax 8 месяцев назад

whoa........WHOA! This is hot. I was looking for elevenlabs alternatives and I think this is it. I love local training and having a 4090 (we have the same one! It rules!) helps a ton and I just dont want to use services! This rules! Instant SUB! Cant wait to try this later!

@ahmetab06 8 месяцев назад

Guys, is there a video where a famous voice actor tries this for a long time? I couldn't find a long video like elevenlabs where I could hear a few examples.

@rockatrock6912 3 дня назад

Hey bro Can i use other language ? How to do it

@ravkhangurra7522 4 месяца назад

Great work, thanks for sharing your knowledge. Can you make this into a colab version, my gpu is low spec. Thanks

@gregorikeller6928 3 месяца назад

Hello Jarod, thank you for the sharing, I need a tool like this with posibilities to do an API request to do that in bulk. does this tool allows it ?

@abuzerkadayif-p2z Месяц назад

hello how to replace a signed actor voice from a video file with another person's voice

@eshan3009 8 месяцев назад

"CUDA out of memory. Tried to allocate 43.81 GiB. GPU 0 has a total capacty of 6.00 GiB of which 2.72 GiB is free. Of the allocated memory 2.33 GiB is allocated by PyTorch, and 16.43 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF" Getting this error when i click generate. Any suggestions? I tried the "Low VRAM" option, but still the same. Also, it correctly detects my GPU during startup with 6 GB RAM.

@chatsmignons5466 8 месяцев назад

I got this error too, I struggle to find a solution ! did you find out ?

@eshan3009 8 месяцев назад

@@chatsmignons5466 Yes. First, i updated my 7zip to the latest version. Unzipped everything again. Then ran the program. Generated my first prompt by choosing 'random' voice. Then i tried generating with other voices...and it ran fine.

@panosjr_greece 7 месяцев назад

Its because your files in voice folder is not .wav. Also upload parts and not a whole audio file

@Tranquilized_ 7 месяцев назад

Thank you, I learned a valuable lesson from this video. Don't do something yourself when someone else can do it better.

@KodaPaul 7 месяцев назад

I feel you... Been struggling with this deepspeed cuda shit trying to make tortoise work lol

@فن_وطرب 3 месяца назад

I followed the instructions carefully but it fails to load the forms😢😢

@Alice0519M 19 дней назад

Jones Timothy Williams Betty Taylor Steven

@Bl4ck7411 21 день назад

Is there a way to add other languages from English?

@blabbilizer День назад

How would I do this on AMD?

@benfrombc 3 месяца назад

what are requirement to achieve this, can this be done with 2018 Mace mini ?

@user-yp2ef5ef9l 10 дней назад

Williams Michelle Jackson Michael Jones Eric

@KipForce 6 месяцев назад

You have a trustworthy face. I chose your video because I don't think you would never hurt me.

@poly06033 8 месяцев назад

Google Colab web ui?

@rockatrock6912 16 дней назад

can i use this without internet? offline working?

@Alice0519M 15 дней назад

Davis Susan Thomas David Robinson Timothy

@BrennerEraFan Месяц назад

Does this version have an API that can be called when it is running?

@Alice0519M 28 дней назад

Perez Jeffrey White Angela Wilson John

@1ajayc 2 месяца назад

where is the AIHUB discord to download models?

@shekmohamed3217 3 месяца назад

pth file is not created .... what is the issue..??

@Sinane_0 2 месяца назад

Same, did you find the issue ?

@shekmohamed3217 2 месяца назад

@@Sinane_0 yeah i know

@Sinane_0 2 месяца назад

@@shekmohamed3217 I've uninstalled / reinstalled and it works

@GraveUypo 8 месяцев назад

do you have a suggestion for language model that runs fast? I use amethyst-13b-mistral.Q8_0 and it is by far the best local model i've tested, by a landslide, completely different dimension. it is actually comparable to gpt4. but it takes like 90 seconds to generate each reply. it's like a person typing at ~70 wpm. maybe there's a model that's 10 times faster and 50% as good?

@Jarods_Journey 8 месяцев назад

You might want to look at 7B parameter models and then look at what model loader your using. If my memory serves me straight, exllama2 was there fastest I think in my testing

@annlaosun6260 2 месяца назад

can you make a video on how to install applio on mac?

@FSKtv 2 месяца назад

Is it possible to convert the pth files to onnx?

@utoob22 3 месяца назад

Which software name is the RVC ? Where can we get it

@elijahpavich1095 8 месяцев назад

What if I already installed a previous tortoise model from your other tutorial. Is there a way to update or download the needed rvc extension myself

@Jarods_Journey 8 месяцев назад

You need to redownload this package to get the RVC inference functionality

@ScrakSFMs 7 месяцев назад

This is perfect for me as I am a Filmmaker that is working on a new project that will use some characters from a game that has a Wiki where I can download the voice lines and turn into a model and use this RVC to make them say the story without spending hours in editing myself. Thanks!

@ScrakSFMs 7 месяцев назад

I had the idea if this didn't exist to just record myself doing the character's lines I wanted and using a RVC to make it sound like the characters but that'd be very time consuming and worse. So once again a huge time saver. And the RVC I used to clone my own voice, the training has stopped working and I couldn't add any more voices which sucked. So I hope this doesn't have any of the issues I've occurred so far yet.

@BenjaminTemplar 5 месяцев назад

That is a great idea guys. I’m a filmmaker too. Great vibes!

@ScrakSFMs 5 месяцев назад

@@BenjaminTemplar No problem, hope the best for you!

@benfrombc 3 месяца назад

what are requirement to achieve this, can this be done with 2018 Mace mini ?

@kaziahmed 5 месяцев назад

Hey Jarods, amazing video! I have a question, is the training for RVC and TTS same? Or do I have to train a model seperately for RVC?

@masterpav 8 месяцев назад

there are many rvc like mangio-rvc, applio and more to cloning voice model but which one is the best for cloning ? i do have nvidia gpu

@ricoletta 8 месяцев назад

No one size fits all. It's mostly context dependent based on my experience

@TheLobsterWrestler 7 месяцев назад

I've been trying to get this up and running, but I keep running into an issue where it keeps trying to use an absurd amount of ram the GPU simply does not have. " Tried to allocate 323.47 GiB. GPU 0 has a total capacty of 12.00 GiB of which -", and so far I'm not having any luck with a fix.

@Footballmadppl 7 месяцев назад

I got the same error

@anthony.stepvoy 4 месяца назад

@@Footballmadppl same problem here, any fix?

@Footballmadppl 4 месяца назад

@@anthony.stepvoy Still not bro

@anthony.stepvoy 4 месяца назад

@@Footballmadppl i fix it, its because voice samples are too long and heavy. CUt it into smaller size audios

@Lucifers-Stepdad 3 месяца назад

@@anthony.stepvoy You are a fucking champion.

@spetheofmusic 8 месяцев назад

I used to make FL Studio tutorials on my main channel like this, straight to the point and super helpful and effective. Well played

@Mark-vv8by 2 месяца назад

is there a way to do a batch TTS with this?

@NoahMine1 3 месяца назад

when i click start nothing happens on the cmd

@sahilrajoba3375 8 месяцев назад

Hey can I run this on hugging face spaces?

@Jarods_Journey 8 месяцев назад

Not natively, I think it'd have to be ported

@sahilrajoba3375 8 месяцев назад

@@Jarods_JourneyI don't know what that means.. I'm a beginner and not fully aware of all the things and that's how i found your channel. People are interested in voice cloning and stuff, is there any way you can show how this model can be used in a hugging face space.

@sahilrajoba3375 8 месяцев назад

Forgot to say you're doing a great job teaching. I learned almost everything about rvc, tts and voice cloning from you.

@JonahToby 9 дней назад

1865 Boehm Land

@PleaseLettuceTomato 12 дней назад

Can I install this on Mac ?

@smithcarrington952 11 дней назад

4258 Cronin Views

@sxmbxdy 4 месяца назад

can i make ai song covers with this

@MikeDKelley 2 месяца назад

So running the bat file keeps coming up with a "path not found" on line "runtime\python.exe .\src\main.py %*" - anyone have a clue what I can do to get past this?

@MikeDKelley 2 месяца назад

Oh, and I checked and in my System32 directory there is no runtime directory - Python is installed but not there, I guess. Windows 11 - anyone have a clue?

@MikeDKelley 2 месяца назад

Yipes - I note I don't even have a runtime directory in C:\ root - as was set in the first line of this bat. This bat looks totally wonked for at least my system.

@erinserekellyry2740 28 минут назад

32083 Bechtelar Well

@FestoonBoston 14 дней назад

5385 Bogan Centers

@DavidDji_1989 Месяц назад

Great tutorial, thanks !

@dio-vo5kc 29 дней назад

up. really great bro tnx

@context_eidolon_music 3 месяца назад

If this works I'm going to come back and tip you bro.

@Movierecap-tvhub 3 месяца назад

Is it working

@LinkinV 5 месяцев назад

i just made a voice but no .index file comes out, im trying to use RVC GUI for ai covers. any fixes?

@SKYGGEMUSIC 6 месяцев назад

Great ! Can we upload a singing vocal recording and render it with a .pth file (RVC model), or is it for speech only ?

@X2ytCrystal 2 месяца назад

Would be awesome to see a video where you break down all the slider options and what do they do. Some of them are self-explanatory, but stuff like Filter Radius or CVVP weight or Diffusion Temperature etc. are pretty unclear and it's hard to determine what exactly it is they do. Documentation for RVC and Tortoise TTS also isn't exactly the best, so most of the stuff isn't explained there either, not well, at least.

@HarveyMadeline-i8x 16 дней назад

944 O'Conner Avenue

@daniellehoggarth9642 16 дней назад

59974 Murray Dale

@LRai-n4q 5 месяцев назад

Hi, how to use it for German or hindi Language? Trained my voice for hindi. But by generating Text to speech I am receiving Config Error. Thanks in advance for your support.

@0705301 8 месяцев назад

Would be cool to see what can be done if you re-trained your voice model, as you said, and see to what level it's possible to take it in terms of pure quality. Like how good can it get with today's "tech".

@Jarods_Journey 8 месяцев назад

Tortoise and RVC already gets really, really close on other voices I've tried and tested. I personally haven't tried mangios still as RVC added rmvpe to it

@GraveUypo 8 месяцев назад

this is good enough that you mostly don't need to use paid models imo. rvc really fixes the worst aspects of tortoise. it's then only a matter of training good models for both (specially tortoise)

@askpinas 4 месяца назад

it looks to be only effective for english language if i tried my native language it cannot make a proper word

@askpinas 4 месяца назад

If i use random/pre-installed voice how can i choose the gender?

@akorneev777 4 месяца назад

Thank you for you hard work! This program is trully amazing. Lterally the best of locally running TTS setups. The quality of the result is outstanding. I just wonder if one could have some control over speed of the reading. I didn't find this in the interface. Do we have some built in text tags like , or sinething like this?

@Okuraio 6 месяцев назад

i'm having this problem: "Possible latent mismatch: click the "(Re)Compute Voice Latents" button and then try again. Error: torch.cat(): expected a non-empty list of Tensors" what it could be?

@pb2806 6 месяцев назад

Awesome system, thank you! Definitely useful for my RPG, Knights of the Chalice 2. I've noticed that the RMS setting is significant and the result may be improved with a value higher than 0.5. In one sample, 0.7 removed the 'metallic' aspect of the voice, compared to 0.5. However, there was hardly any difference between 0.7 and 1.0. Not sure yet if 0.7 is the 'best' value for all voices or if that depends on each voice. I have one big request: please let the name of the output file contain the seed, and maybe also the RMS value. It's nice to be able to recover the seed when you want to tweak a sample. Thank you!!

@WaifuRecaps 5 месяцев назад

I'm currently testing workflow with openai generated TTS to RVC. openai seems to create superior base TTS to tortoise

@Murderface666 8 месяцев назад

I dont think anyone mentioned this, but the huggingface link for RVC is dead... Oh wait, My google wasn't showing that it was downloading. Nevermind!😁

@Kaiwen-s3l 6 месяцев назад

Hey thanks for offering your repo. How much Gram is required to run this? I'm running a GTX 1650 NVIDIA card, it's only got 4 gb. Is that enough, and if so it will run be slowly?

@RobertJene 8 месяцев назад

2:44 hot tip. you don't have to do this if you don't want to. But through all my RU-vid research about how to make videos, the successful YT channels say the ideal spot to put your self-promo section is at about 2/3 of the way through the video so that you retain more of your audience to get more watch time. I also enable mid-roll ads and put a timestamp in my editor, and so I know what time to put my single mid-roll ad

@PrinceAlaric 16 дней назад

updates tutorial?

@GraysonWayne-d5t 3 месяца назад

I installed rvc W-Okada and my voice doesn’t change, it’s the same. How can I fix that?

@XenkoVence 6 месяцев назад

I've got a bit of a unique issue. Training doesn't seem to do anything. It'll run for a bit then seemingly pause. I gave it 12 hours to see if it was just running in the background and still nothing. The graphs don't even show up, so it's kinda hard to tell what's going on. Nothing in the terminal says there's an error, so I figured I'd bring it up here. Am I missing dependencies or something? Is it cause I installed it on an external hard drive instead of the D or C drive? There's not a lot to go on, but any help would be nice.