3 Seconds of Audio Can Clone Any Voice - Speech Editting with VoiceCraft 

Awesome quality for a zero-shoot! I'll give it a try. Also thanks for the update on the upcoming voice clone video! I'm glad it's coming, hopefully during this week!

Cool stuff. Appreciate the update on the next voice clone repository video

SWEET finally, we are so BACK!

It is worth to note that both Voicecraft and Audiocraft cannot be used commercially (weights have non-commercial licenses). Most people probably will not care as it is hard to prove, but I guess some people would like to know that. AFAIK you can use Tortoise (and probably RVC) commercially. Thanks for the video though, the results from just 3s of audio are just stunning. I get it that you can copy the voice patterns pretty well if you get like a few minutes of speech, but what you can get here with just 3 seconds is crazy.

VoiceCraft seems to be the best one I've heard so far -- at least on RU-vid.

oh, awesome. progress. we need more of it!

thanks for all the insights !!

Thanks Man for all you do

very cool I have to say I learned a lot from you especially when it comes to RVC so thank you very much but even with all of that I could never get a voice model that is identical to the original voice any help with that?

Hello, why do I need one voice sample in the tortoise auto aggressive fine-tuned model in the voices folder? Why can’t I select just none and will the voice sample affect the quality of the trained voice I mean when you put voice samples in the voices folder after training and selecting the model and wears the prepare a new language tab and how does it work?

great stuff!

I think the voice engine by open ai is just hype now because its from open ai

How does the cloning do on voices with special effects tied to them? I.e. SHODAN from System Shock? Will a large enough finetuning dataset accomplish good results, or will the inherent underlying training cause issue from not training on voices with special effects/pattern variances?

Love your stuff. I am using this repo and was able to reproduce the output wav files. I need to be able to load the model and then make many inference calls without having to reload the model every time. Do you have insight on how to do this or can you share your visual studio code project on github? So far, I am loading the model using fastapi and unicorn to host it. I can do inference via a post call the first time, but when trying to run again, I get WARNING:phonemizer:words count mismatch I think I need to unload or re-execute something to reset it, without removing the entire model.

Any chance you can do your magic and create a one click install that will work on windows if you have an Nvidia GPU? Pretty please?

Thank you for good content. I'm just curious about the commercial use . Since Coqui Public Model License is only for non-commercial use . Is it good to use output of this model in youtube ? I'm also planning to use tts in my content.

Hey Jarrod. Do you think this would be a viable replacement for tortoise for me to use to make audio books? I really need something soon.

Can this do things like laughing, sneezing, coughing or things like that?

I made an API server for VoiceCraft as well as added it to my audiobook/dubbing generation app, Pandrator. Both run on Windows and Pandrator has a one-click installer. I'm not sure what I think about it yet, to be honest. I achieve very good results with XTTS, but I cannot experiment with VoiceCraft too much, because generation is very slow on my measly 4GB 3050 (laptop), slower than processing XTTS results with RVC, even. I have only tried the smaller model (though, according to the author, the difference in quality is negligible). Sometimes it drastically changes the pitch, it sounds as though a sentence or a part of one was generated using a different voice altogether. It can be mitigated by playing with the parameters a little, probably. The quality of voice cloning alone is much better than XTTS (I'm not sure about XTTS+RVC), but consistency seems to be worse.

I can't get docker working, it's breaking on the first cell. Would LOVE a walkthrough.

please do a video on windows setup. I really want something to clone voices from small datasets. I been replacing game audio of Castlevania SOTN. and the PSX voice for Dracula doesn't clone because of only one minute of audio. I really would like to use all the PSX voices but right now been using PSP Dracula. thank you for any help. and thank you for the video.

it's getting scarier and scarier

Thank you for this useful and wonderful channel. I have been searching for a long time for a program that converts text to speech for Arabic. I have tried many programs and found that they do not reach the desired level regarding the Arabic language. The best one was eleven labs, but it's not free. Also, xtts coqui is good for the Arabic language, but it needs improvement. Currently I am looking for a program that converts text into speech. It can be trained to pronounce the Arabic language.. I do not know how to train xtts coqui in the Arabic language.

Can you share your build? This is the quickest way to use VoiceCraft

have you tried like indian accent or singlish accent ? will it follow?

What you think about using cloud gpu?

Before I try to istall this: How does it perform with other languages?

What about the best open source speech to text? Is there nothing better than Whisper in accuracy?

Cool. Does it run on CPU or you must have a graphics card.

What's the lowest power Nvidia card needed to make this reasonably work

could you make a one click installer for us? that would be greatly appreciated!

Do you have suggestions for real time TTS models that are open source?

Hi, it can talk another languages ?? By the way, tanks for all the work, nice channel to creators.

Jarod, How was the inference speed and GPU utilization on your 4090(I assume you're using one)?

It works only in english?

Pleas can use with arabic voice

How does this compare to my boy tort TTs RVC ?

Does it work well for other languages?

Does this come with the webui?

How to run in Google colab

Does it support CHinese and cantonese , vietnamese ?

Can I run this without GPU any method 😢

This license allows only non-commercial use of a machine learning model and its outputs. Why even bother...

Hello, why do I need one voice sample in the tortoise auto aggressive fine-tuned model in the voices folder? Why can’t I select just none and will the voice sample affect the quality of the trained voice I mean when you put voice samples in the voices folder after training and selecting the model and wears the prepare a new language tab and how does it work?