Replay is software (and it's free!) that allows you to replace vocals using voice models. It's one of the ways people use to make AI covers. It's fun to play around with, and I've done that before using Hololive voice models (just be sure you are clearly stating that it's not the real thing).
But I've always wanted to train my own voice and create my own voice model! The problem was, when I looked into it, it all seemed so complicated and I'm just very stupid. However, Replay has added (beta) feature to Train Your Own Model! Cool! So I did that, training it on about 10 minutes worth of me narrating something -- this was a recording I had done a few years ago.
I tested it by swapping my voice in using an example where Microsoft AI TTS read some news. It really does sound like me! Next, I wanted to see how I sounded singing. So I created clips using Synthesizer V Xuan Yu and Jun as the base vocals and I compared that to my actual singing voice.
I could tell that it was my voice, but the thing is, my talking voice is not the same as my singing voice. What I want to do next is train a voice model using clips of me just singing. I'll have to generate isolated stems from early recording projects for that.
7 май 2024