AI to Convert Any Voice to a Specific Voice

Intermediate
1

Hey, everyone! How’s it going?

Lately, I’ve been exploring artificial intelligence used to create music, separate instrumentals from songs, among other things. Because of that, I became interested in training my own AI, where the main idea is for it to receive an audio input (preferably vocals only) and transform the input voice into a fixed target voice.

I work in data science, but my focus has been mostly on natural language models, so I wanted to see if there’s anyone willing to give me some tips about the audio field, haha

  1. What are the most commonly used models in this area?
  2. When training the model, would it be ideal to generate a dataset with the target voice in various scenarios, or could I limit it to just a “spoken” dataset, for example?
  3. Any tips?

Thanks in advance!

1 Like
2

If it’s text to voice, I think RVC2 is the most major one.
There are all sorts of resources on external sites.

I’m not too familiar with voice changer systems, but I think it’s in the collection. What’s the name of the model…?
Well, if you find a space with a similar purpose and look in requirements.txt, you should be able to find it.

But be aware that many of the voice-related libraries are from the last year. Build errors tend to occur quite often.

1 Like
3

So, I’m not very familiar with voice-changing systems either. What I’m testing are online software tools, like Suno and Moises. From using them, I became interested in practicing some finetuning in this area.

And thank you very much for your response, @John6666

4

This is the most common voice cloning I see at HF.

And also this.

RVC

applio

I think there was another…

BTW, I’ve used Suno too, but I guess I can’t match that guy’s performance…
Maybe they’ll catch up soon, but not yet.

By the way, if RVC-related models can be diverted, there is a lot of data lying around on the Internet, from animation to singers, like this.

1 Like
5

Now with all these places for me to check out, I’ll probably be able to explore a lot o/

I really appreciate it, this will definitely help!
And that guy, Suno, is out of this world. But getting something 30% close to that is already excellent.

1 Like
6

I’m glad I could be of some help!

EXTRAS for you. nightmare stage.

1 Like
7

I you want to convert your voice into ai voice the audiomodify.com is the best website. In which you can change your voice into another singer voice

1 Like
8

That sounds like an awesome project! For voice transformation, models like Wave Net or Tacotron work great. For training, a varied dataset helps, but starting with just a spoken dataset can work too. Just make sure to refine it as you go for better results. Good luck!

1 Like
10

Thank you mate! I’ll sure take a look

11

Thank you, Dylan! It really is a very interesting project, and looking back today, there are a lot of resources to test and see what can make my life easier haha

1 Like
12

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.