Is there any tutorial 4 pretrain wav2vec2

Beginners
1

Hi, guys!

I was trying to pretrain a wav2vec2 from scratch. However, the loss is continuous remains high and is never reduced.

So I wonder if there is a tutorial for pretrain wav2vec2. Looking forward to your reply.

Regard,
Eilander

1 Like
2

@Eilander did you find any solution to this problem? If you have pre trained a model can you please share the code

3

Have you checked out the README here? transformers/examples/pytorch/speech-pretraining at main · huggingface/transformers · GitHub

4

Hi @Eilander did you find what you were looking for? If not, this tutorial might be helpful for you;

1 Like
5

Thanks for sharing amazing tutorial. I face difficulties to find this topic. Thanks

1 Like