Is there any tutorial 4 pretrain wav2vec2

Hi, guys!

I was trying to pretrain a wav2vec2 from scratch. However, the loss is continuous remains high and is never reduced.

So I wonder if there is a tutorial for pretrain wav2vec2. Looking forward to your reply.

Regard,
Eilander

1 Like