Finetuning Wav2Vec2 on TPU

🤗Transformers
1

I am planning to finetune a Wav2Vec2-XLSR-53 on a newly generated speech dataset. Are there any example scripts on how to finetune Wav2Vec2 on TPUs? I do find some PyTorch examples but these are for GPUs only.

I would prefer using Flax for this but the only scripts I am able to find is for pretraining.

2

Hi. Were you able to finetune it with TPUs? I’m working on it now and it’d be great help to find some resources.

3

Sorry. This project was delayed. I have not tried this yet. Hopefully, I will look into it soon.