I took part in the Wav2Vec2 fine-tuning week for Spanish, this is my forum post. My model card describes some of the pre-processing and training steps I took.
It would be awesome to create a pretrained model using Jax/Flax. I’m not sure I’ll have the time to take part in this one (I already signed up for a different project, and I know nothing about Jax), but I’ll try to follow your discussions if I can. Good luck!