As I said, first load it inside a TFWav2Vec2ForXxx model (I’m not sure exactly which model you used, replaced the Xxx to the proper name). You can do this with
TFWav2Vec2ForXxx.from_pretrained(path_to_pytorch_model, from_pt=True)
This model will be a Keras model. You can save it using Keras, so should be able to then load it with Keras.