I had same problem,
In tried to copy the tokenizer_config.json file from whisper model output directory to checkpoint directory
Then i load the model from checkpoint directory
It worked form me
I had same problem,
In tried to copy the tokenizer_config.json file from whisper model output directory to checkpoint directory
Then i load the model from checkpoint directory
It worked form me