How to generate output from a model trained with accelerate?

🤗Accelerate
1

I’ve trained a mt5 model with accelerate. But it only save the model.config file and the pytorch.model file?
How can I generate output from my model without the tokenizer files?
When I try to load the model it gives me the following error.

OSError: Can’t load tokenizer for ‘saved’. Make sure that:

  • ‘saved’ is a correct model identifier listed on ‘Models - Hugging Face’
    (make sure ‘saved’ is not a path to a local directory with something else, in that case)

  • or ‘saved’ is the correct path to a directory containing relevant tokenizer files

2

It looks like you are trying to load the tokenizer for that model, so you need to save it in the same directory (hard to be sure since you are not sharing your code!)

4

Thank you!
My bad. I’ve been trying to train the model without even using a tokenizer :disappointed: