How to convert the new t5x models to huggingface transformers

🤗Transformers
4

You should be able to just load it into PretrainedTokenierFast:

from transformers import PreTrainedTokenizerFast

tok = PreTrainedTokenizerFast.from_pretrained("/path/to/your/trained/tokenizer/directory")
tok.push_to_hub("/url/to/your/repo")