Save_pretrained() on tokenizer does not generate a tokenizer.json file

[mahmutc]

hi @Akirami
Can you please share your code snippet? I don’t know if you need something similar to the following but for tokenizer rather than model.

How to create a config.json after saving a model

You need to subclass it to have the save_pretrained methods available. So instead of class Mean_Pooling_Model(nn.Module): use from transformers.modeling_utils import PreTrainedModel class Mean_Pooling_Model(PreTrainedModel): It will add extra functionality on top of nn.Module.