you need to resize the token vocabulary in the model.
model.resize_token_embeddings(len(tokenizer))
1 Like
you need to resize the token vocabulary in the model.
model.resize_token_embeddings(len(tokenizer))