@lewtun Could you help us in this?
Tokenizer.add_tokens automatically convert ESM2 new token to special
We can not extend the embedding layer by adding new tokens using ESM-2 models.
@lewtun Could you help us in this?
We can not extend the embedding layer by adding new tokens using ESM-2 models.