Using transformers (BERT, RoBERTa) without embedding layer

You can find an answer to your question here:
https://github.com/agemagician/ProtTrans/issues/5

1 Like