Hi all,
Is anyone aware of plans to implement deBERTa v3 as a distinct model in HuggingFace in the same way that the original deBERTa and deBERTa-v2 have been implemented?
I am aware that there are pretrained v3 models that can be finetuned, but I am interested in training from scratch as this model seems to be a significant improvement on previous iterations (especially the RTD mechanism for training).
1 Like