DistilBERT for Donut Decoder

bgsuello March 29, 2023, 12:12pm 1

Hello, is it possible to use DistillBERT for Donut decoder instead of the default MBART?

Topic	Replies	Views
Distilbert Multlingual Uncased Models	264	September 28, 2020
Does donut suite for document struct? Beginners	157	July 14, 2023
Distillation code works on TPU? Intermediate	275	October 19, 2020
Commercial packager for BB3? Beginners	180	December 8, 2022
Is there a room lower that deals with nonuncoders? Beginners	137	April 29, 2023