Hi huggingface team,
Is there a list of compatible models that work with the
For instance the docs mention
BERT Encoder/Decoder and I think @patrickvonplaten has written some beautiful notebooks using
RoBERTa, but can it be used for models like the
ALBERT? in other words, is something like below possible?
config_encoder = AlbertConfig() config_decoder = AlbertConfig() config = EncoderDecoderConfig.from_encoder_decoder_configs(config_encoder, config_decoder)