Hi huggingface team,
Is there a list of compatible models that work with the EncoderDecoder model?
For instance the docs mention BERT Encoder/Decoder and I think @patrickvonplaten has written some beautiful notebooks using RoBERTa, but can it be used for models like the Reformer or ALBERT? in other words, is something like below possible?
config_encoder = AlbertConfig()
config_decoder = AlbertConfig()
config = EncoderDecoderConfig.from_encoder_decoder_configs(config_encoder, config_decoder)