Fine tuning T5 Encoder and T5 Decoder separately

Is it possible to create instances for T5Encoder and T5Decoders separately. I would like to fine tune T5Encoder with Masked Lang Objective on company specific dataset and then use it with T5Decoder for text generation.
I have tried and searched exclusively on Huggingface for these classes and/or their documentation but could not find so.