Is the Adapters library compatible with custom transformers?

I have a custom PreTrainedModel PyTorch transformer model. The custom transformer class is just a call to the PyTorch Transformer object. Is there any way to use adapter-Transformers with this, or do I need a supported model?

Thank you