There are different Deep Learning Containers available with different combinations of PyTorch and Transformers, see here.
That being said, if you require a specific version for torch and/or transformers and it’s not available in that list you can provide a requirements.txt file and specify a specific version number. See also this post, hope that helps.