To use the latest version of the transformers library in a SageMaker DLC you don鈥檛 have to provide a custome inference script, just a requirements.txt file with a line that says transformers==4.23.1
The DLC will then install/update to the specified transformers version. Not entirely sure if that will solve your issue but it鈥檚 alway good to at least try it out with the latest version 