Yes, I was able to resolve the issue. I removed my function “input_fn” from the script (this meant that I ended up using “input” func written in sagemaker huggingface inference toolkit). In “model_fn” and “predict_fn”, I added an argument “context=None”. In predict_fn, I modified argument “model_dict” to “model”.