Spot instances with Sagemaker batch transform?

not possible today. If you want to use Spot for inference, you can write inference code as a custom python script and run inference in the Training API / HuggingFace Estimator :slight_smile:

2 Likes