Batch_transform Pipeline?

Hey @marlon89,

Currently, does Batch transform doesn’t support multi-model endpoints. But what you could do is create a customer inference.py which contains two models and runs prediction against both.
Or you could use something like SageMaker Pipelines, AWS Lambda function to create an automated pipeline that takes care of it so you don’t need to run your batch transform jobs.

Or you could add wait=False to batch_job.transform which tells the SDK not to wait until the job completes and your jobs would run in “parallel”.

The probably easiest way to start and automate is to create an AWS Lambda function with a cloudwatch trigger (run every week on day X) and start your batch transform jobs with it.

1 Like