Batch_transform Pipeline?

Amazon SageMaker
8

As the errors says you need to adjust AssembleWith to be the same.
=>

# create Transformer to run our batch job
batch_job = huggingface_model.transformer(
   instance_count=1,
   instance_type='ml.g4dn.xlarge',
   output_path=output_s3_path, # we are using the same s3 path to save the output with the input
   accept="application/json",
   assemble_with="Line",
   strategy='SingleRecord')

You can find the documentation here Transformer — sagemaker 2.198.0 documentation

  • assemble_with ( str ) – How the output is assembled (default: None). Valid values: ‘Line’ or ‘None’.
1 Like