Hi, I finetuned a BERT model on AWS EC2 (i.e. not on SageMaker), and would like to use the resulting model in a Sagemaker Pipeline that ultimately does a BatchTransform step. I’ve saved the model as a pt file and added it to a tar.gz archive, but get an error when I try to use it for inference. I’…

[image] bluePenguin: tar -czf model_try_429.tar.gz outputs_429/ I suspect that this tar command is incorrect: You seem to zip the directory instead of the files, which would mean that the structure of your file will be incorrect. The file name HAS to be model.tar.gz, as far as I know. Ins…

Use my finetuned Bert Model in SageMaker BatchTransform

Amazon SageMaker

bluePenguin April 30, 2022, 12:57am 5

@marshmellow77 That fixed it, thank you so much!

Topic		Replies	Views
Create a batch transform job with custom trained biobert model Amazon SageMaker	15	2096	February 22, 2022
Error deploying BERT on SageMaker Amazon SageMaker	20	5356	April 1, 2025
Sagemaker/mms/models/model does not appear to have a file named config.json Amazon SageMaker	4	5403	August 31, 2023
SageMaker Inference for Model Tuned Elsewhere Amazon SageMaker	4	1095	September 2, 2021
How to Create Model in SageMaker Console from .tar.gz Amazon SageMaker	7	10469	March 10, 2022

Use my finetuned Bert Model in SageMaker BatchTransform

Related topics