When trying to use Huggingface estimator on sagemaker, Run training on Amazon SageMaker e.g. # create the Estimator huggingface_estimator = HuggingFace( entry_point='train.py', source_dir='./scripts', instance_type='ml.p3.2xlarge', instance_count=1, role=role…

I published a repo that shows how you can extend the existing HF DLCs in order to use transformers versions higher than 4.17.0. The repo shows how to extend the Inference Container, but the same applies to the Training DLC. Hope that helps! [image] GitHub - marshmellow77/sm-extend-contain…

Huggingface / Pytorch versions on Sagemaker

Amazon SageMaker

alvations December 20, 2022, 9:41am 11

Thank you for the share. Great job on the blogpost!

Topic		Replies	Views
Transformers 4.6.0 on SageMaker? Amazon SageMaker	14	4641	September 9, 2022
Highest Transformer vers. that works with Sagemaker? Amazon SageMaker	2	503	September 1, 2021
How is transfomers_verion and pytorch_version determined Amazon SageMaker	1	3059	November 9, 2022
Sagemaker Huggingface Transformers support: New updates? Amazon SageMaker	1	2075	November 3, 2022
Transformer Version train vs. Sagemaker Amazon SageMaker	1	321	September 14, 2021

Huggingface / Pytorch versions on Sagemaker

Related topics