HuggingFace Inference containers are not available in GovCloud (US-East)

Amazon SageMaker
1

Hi Team,

Greetings!!

We are able to access following HuggingFace inference container in GovCloud (US-West) region.

442386744353.dkr.ecr.us-gov-west-1.amazonaws.com/huggingface-pytorch-inference:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04

AWS announced the availability of SageMaker in GovCloud (US-East) region early this year (documentation)

Hence we decided to deploy models on US-East region but we are not able to pull the following inference container in US-East region and getting below error.

442386744353.dkr.ecr.us-gov-east-1.amazonaws.com/huggingface-pytorch-inference:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04

Error: cannot pull 442386744353.dkr.ecr.us-gov-east-1.amazonaws.com/huggingface-pytorch-inference:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04. Ensure that the role exists and the image was granted pull permission.

Please check if {dlc-aws-account-id} is correct or not, confirm when we can access those images in US-East region.

Thanks & Regards,
Vinayak

2

Can you please open an issue in the GitHub - aws/deep-learning-containers: AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet. repository? Thats nothing we (HF) have impact on.

3

Sure, Thanks