Deploying T5-style models via Sagemaker Endpoint: 'T5LayerFF' object has no attribute 'config'

msuppaslido · October 28, 2022, 2:17pm

Would you happen to know where would one need to place this requirements.txt file? I do not seem to be able to find a configuration option in the HuggingFaceModel that would allow me to pass its location on its instantiation or deployment but I might have very easily missed something

Topic		Replies	Views
Getting error in the inference stage of Transformers Model (Hugging Face) 🤗Transformers	0	783	October 11, 2022
How to deploy a T5 model to AWS SageMaker for fast inference? Amazon SageMaker	13	5795	February 28, 2022
Calling Sagemaker Endpoint for fine-tuned summarization model Amazon SageMaker	15	5080	March 22, 2024
ModelError when deploying google/flan-t5-xl Amazon SageMaker	1	448	July 31, 2023
Help for inference.py code Amazon SageMaker	10	4003	March 8, 2022

Deploying T5-style models via Sagemaker Endpoint: 'T5LayerFF' object has no attribute 'config'

Related topics