Hi, for inference I created a deployment on AWS which is working fine when used for summarization It works fine on some texts, but as soon as I use a particular long text I get an error and I am not able to run any summarization taks again, even the ones with short input texts are no longer workin…

Sagemaker HuggingFaceModel crashed with CUDA error

philschmid May 17, 2023, 12:35pm 2

Topic		Replies	Views
Hugging Face BART Text Summarization Model-Sage Maker deployed after a month giving me an 400 error Models	1	574	May 2, 2023
CUDA error for inference on GPU instance Amazon SageMaker	2	749	May 16, 2023
GPT-J fails on Amazon Sagemaker Models	2	1289	July 21, 2022
Getting error in the inference stage of Transformers Model (Hugging Face) 🤗Transformers	0	766	October 11, 2022
ClientError:400 when using batch transformer on sagemaker for inference Amazon SageMaker	3	2023	January 11, 2022