I am using the "bhadresh-savani/bert-base-go-emotion’ via AWS Sagemaker on inferentia instance. The model card specifies an additional parameter return_all_scores which should return the scores for all seven emotions. This works out of the box with the huggingface transformer library, the Inference…

Emotion Model: Additional inference parameter not processed in Sagemaker inferentia instance

philschmid July 17, 2023, 7:11am 2

the inference.py is not having that parameter you need to update your inference.py to be able to return all scores.

1 Like

Topic		Replies	Views
Emotion Model: Additional inference parameter not processed in Sagemaker Amazon SageMaker	4	1214	June 28, 2022
Return all class labels from SageMaker invoke_endpoint Amazon SageMaker	8	1545	January 22, 2022
Huggingface model for inference in aws sagemaker Amazon SageMaker	1	661	May 30, 2022
AWS Deploy - Bert-Base-Uncased-Go-Emotion 🤗Transformers	0	251	January 31, 2022
Deploying Huggingface Sagemaker Models with Elastic Inference Amazon SageMaker	21	4223	November 8, 2022