Hi, I have recently deployed the FinBERT model in SageMaker, and I am using it for inference in a text classification task. When I call the predictor.predict(data) I get only the label and probability of the predicted one (the one with the maximum value), but I am missing the ones for the other cla…

Missing likelihood for all the classes in inference after BERT model deployed in SageMaker

dineshmane June 15, 2022, 1:06pm 2

Did you find the solution?

Topic		Replies	Views
Return all class labels from SageMaker invoke_endpoint Amazon SageMaker	8	1545	January 22, 2022
Facebook/bart-large-mnli inference when deployed on SageMaker Amazon SageMaker	1	1086	April 29, 2022
Sagemaker Huggingface zero shot classification with candidate_labels in predict method Amazon SageMaker	2	1882	June 16, 2022
How to use fine tuned Hugging face model saved at S3 at inference time? Amazon SageMaker	1	5094	May 4, 2022
About the Amazon SageMaker category Amazon SageMaker	25	4102	August 5, 2021