Huggingface model for inference in aws sagemaker

Hi:)
I checked the model’s inference value through ‘predictor’ in ‘sagemaker’ as follows.

By the way, what does the ‘score’ in the 13th cell mean?

It is confusing because the value of the score is different according to the context and question.

Also, is there a way to display the decimal point of the ‘score’ to two digits?
I’ve been searching for days but couldn’t find it. Any help would be greatly appreciated!

Hello @Jiiho,

The score is the probability of the answer between 0-1. We are using the question-answering pipeline of transformers: transformers/question_answering.py at v4.19.2 · huggingface/transformers · GitHub

You can modify this by creating your own inference.py and adjust the post-processing of the pipeline

1 Like