Huggingface model for inference in aws sagemaker

Hello @Jiiho,

The score is the probability of the answer between 0-1. We are using the question-answering pipeline of transformers: transformers/question_answering.py at v4.19.2 · huggingface/transformers · GitHub

You can modify this by creating your own inference.py and adjust the post-processing of the pipeline

1 Like