I have fine-tuned DistilBertForQuestionAnswering model using custom data. And I saved that model in colab. I can load the model as well. I need to know how I can use that loaded model to input a question and get a answer(prediction).

Predicting answers using DistilBertForQuestionAnswering

SathsaraRasantha January 22, 2021, 2:06pm 3

I tried the code in docs. But it gives me a error.

RuntimeError: Input, output and indices must be on the current device

Topic		Replies	Views
Inference with DistilBertForQuestionAnswering 🤗Transformers	2	384	January 22, 2021
Allocation of 93763584 exceeds 10% of free system memory 🤗Transformers	0	1773	July 29, 2022
Need help to give inputs to my fine tuned model Beginners	1	330	December 7, 2021
Issues with Finetuning QuestionAnswer model Beginners	0	360	May 27, 2021
Distilbert. . . Accelerated Inference error Models	0	232	February 22, 2022