Hugging Face Forums
Run parallel api inference for QA
🤗Transformers
Mamoon
November 19, 2021, 5:20am
1
How can we handle the parallel request of question-answering using API inference for qa?
Related topics
Topic
Replies
Views
Activity
Having issues with running parallel, independent inferences on multiple GPUs
Beginners
0
234
September 10, 2024
Batched pipeline for Question-Answering
Intermediate
0
557
April 28, 2022
Regarding a Trial Version
Inference Endpoints on the Hub
0
208
April 23, 2024
Execute finetuned QA model in parallel
Intermediate
0
311
September 29, 2022
Inference API response time scales linearly with number of inputs
Beginners
0
263
November 1, 2021