Hugging Face Forums
Run parallel api inference for QA
🤗Transformers
Mamoon
November 19, 2021, 5:20am
1
How can we handle the parallel request of question-answering using API inference for qa?
Related topics
Topic
Replies
Views
Activity
Batched pipeline for Question-Answering
Intermediate
0
558
April 28, 2022
Batch (List of Prompts) for Inference Client feature
Intermediate
0
236
November 9, 2023
Inference API detailed request
Beginners
5
2290
September 11, 2020
Inference API (serverless)
Beginners
0
122
May 29, 2024
Execute finetuned QA model in parallel
Intermediate
0
315
September 29, 2022