Run parallel api inference for QA

Mamoon November 19, 2021, 5:20am 1

How can we handle the parallel request of question-answering using API inference for qa?

Topic		Replies	Views
Batched pipeline for Question-Answering Intermediate	0	559	April 28, 2022
Inference API detailed request Beginners	5	2316	September 11, 2020
Batch (List of Prompts) for Inference Client feature Intermediate	0	237	November 9, 2023
RAG Class for Question Answering 🤗Transformers	0	431	October 22, 2020
Execute finetuned QA model in parallel Intermediate	0	318	September 29, 2022