Run parallel api inference for QA

Mamoon November 19, 2021, 5:20am 1

How can we handle the parallel request of question-answering using API inference for qa?

Topic		Replies	Views
Batched pipeline for Question-Answering Intermediate	0	560	April 28, 2022
Inference API detailed request Beginners	5	2356	September 11, 2020
Batch (List of Prompts) for Inference Client feature Intermediate	0	239	November 9, 2023
Execute finetuned QA model in parallel Intermediate	0	320	September 29, 2022
RAG Class for Question Answering 🤗Transformers	0	463	October 22, 2020