How can I send the infer data to a roberta endpoint?

skelnlp July 27, 2022, 4:04pm 1

Hi,

I have a roberta http endpoint deployed as a Seldon Core Deploymen (see [HuggingFace Server — seldon-core documentation]), how can I send the context and question to it?

Topic		Replies	Views
Error Deploying Private Endpoint Inference Endpoints on the Hub	2	221	October 23, 2023
Sending System and User Prompt in Deployed endpoint Beginners	3	329	November 17, 2023
Is it possible to have streaming responses from inference endpoints? Inference Endpoints on the Hub	6	1328	July 24, 2023
Inference endpoint data privacy Inference Endpoints on the Hub	5	1896	April 17, 2023
How do Inference Endpoints fit into larger solution? Inference Endpoints on the Hub	0	303	June 17, 2023