Hi,
I am using valhalla/t5-base-qa-qg-hl(valhalla/t5-base-qa-qg-hl · Hugging Face) Text2Text-Generation Model to generate questions from some context. When it comes to inference, I have found that on sagemaker it is only returning one output, while running the model locally the model generates multiple output.
I wanted to get all the model outputs from sagemaker endpoint. I am using the sagemaker api to deploy it there.
Thanks,
Jatin