Hi! I’m trying to use the Huggingface Inference Toolkit with a pipeline using the guide below :slight_smile: : [image] GitHub - aws/sagemaker-huggingface-inference-toolkit Contribute to aws/sagemaker-huggingface-inference-toolkit development by creating an account on GitHub. …

HuggingFace Inference Endpoints: Pipeline Args

Dnsibu January 22, 2024, 8:36pm 6

Did you ever solve this issue? I’m facing the same problem

Topic		Replies	Views
Inference Hyperparameters Amazon SageMaker	29	4839	October 8, 2021
Hugging Face inference API Model cards	0	776	June 20, 2022
Bug? Pipeline is discarding some of the predictions 🤗Transformers	0	89	March 26, 2024
Deploy named entity recogintion model to sagemaker grouping Amazon SageMaker	1	765	September 7, 2022
How are the inputs tokenized when model deployment? Amazon SageMaker	13	4278	September 3, 2021