Hi, I am interested in deploying a HuggingFace Model on AWS SageMaker. Let’s say for example I deploy “google/pegasus-large” on AWS. You have very generously given the code to deploy this shown below. I was wondering if, as part of the predict function we have additional arguments. I would like to …

Inference Hyperparameters

ujjirox September 2, 2021, 1:54pm 6

@philschmid Thank you very much! I’ll leave you in peace!

Topic		Replies	Views
Predict function ignore parameters Amazon SageMaker	8	1172	January 28, 2022
How are the inputs tokenized when model deployment? Amazon SageMaker	13	4278	September 3, 2021
How to deploy a T5 model to AWS SageMaker for fast inference? Amazon SageMaker	13	5795	February 28, 2022
Deploying Open AI's whisper on Sagemaker Amazon SageMaker	54	16200	April 12, 2024
About the Amazon SageMaker category Amazon SageMaker	25	4102	August 5, 2021