Hugging Face Forums
Inference Toolkit - Init and default template for custom inference
Amazon SageMaker
ujjirox
October 4, 2021, 7:21am
8
Gotchu. I figured that’s what you meant a couple minutes later.
Deploying TinyLlama Model via SageMaker Inference Endpoint with Custom Setup
show post in topic
Related topics
Topic
Replies
Views
Activity
Help for inference.py code
Amazon SageMaker
10
3971
March 8, 2022
Inference Toolkit - custom inference with multiple models
Amazon SageMaker
1
620
April 4, 2024
Deploying custom inference script with llama2 finetuned model
Amazon SageMaker
6
1220
January 4, 2024
Infer on sagemaker with custom pipeline
Amazon SageMaker
2
498
September 14, 2023
Loading inference.py separately from model.tar.gz
Amazon SageMaker
4
1796
June 5, 2023