Hugging Face Forums
Guide/Tutorial to write an inference endpoint for custom models
Inference Endpoints on the Hub
codewithRiz
October 19, 2024, 6:54am
6
this help me to create some custom handler.py file for my project whis is not in pure transformer
show post in topic
Related topics
Topic
Replies
Views
Activity
Help with custom handler.py for model inference endpoint
Beginners
1
745
February 24, 2024
Requirements for Hosting LLM via Inference Endpoints
Inference Endpoints on the Hub
2
49
June 13, 2025
Model won't load on custom inference endpoint
Inference Endpoints on the Hub
2
361
June 13, 2024
Creating inference endpoint with custom handler - is this how it should work?
Beginners
5
2322
November 27, 2022
Issue with Deploying LoRA-adapted Model on Hugging Face Endpoint
Beginners
10
129
April 26, 2025