Does a pinned model get automatically updated?

Inference Endpoints on the Hub
1

When we push a model to a repo, and we have a pinned model on that repo, does the pinned model get updated automatically and immediately?

2

No, the endpoint is not automatically updated when you push a new revision.

We are working on adding the „revision“ to the update capabilities to have seamless, rollback tolerant updates of model revisions.

This would allow you to easily update the endpoint with using the HTTP API and a webhook for example when you upload a new model.

3

Thanks for the response @philschmid. So just to make sure I’m 100% clear: at present we would need to manually unpin and re-pin the model after each update to the repository?

4

Ah no i see that we can specify pinned models in an API call here: Detailed usage and pinned models

5

What do you mean with up-pinand pin? Are you talking about the Inference Endpoints

6

I mean the Accelerated Inference API: Dashboard - Hosted API - HuggingFace

7

For clarity if people stumble on this thread:

  • the Inference API is a free service for the community to test and evaluate models on the Hub, it works on shared infrastructure and is rate limited. It used to be a paid solution, with the ability for users to “pin models” to avoid load times.
  • Inference Endpoints is a new paid service designed for production use cases, where models are deployed on dedicated infrastructure. There is no concept of “pinning models” as each created endpoint is created from scratch for/by the customer with its own compute resources.

By the way @mattupson the HF Inference Endpoint CLI tool is super cool thanks for building it!

8

Yes it will great if the pinned model get updated when a new version of the model in the repo is pushed!

1 Like
9

As far as I understand, with HF inference endpoint, If i want to update a running endpoint with another version of the model i need to create a new endpoint, and delete the old one after I’ve made the transition.
In my case the request endpoint URL needs to be the same. My Sentiment Analysis API model will be integrated in a forum. It is not possible to modify URL endpoint each time we push a new version. How i can handle this?
Thanks for your help