Download count for a model deployed as a serverless endpoint


A while ago I finetuned a BERT model, pushed it to the :hugs: hub, and subsequently deployed it as a Sagemaker endpoint with a serverless configuration. I noticed that the download counter on the hub shows quite a lot of downloads (currently around 1600 the last month), even though it’s quite a niche model. So I was wondering: does the serverless endpoint download the model from the hub every time it boots thus increasing the download count substantially?

Did you use the hub configuration with model_id and task? If so yes then everytime the Serverless function is started from a cold start it loads the model

1 Like

I did! And good to know, thanks!

1 Like