Download count for a model deployed as a serverless endpoint

Amazon SageMaker
1

Hi!

A while ago I finetuned a BERT model, pushed it to the :hugs: hub, and subsequently deployed it as a Sagemaker endpoint with a serverless configuration. I noticed that the download counter on the hub shows quite a lot of downloads (currently around 1600 the last month), even though it’s quite a niche model. So I was wondering: does the serverless endpoint download the model from the hub every time it boots thus increasing the download count substantially?

2

Did you use the hub configuration with model_id and task? If so yes then everytime the Serverless function is started from a cold start it loads the model

1 Like
3

I did! And good to know, thanks!

1 Like