Secrets for custom inference endpoint?

Inference Endpoints on the Hub
1

I am in the process of creating an inference endpoint of a gated model.

I went through the documentation but could not find a secure way of passing an authentication token to the custom handler.

It seems that secrets and environment variables are only available in spaces, but not in inference endpoints.

Here is a link to my custom handler and to the corresponding space that works fine thanks to a secret.

I could hard code the token and make the model private to avoid leaking the token but that does not seem right.

Any suggestion?

1 Like
2

Secrets in Inference Endpoints are not available yet, but they’re on the roadmap

1 Like
3

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.