Environment Variables now supported on endpoints?

Hey, I was trying to deploy a gated model recently and found it was failing to download the model files, even though I had accepted the user agreement and gotten access on the same account I was trying to deploy from.
I found this ticket here that described a similar problem.

This morning I noticed a spot for environment tokens in my endpoint, wondering if this is purely coincidence. Env variables seem to be supported, but I couldn’t find an announcement or docs.

Thanks!

Hi @Frase! :hugs: This is a new feature we just added to Inference Endpoints. Let us know if you have any questions or feedback!

So awesome and coincidental! Thank you! It’s super helpful and works as I’d expect it to.

1 Like