Having trouble deploying a Hugging Face model on GCP Vertex AI

I’ve been trying to deploy a model (knowledgator/comprehend_it-base, though it happens with others too), and I consistently get this error:

"The token is not valid or does not have permission."

Here’s what I’ve already tried:

  • Generated multiple access tokens

  • Tweaked permissions

  • Accepted usage conditions (where applicable)

Still hitting the same wall. Not sure if there’s something extra needed between Hugging Face and GCP. Maybe some hidden linking step?

If anyone’s managed to get this working, I’d really appreciate any tips!

1 Like

In the first place, you don’t need a Hugging Face token to download that model, so it’s maybe not a token issue.
I think the error message from Vertex is not reliable except for “there is an error”…

When it comes to this kind of thing, the only way to find out what the real error is is to change the conditions one by one…