Could not locate the configuration_hf_nomic_bert.py inside nomic-ai/nomic-bert-2048

Can anyone explain how to resolve this error?
Could not locate the configuration_hf_nomic_bert.py inside nomic-ai/nomic-bert-2048.
I have the configuration_hf_nomic_bert.py in nomic-ai/nomic-bert-2048 folder. nomic-ai folder has nomic-bert-2048 folder and nomic-embed-text-v1.5 folder each with config.json.

I’m experimenting this through remote server and middle man has blocked hugging face for us so I can’t use transformers to save models.

I downloaded the models using download button here. Is there more steps to this setup/saving stage prior to loading models?

Model path is set to local nomic-embed-text-v1.5 folder path.

2 Likes

Do I have to also load bert-2048?

1 Like

For anyone wondering, I just used different embedding model, all-mpnet-base-v2 in my case, and it works fine. I guess this is more of a nomic-bert-2048 model issue.

1 Like

I downloaded the models using download button here. Is there more steps to this setup/saving stage prior to loading models?

That shouldn’t be a problem.
It’s more convenient to do snapshot_download, but it doesn’t make any difference if you download all the files manually.

I guess this is more of a nomic-bert-2048 model issue.

Quite often, there are cases where a model works correctly under the creator, but the model is mistakenly converted to the HF format, and no one points it out, so it remains as it is.
Sometimes, the conversion function is corrected in an upgrade of the HF library, and the next version of the model converted with this function works correctly.
I wonder if that’s what happened this time.