Git clone/lfs broken for certain models

I am trying to clone facebook/nllb-200-distilled-600M for integration into a docker container.

But currently the cloning fails with the message:

Cloning into 'nllb-200-distilled-600M'...
remote: Enumerating objects: 46, done.
remote: Total 46 (delta 0), reused 0 (delta 0), pack-reused 46
Unpacking objects: 100% (46/46), 11.02 KiB | 564.00 KiB/s, done.
Downloading pytorch_model.bin (2.5 GB)
Error downloading object: pytorch_model.bin (c266c2c): Smudge error: Error downloading pytorch_model.bin (c266c2cfd19758b6d09c1fc31ecdf1e485509035f6b51dfe84f1ada83eefcc42): [c266c2cfd19758b6d09c1fc31ecdf1e485509035f6b51dfe84f1ada83eefcc42] Object does not exist: [404] Object does not exist

Errors logged to '/home/ubuntu/nllb-200-distilled-600M/.git/lfs/logs/20230705T154626.154570458.log'.
Use `git lfs logs last` to view the log.
error: external filter 'git-lfs filter-process' failed
fatal: pytorch_model.bin: smudge filter lfs failed
warning: Clone succeeded, but checkout failed.
You can inspect what was checked out with 'git status'
and retry with 'git restore --source=HEAD :/'

And the logfile similarly tells me:

git-lfs/3.3.0 (GitHub; linux amd64; go 1.19.3)
git version 2.34.1

$ git-lfs filter-process
Error downloading object: pytorch_model.bin (c266c2c): Smudge error: Error downloading pytorch_model.bin (c266c2cfd19758b6d09c1fc31ecdf1e485509035f6b51dfe84f1ada83eefcc42): [c266c2cfd19758b6d09c1fc31ecdf1e485509035f6b51dfe84f1ada83eefcc42] Object does not exist: [404] Object does not exist

Which is a weird error, as the file can be downloaded manually going through the website, and the SHA matches.

Any ideas on what could be wrong here? I get the same error for other facebook models, but can successfully clone other models.

I got the same issue for Facebook/Meta models only and I fixed it by putting my Huggingface login and password.

git clone https://loggin:pwd@huggingface.co/nllb-200-distilled-600M

1 Like