As for me, a proper temporary workaround is
git config --add lfs.url "https://huggingface.co/NickKolok/repo_name.git/info/lfs"
Taken here: Files get skipped, repository or object not found. 路 Issue #1151 路 git-lfs/git-lfs 路 GitHub
Still looks like git-lfs is a scam.