Thanks for the ping, @John6666
@johntzwei we’ve seen that error crop up when information in the xet cache (held underneath the huggingface cache) is removed/not properly downloaded in the first place and then the download resumed.
However, this should be addressed in recent releases of hf-xet - when you do a pip freeze | grep hf-xet on the machine where this is running, what do you see? If it’s below 1.1.4 I would suggest upgrading with pip install -U hf-xet and seeing if that helps.
Of note is that more recent versions of hf-xet also provide stronger protection against the xet cache expanding like what you saw.
If upgrading doesn’t help and you’re still experiencing issues, please open an issue at this link so we can gather more information and dig into the issue. Thank you!