Is hf_transfer still maintained?

🤗Hub
1

The HF Transfer library GitHub - huggingface/hf_transfer is a really neat tool, but it looks like there’s no activity by the owner(s) of the repo since August.
Is there any plan to maintain this library moving forward?

1 Like
2

Ask the person.

@mcpotato Do you have any plans for future maintenance?

3

No clue about library maintenance, feel free to share with me if there are any specific problems you’re facing.
As for an alternative, one of the huggingface fellows developed this neat library inspired by HF transfer

feel free to check it out and let me know if this is a good alternative.

1 Like
4

any specific problems you’re facing

  • this thread started because I opened a PR last week because wheels for hf_transfer does not have a license, and I didn’t see any reaction. Seeing issues and commit history, I then realised it might be abandonware
  • actual problem: download weights faster when calling XYZModel.from_pretrained() (well, I guess I might have stated the obvious, given the one thing hf_transfer does :stuck_out_tongue:). If I were to use firerequests (or write my own tool), I’d be losing the integration with the overall transformers library, and here specifically I mean figuring out which files need to be downloaded for a given model name and revision tags, and where.