Question about downloading models on an HPC

🤗Hub
1

Hi,

I’m a staff researchers working a university. We have a High Performance Compute cluster and some faculty would like to have a centralized place where they can download models and datasets to and have their students or other faculty access them. So far, I’ve just been changing where things are downloaded using the cache_dir parameter, but that seems to be causing permissions errors when other users try to access them.

I would love to hear any tips or thoughts you might have. Let me know if you need anymore information.

Thanks,
Peter

2

In my university, I, with the help of the IT team, established a specific directory for huggingface models and datasets, where all students have read access, but only few people have the write access. That way, models and dataset are not deleted by other people, everyone can use the models and datasets, and managing it is up to me and the IT team.