Shared cache-dir licensing

I am working with a supercomputer cluster where several different research groups are working on ML research. As many are using the transformers library to load pretrained models it would be very beneficial if it were possible to use a centrally shared cache_dir on the cluster. However, then the question is with regards to licensing.

What legal considerations have to be made with respect to licensing, copyright etc. if one would share the cache_dir? Does this count as redistribution and is then a separate question regarding the license for each and every model that you host?