We are downloading the model weights for llama2 70b from hugging face and specifying the local cache directory on day 1.In the day 2 when we try to load the model from cache directory it just hangs on there.
More specifically lets say on day 1 I am loading the models and storing in cache dir.Rest of the day it works fine.But after stopping the instance and again starting on day 2 model loading just keeps hanging unless and until we delete the cache directory and load the weights again from huggingface.
How can we get around this problem?