Is it possible to download all these file offline and then used it. Rather than downloading in cache? I’m a beginner.
torch.manual_seed(4)
tokenizer = GPT2Tokenizer.from_pretrained("facebook/opt-13b", use_fast=False)
model = OPTForQuestionAnswering.from_pretrained("facebook/opt-13b", torch_dtype=torch.float16).cuda()