Getting error while loading model from local path : Exception: expected value at line 1 column 1

[InderV94]

I created a tar file out of a unsloth fine-tuned model(base-model: unsloth/gemma-2b-bnb-4bit) using PEFT and pushed it to gcsBucket. I am downloading the artifacts from gcs bucket, extracting the files and locally saving them into a folder. Now, I am trying to load the model using this local directory path, but getting error : Exception: expected value at line 1 column 1

 model, tokenizer = FastLanguageModel.from_pretrained(
    model_name ='./model',
    max_seq_length = max_seq_length,
    dtype = None,
    load_in_4bit = True,
    local_files_only = True,
  )
 FastLanguageModel.for_inference(model)

How can I load the model from the given directory?

[mahmutc]

@InderV94

I am downloading the artifacts from gcs bucket, extracting the files and locally saving them into a folder.

You might have some issues with this process. Can you please check the size of config.json, tokenizer.json and tokenizer.model:

Exception: expected value at line 1 column 1

[InderV94]

All the model files are of valid size. Interestingly creating a zip and unzipping it back is doing all the magic.If I simply do git clone <huggingface_model_uri> and then provide the local path while loading model it works.