Hi there,
I was trying to download defog/sqlcoder models. I was able to successfully load it:
"
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained(“defog/sqlcoder-7b-2”)
model = AutoModelForCausalLM.from_pretrained(“defog/sqlcoder-7b-2”)
"
But when I try to save the model, it gives errors. I checked with official defog page and got suggestion to raise it here since there seems to be some issue in transformers library. Can you please help. Thanks
Can you please showcase which error you’re getting?
There is no verbose error. I when I execute line “model.save_pretrained()”. it says “killed” on terminal. Thats it
This might be an issue related to your environment, perhaps you’re constrained on memory.
Note that calling model = AutoModelForCausalLM.from_pretrained(“defog/sqlcoder-7b-2”) requires about 14GB of space on your disk.
Could you try this on Google Colab and see if the same error occurs? If not, then it’s related to your machine.
Hi @nielsr. Yes I do have enough mem space. I did try saving a model of similar size and it did save it successfully. Not sure why this happened. I am using RTX4090 card