After finetuning, i’m not able to save a config.json file using trainer.model.save_pretrained My pip install: !pip install torch datasets !pip install -q accelerate==0.21.0 peft==0.4.0 bitsandbytes==0.40.2 transformers==4.31.0 trl==0.4.7 Model code: model_name='meta-llama/Llama-2-7b-chat-hf' mo…

Config.json is not saving after finetuning Llama 2

hemanthkumar23 May 1, 2024, 2:15pm 5

Can you please elaborate?

Guide/Tutorial to write an inference endpoint for custom models