Hello All, Is it possible to use LoRa fine-tuning directly on a an existing AWQ (e.g. casperhansen/mistral-7b-instruct-v0.1-awq ) model?
No it is currently not possible , but i think it is possible for GPTQ.
Hello All, Is it possible to use LoRa fine-tuning directly on a an existing AWQ (e.g. casperhansen/mistral-7b-instruct-v0.1-awq ) model?
No it is currently not possible , but i think it is possible for GPTQ.