I am training Falcon model for QnA task and I want to use it for medical QnA but while traning I got the following error I also tried installing bitsandbytes version mentioned below and I am srtill facing the same issue can anyone suggest a better idea? How to resolve this error training_args = t…

Resolving "Cannot Perform Fine-Tuning on Purely Quantized Models" Error in Falcon Model Training?

shubhankarwcte May 9, 2025, 9:21am 5

yess, its working now

1 Like

Topic		Replies	Views
Using Trainer class + 4/8 bit quantised model for prediction 🤗Transformers	1	253	August 22, 2025
"You cannot perform fine-tuning on purely quantized models." error in LoRA model training? 🤗Transformers	3	2743	August 16, 2024
Evaluating with quantized model using Trainer Beginners	1	291	August 10, 2024
Peft Model For SequenceClassification failing _is_peft_model Beginners	0	924	February 11, 2024
How to do classification fine-tuning of quantized models? 🤗Transformers	0	486	February 2, 2024