What is the difference between gptqConfig and bitsAndBytesConfig

abhi40308 August 27, 2023, 6:30am 1

Wanted to understand the difference between GPTQConfig and BitsAndBytesConfig

1 Like

Topic		Replies	Views
Diff between GPTQ and NF4 with bitsandbytes 🤗Transformers	0	1243	August 1, 2023
Whats the difference between QLoRA and autoGPTQ? 🤗Transformers	0	533	August 13, 2023
Configuring Group Size for BitsAndBytesConfig 🤗Transformers	0	81	June 23, 2024
4-bit quantization Intermediate	0	457	November 18, 2023
Correct Usage of BitsAndBytesConfig 🤗Transformers	4	28617	March 18, 2023