Quantization using GPTQ

Beginners
1

I am trying to run the GPTQ code, but this error shows up ever time!

RuntimeError: “cholesky_cusolver” not implemented for ‘Half’’

1 Like