(training takes place on a CPU Basic 16 GB RAM) I tried reinstalling CUDA, installing bitsandbytes (different versions). I tried to train the model on different datasets with different parameters, but the error remains
AutoTrain can be used even with free CPU space (although it’s very slow), but the quantization library bitsandbytes can basically only be used with a GPU.
Perhaps you are trying to train a model that has been quantized with bitsandbytes or trying to train QLoRA. That’s not possible with free CPU space.