Sorry for the newbie question. Where does the meaning of “bnb” in Finetune-opt-bnb-peft.ipynb come from? I couldn’t figure it out by looking at the source code.
Perhaps it comes from the author’s name “Benjamin Bossan”?
It comes from the name of the library ‘bitsandbytes’ (GitHub - TimDettmers/bitsandbytes: 8-bit CUDA functions for PyTorch) that implements (among other stuff) 8bit quantization
Sorry I’m a newbie in this field. Thank you.