Number of parameters reduced after loading in 4bit


Why is there a decrease in no of parameters in 4bit?

1 Like

When we load in 4 bit, the linear layers are replaced with linear 4bit layers. These layers have half the number of parameters. But still I am also not clear how number of parameters become half.