I don’t know, but I have already successfully used q4 model.
As John6666 said, it seems like HF “Use this model” integration became more “strict” and began to check the name in the model metadata with the name of file\quantization.
2 Likes