I was able to reproduce the same error here. And it doesn’t happen with “unsloth/Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bit”…
Looking at the Community section, it seems that there is a problem, although the symptoms are different, and in some cases it seems that the problem can be solved by downgrading Transformers.
1 Like