How to convert models microsoft/Phi-3-vision-128k-instruct to GGUF format. One for Windows and macOS (silicon and intel), The original installation method never worked on my end, I needed a more convenient method. interchip machine.
use llama.cpp， for example，python convert-hf-to-gguf.py Qwen/Qwen1.5-7B-Chat --outfile models/7B/qwen1_5-7b-chat-fp16.gguf