I have found the solution for llama or you can edit for other models
you can use this :
llama-recipes/docs/inference.md at main 路 facebookresearch/llama-recipes 路 GitHub
i have edited some files inside it to load mistral instead of llama
I have found the solution for llama or you can edit for other models
you can use this :
llama-recipes/docs/inference.md at main 路 facebookresearch/llama-recipes 路 GitHub
i have edited some files inside it to load mistral instead of llama