Hugging Face Forums
Utilizing GPU for ggml model with Langchain
Beginners
Wi1
August 19, 2023, 1:17am
2
Can check out the GPU instrucitons:
https://python.langchain.com/docs/integrations/llms/llamacpp#gpu
show post in topic
Related topics
Topic
Replies
Views
Activity
Fine Tuning GGML model
Beginners
3
3434
September 24, 2023
CUDA convert GUFF to CUDA GUFF
Models
6
183
December 18, 2024
GPU Google Colab not working with langchain
Models
0
544
February 16, 2024
Why I am getting this problem while running any of the GGUF model instead of with .bin model
Models
1
2622
November 7, 2023
NotImplementedError: ggml_type 21 not implemented
🤗Transformers
2
82
September 23, 2024