Newbie question - is it possible to run a GGUF with the serverless API and if so, how do I configure the config.json to make it work?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| chatglm3-6B mode .gguf file download | 0 | 145 | June 11, 2024 | |
| Fine tuning gguf models? | 1 | 1440 | April 30, 2024 | |
| Hugging Face GGUF Models now supported in RecurseChat | 0 | 223 | May 30, 2024 | |
| Why I am getting this problem while running any of the GGUF model instead of with .bin model | 1 | 2629 | November 7, 2023 | |
| GPT4all in a personal server to be access by many users | 0 | 926 | September 19, 2023 |