ERROR | Expected a cuda device, but got: cpu
|
|
1
|
427
|
January 1, 2024
|
Cannot Setup Mixtral Models and Other Models on Inference Endpoints
|
|
1
|
321
|
December 22, 2023
|
504 Gateway Time-out in Inference Server Endpoints
|
|
6
|
587
|
December 21, 2023
|
Truncated output on mistralai/Mistral-7B-Instruct-v0.1
|
|
4
|
1140
|
December 21, 2023
|
Deploying CLIP-Vit as an inference endpoint
|
|
1
|
221
|
December 20, 2023
|
Stuck Inference endpoint
|
|
1
|
238
|
December 14, 2023
|
Difference between python and rust token size
|
|
0
|
135
|
December 13, 2023
|
Model Deployment Error
|
|
0
|
150
|
December 12, 2023
|
Unable to start inference endpoint: not enough hardware capacity
|
|
6
|
811
|
December 12, 2023
|
Issue with Salesforce/blip-image-captioning-large Endpoint: "input_ids or inputs_embeds" Error
|
|
1
|
317
|
December 12, 2023
|
General Automation Chat: Explorando las Fronteras de la Automatización Conversacional
|
|
0
|
137
|
December 12, 2023
|
I am facing errors when using my endpoint
|
|
4
|
494
|
December 11, 2023
|
Endpoint usage and cost stays at 0$
|
|
0
|
160
|
December 9, 2023
|
Image-segmentation pipleline seems broken
|
|
1
|
159
|
December 7, 2023
|
Getting no config error while creating inference endpoint
|
|
0
|
155
|
December 5, 2023
|
Key Error when trying to deploy inference endpoint
|
|
2
|
531
|
December 3, 2023
|
Feature Suggestion! running large gguf models!
|
|
0
|
414
|
December 3, 2023
|
Cannot create new endpoints: WebserverFailed
|
|
1
|
535
|
November 30, 2023
|
Unable to generate more than one token at a time using website API
|
|
1
|
242
|
November 29, 2023
|
Formatting Inference API call for LLama 2
|
|
3
|
7332
|
November 23, 2023
|
Stuck starting inference model
|
|
6
|
1544
|
November 23, 2023
|
(Tips) Optimizing Underutilized Resources
|
|
0
|
179
|
November 15, 2023
|
LLAMA2 70b Inference api stuck on currently loading
|
|
3
|
628
|
November 14, 2023
|
Inference Endpoint Failure - Error: "Shard 0 failed to start"
|
|
0
|
438
|
November 14, 2023
|
Llama 2 Inference Endpoint Stop Working
|
|
1
|
220
|
November 14, 2023
|
Serving AWQ models without a custom container
|
|
2
|
204
|
November 13, 2023
|
How to Query the Progress of Inference on a Custom Endpoint Handler?
|
|
1
|
383
|
November 10, 2023
|
Model working on free api but not on paid one
|
|
0
|
200
|
November 9, 2023
|
https://huggingface.co/LegacyAI/VT/blob/main/handler.py
|
|
0
|
126
|
November 9, 2023
|
ModuleNotFoundError: No module named 'cv2'
|
|
1
|
813
|
November 8, 2023
|