[RESOLVED] Recommended way to use guidance on an Inference Endpoint?

moocow2txt · March 27, 2024, 7:13am

Update: The problem appears to have been on the Inference Endpoints side and now seems to have been resolved: Inference endpoints are now using ghcr.io/huggingface/text-generation-inference:1.4.4 as the default image.

Apologies for the noise.

Topic		Replies	Views
Image-to-image Stable Diffusion Inference Endpoint? Inference Endpoints on the Hub	15	3346	November 29, 2022
TGI container for fine tuned model? Inference Endpoints on the Hub	1	11	August 21, 2025
Image-To-Text task on Inference Endpoint Inference Endpoints on the Hub	13	2350	October 17, 2023
Help with custom handler.py for model inference endpoint Beginners	1	749	February 24, 2024
Custom image endpoint 404 Inference Endpoints on the Hub	0	295	January 24, 2024

[RESOLVED] Recommended way to use guidance on an Inference Endpoint?

Related topics