Thanks. Using providers works like magic. Here is the documentation: HF Inference
Sample
client = InferenceClient(
provider="hf-inference",
token=os.environ["HF_TOKEN"])
Thanks. Using providers works like magic. Here is the documentation: HF Inference
Sample
client = InferenceClient(
provider="hf-inference",
token=os.environ["HF_TOKEN"])