Shard Cannot Start/Inference endpoint error while deployment

When I try to deploy my model (Distilbert/distilgpt2) which I finetuned on my custom dataset using Inference Endpoint it throws an error: “Shard Cannot Start” because of which deployment of model stops. But when I try to deploy an untrained model (which is not finetuned), it easily gets deployed.

1 Like

Hi @shruti91 Has the endpoint already been deleted? Can you try deploying the endpoint once more? We can take a look if you continue running into issues.

1 Like