Hello, I’m currently facing a similar issue to the ones in this conversation. I finetuned LLama3.1 and I’m trying to deploy to sagemaker directly from huggingface, it deploys to endpoint successfully but when I try to call the endpoint, I get an error that the inference script is missing. Is there anyway to attach the inference script to it after pulling from HF?
1 Like