I ran into the same issue, everyone is and they don’t know why. I need to present my final project in 1 day and only found out tonight my model is not working. I am paying something like 0.06$ an hour to have it deployed through Inference Endpoints on AWS.. apparently this is the only solution..
1 Like