Got suspicious following @philschmid 's comment, so I ran his deployment code as is, and got the same error. Then changed the model to msmarco-distilbert-dot-v5 and used the same inference.py file to override the functions.
All deployed now and no errors. Possibly some issue with MiniLM configuraiton.
Thanks for the help everyone! The references were extremely helpful