As per the documentation here, link I re-created the predictor object used for inference.
Code Snippet:
from sagemaker.huggingface.model import HuggingFacePredictor
predictor = HuggingFacePredictor(endpoint_name='your-huggingface-endpoint-name')
The issue is resolved now.