Deploying Huggingface Sagemaker Models with Elastic Inference

Hello @philschmid,

I read your article https://www.philschmid.de/huggingface-bert-aws-inferentia about hugging face model deployment on inferentia instance (very good and clear btw).

Can this method be used for all model types and all tasks ? I particularly think to Seq2Seq models (Bart, Pegasus, T5) for Summarization task