Different Summary Outputs Locally vs API for the Same Text

kmfoda · December 3, 2021, 9:08am

Hey @philschmid thanks for your response. I’ve experienced this issue with the hosted inference API but suspect it might be the same with Amazon SageMaker as well they both use the pipeline model if I’m not mistaken?

Topic		Replies	Views
Pipeline vs model.generate() Beginners	11	14111	July 16, 2025
Difference API results and local transformer results Beginners	0	457	February 18, 2023
Summariser pipeline giving different results on same model with fixed seed Intermediate	0	871	August 17, 2022
Summarization pipeline 🤗Transformers	0	198	October 17, 2023
Sagemaker HuggingFaceModel crashed with CUDA error Amazon SageMaker	3	1260	February 20, 2025

Different Summary Outputs Locally vs API for the Same Text

Related topics