We fine-tuned the GPT2Model (distilgpt2) some time ago. Due to tool vulnerability issues, we have to upgrade transformers 4.48.0 or above. However, the exact same GPT2 model produces different outputs for the exact same input after the upgrading. It seems to me that the masked portion of the model o…

Perhaps this? SDPA is now default attention. [`GPT2`] Add SDPA support (#31172) committed 07:40AM - 19 Jun 24 UTC (UTC) [image] vasqu +191 -11 …

GPT2Model model output inconsistency between different transformers versions

system Closed March 23, 2025, 6:26am 7

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Inconsistent GPT2Model results between transformers versions Intermediate	7	30	July 19, 2025
Difference in output logits when using a subsection of the input sentence 🤗Transformers	0	372	January 8, 2023
Different model.generate() predictions between batched and unbatched/padded token inputs 🤗Transformers	2	2265	August 26, 2023
Hidden States of OpenAI GPT2 inconsistent 🤗Transformers	2	284	October 25, 2021
Looks like the new transformer 4.49.0 has some issues 🤗Transformers	3	278	March 6, 2025