Why is BigBird Pegasus/Pegasus Repeating the Same Sentence for Summarization?

Models
1

Hello,

BigBird Pegaus, when creating summaries of text, is repeating the same sentence over and over. I have tried using text on the Hugging Face model hub and there is an issue posted on Stack Overflow (python - Big Bird Pegasus Summarization output is repeating itself - Stack Overflow). Additionally, below are some images from the Hugging Face hub.

image
image732×719 89.6 KB

I am doing text summarization for my thesis and I am not sure why this is happening, but apparently it has been an issue for 6 months. Is there a way to prevent this from happening?

Thank you.

2

I use no_repeat_ngram_size to reduce the repetition during text generation.