Currently, my aim is to finetune the implemented Pegasus on CNN/DailyMail dataset from the ‘google/pegasus-large’ checkpoint. However, I was unable to achieve claimed numbers (Pegasus: replication and distillation results · Issue #6844 · huggingface/transformers · GitHub). My results are ROUGE-1: 43.7 and ROUGE-L: 40.6. My assumption is that I need to modify some sort of hyperparameters.
I would be grateful if you could give me any comment or advice.
P.S: these are hyperparameters I have tried