Training PEGASUS on unlabeled data

Skylixia · April 16, 2021, 8:17pm

Hi,

I was wondering if there is any way to load a PEGASUS model and further train it on unlabeled data with its training objective rather than supervised finetuning with labeled data ?

Topic	Replies	Views
Non fine-tuned Pegasus models Models	288	June 22, 2021
Can the Pegasus Model be Adapted Using the PEFT-LORA Technique? Beginners	155	August 8, 2023
Pegasus Paraphrase Fine Tuning dataset Research	627	May 30, 2022
PEGASUS decoder with input as PEGASUS's full autoencoder output Beginners	221	April 20, 2022
Temperature has no effect on Pegasus LM Beginners	349	June 24, 2021

Training PEGASUS on unlabeled data

Related Topics