Is there any pretraining script for BART?

Hi all,

I’m looking for pretraining script for BART.

I have a plan for pretraining BART model in Korean but I can not find any pretraining script even in fairseq repo (https://github.com/pytorch/fairseq/issues/1614).

is there any suggestion to pretrain model for other language?

thx :slight_smile:

4 Likes