GPT2 for Punjabi Pretrain GPT2 on Punjabi language to create a strong language generation model for Punjbai Model A randomly initialized GPT2 model Datasets One can make use of Kaggle Wikipedia Punjabi Articles dataset - Punjabi Wikipedia Articles | Kaggle Available training scripts A causal …

PreTrain GPT2 from scratch in Punjabi

patrickvonplaten June 29, 2021, 2:39pm 3

Cool idea @bhavnicksm - would you like to join?

Topic		Replies	Views
Pretrained GPT2 for Tamil Flax/JAX Projects	13	1086	July 12, 2021
PreTrain GPT2 from scratch in Indonesia Flax/JAX Projects	13	755	June 30, 2021
PreTrain GPT2 from scratch in Bengali Flax/JAX Projects	8	2424	August 19, 2021
Pretrain GPT-2 from scratch in Mongolian Flax/JAX Projects	3	956	July 2, 2021
Pretrain GPT-2 from scratch in Thai Flax/JAX Projects	0	919	July 18, 2021