GPT2 for Bengali Currently, there is no GPT2 model that was trained from scratch for Bengali on the hub. For this project, the goal is to create a strong language generation model for Bengali using GPT2 Model. 2. Language Bengali. 3. Model A randomly initialized GPT2 model. 4. Datasets One ca…

PreTrain GPT2 from scratch in Bengali

patrickvonplaten June 25, 2021, 5:20pm 5

This looks like a great topic! Let’s wait if more people are interested until Monday and make this an official team than on Monday

1 Like

Topic		Replies	Views
Model for Bengali Poetry Generation with GPT-2 Flax/JAX Projects	4	2172	July 2, 2021
Pretrain GPT-2 from scratch in Thai Flax/JAX Projects	0	920	July 18, 2021
Pretrain GPT-2 from scratch in Mongolian Flax/JAX Projects	3	958	July 2, 2021
PreTrain GPT2 from scratch in Spanish Flax/JAX Projects	12	1959	July 1, 2021
PreTrain GPT2 from scratch in Indonesia Flax/JAX Projects	13	755	June 30, 2021