GPT2 for Mongolian Goal is to create a strong language generation model for Mongolian :mongolia: Since initial code and data is pretty much written by @patrickvonplaten and other huggingface members, it should not be so hard to get the first sense. Model Randomly initialized GPT2 model Dataset…

Pretrain GPT-2 from scratch in Mongolian

bayartsogt July 2, 2021, 3:20am 4

Great! Please register here.

Topic		Replies	Views
Pretrain GPT-2 from scratch in Thai Flax/JAX Projects	0	918	July 18, 2021
PreTrain GPT2 from scratch in Russian Flax/JAX Projects	1	667	July 1, 2021
PreTrain GPT2 from scratch in Spanish Flax/JAX Projects	12	1956	July 1, 2021
PreTrain GPT2 from scratch in Bengali Flax/JAX Projects	8	2421	August 19, 2021
PreTrain GPT2 from scratch in Indonesia Flax/JAX Projects	13	752	June 30, 2021