RoBERTa/BERT for Norwegian Currently, there is only a very limited amount of BERT-like models for Thai on the hub: Hugging Face – The AI community building the future. . For this project, the goal is to create a RoBERTa/BERT model for just the Norwegian language. Model A randomly initialized RoBE…

PReTrain RoBERTa from scratch in Norwegian

saattrupdan June 28, 2021, 5:39pm 3

It could make sense to pretrain a common Scandinavian model instead, as our languages are so similar. I’ve made a project suggestion here: Scandinavian RoBERTa.

2 Likes

Topic		Replies	Views
PreTrain RoBERTa from scratch in Thai Flax/JAX Projects	3	566	July 2, 2021
PreTrain RoBERTa from scratch in Hindi Flax/JAX Projects	24	1901	December 10, 2021
PreTrain RoBERTa from scratch in Portuguese Flax/JAX Projects	16	2120	October 4, 2021
BERTIN: PreTrain RoBERTa-large from scratch in Spanish Flax/JAX Projects	23	1827	July 19, 2021
PreTrain RoBERTa from scratch in Marathi Flax/JAX Projects	7	835	July 7, 2021

PReTrain RoBERTa from scratch in Norwegian

Related Topics