BERTIN: PreTrain RoBERTa-large from scratch in Spanish

We now have a Discord channel to discuss details: Discord

Hi. It seems I can’t see that Discord channel (I get a blank page in Discord, saying “You don’t have access to any text channels, or there are none in this server”). Do I need an invitation?

I had an error like that when using the desktop app. Try using the web interface. Also, have you for an invite? If not, send me a DM with your email.

As the event wraps up, all our work is released and tracked in this repo: bertin-project/bertin-roberta-base-spanish ¡ Hugging Face

Thanks to y’all :heart:!