I can train BERT from scratch using PyTorch code from hugging face GitHub.
However, when it comes to ELECTRA, I just cannot find PyTorch resources.
How can I use get labels of 1 or 0 indicating whether token is replaced or not?
Please somebody help me…