Hello guys,
I’m doing some research about the effects of pre-training tasks by changing ALBERT. I want to add a new binary classification pre-train task besides from NSP and MLM. Is it possible to pre-train three tasks together? If so, how to write the script to do that?