ALBERT Pretraining example (Tensorflow)

Beginners
1

Hello everyone,

Is there any guide / example of how to do pretraining of ALBERT (in Tensorflow) using code only from huggingface?

I would really appreciate any help.

Thanks

2

@sgugger any help here would be very appreciated

3

Still waiting a reply on this