This repository looks very promising.
Benchmarks shows very huge speed up gains in Tensorflow 2.0.
And tons of tutorials to start with. Models are keras fit compatible too.
And Glue score on Albert joint loss also looks good. Some other useful features too.