Hi @patrickvonplaten ,we are working on it.We have finished writing our training script for Bert multiple choice using flax and also our cosmosq&a dataset.it’s working perfectly fine.we just need access for the tpu and accomodate training the same with the gpt-2 multiple choice model.That should get completed by tomorrow.We have created the discord channel also.