Training using multiple GPUs

[Sahajtomar]

Hi @OlivierCR , I am using distributed training , somehow model training does not start at all. I am using t5 large on 8 GPUs.