Training using multiple GPUs

I am fine tuning T5 model on sagemaker with 4 gpu, just one gpu is being used. What do you suggest