Which data parallel does trainer use? DP or DDP?

[sgugger]

It depends if you launch your training script with python (in which case it will use DP) or python -m torch.distributed.launch (in which case it will use DDP).