Hi there! I’m doing DDP style training with the help of trainer. I set up my accelerate config to use 4 GPUs. I have set these args for training: per_device_train_batch_size=2, gradient_accumulation_steps=16 I want to know what will be the effective batch size in this case? When I start the tra…

How to calculate effective batch size while using DDP?

jaydeepb July 21, 2025, 11:02pm 4

resolved! was miscalculating!

2 Likes