I see. So, just to be clear, Accelerate will ensure that, given any sampler, the data will be split exclusively for each GPU? Interesting, because I wasn’t able to find this functionality in the prepare_dataloader method of the Accelerate function. Is it wrapped in any other Accelerate method?
1 Like