Hi ! Like you mention in this post : Accelerator .prepare() replaces custom DataLoader Sampler - :hugs:Accelerate - Hugging Face Forums When we use a custom sampler, it is used on downstream processes. But today it works like that : [image] Sampler will generate batches, and batches will be a…

Accelerate - WeightedRandomSampler Dataloader

FrsECM June 18, 2024, 8:03am 2

In the end, what i would like is more a behavior like that :

Topic		Replies	Views
Accelerator .prepare() replaces custom DataLoader Sampler 🤗Accelerate	5	1255	March 9, 2025
Can accelerator handle the distributed sampler? 🤗Accelerate	2	2903	December 21, 2021
Using DistributedSampler with accelerate 🤗Transformers	4	117	April 2, 2025
DataLoader from accelerator samples from beginning of dataset for last batch 🤗Accelerate	1	648	January 15, 2024
How does Accelerate ensure uniqueness of data samples across GPUs? 🤗Accelerate	2	854	June 21, 2023