Hi, I can’t figure out how to train using an IterableDataset. I keep running errors with the train step. If I don’t set the max_steps training arg, I get an error claiming that the dataset doesn’t have a length. On the other hand, with that set to max_steps=150_000 I see this error. Any pointers? T…

Setting max_steps with IterableDataset still errors

shwetha-97 August 23, 2023, 11:30pm 3

I am also facing the exact same error and there aren’t many resources on the internet that I am finding for this, could you please share what you did to solve it? I would really appreciate the help!

Topic		Replies	Views
There seems to be not a single sample in your epoch_iterator, stopping training at step 0! This is expected if you're using an IterableDataset and set num_steps (5000000) higher than the number of available samples Beginners	2	1764	April 19, 2023
Streaming dataset into Trainer: does not implement __len__, max_steps has to be specified 🤗Datasets	6	4552	March 21, 2023
Using an IterableDataset for 1+ epochs in Trainer Beginners	3	177	January 2, 2025
Error training with iterabledatasets Beginners	1	640	July 22, 2022
Using IterableDataset with Trainer - `IterableDataset' has no len() 🤗Transformers	7	14765	December 17, 2024

Setting max_steps with IterableDataset still errors

Related topics