Letting the generator know, how many stepts he will take

🤗Datasets
1

Hi, I have a question regarding datasets. I am loading a dataset using the from_generator function, and when the loading is in the process, we get a little informative window letting us know how many items are still being processed:
image

Now, I would like to ask someone if there is an argument to inform the function, that he will need to process (in my example) 10416 items.
I am calling the function like this:

> HFDataset.from_generator(gen)

1 Like
2

Hi ! there is no such argument at the moment

2 Likes