Caching progress of Dataset.from_generator

[lhoestq]

Hi ! It’s not currently possible

Maybe you can create multiple Dataset objects, this way if one crashes the others can continue