@mariosasko What’s the status of datasets implementing multi-process loading for IterableDataset? I’m happy to help out if needed, this would really help speed up my model training and allow me to continue to stay within the HF ecosystem
@mariosasko What’s the status of datasets implementing multi-process loading for IterableDataset? I’m happy to help out if needed, this would really help speed up my model training and allow me to continue to stay within the HF ecosystem