Streaming in dataset uploads

Hi ! Currently IterableDataset still needs a push_to_hub() method, which would be very welcome (it’s open to contributions).

Note that in the meantime, you can still merge your small parts into train/val/test in the YAML part of the README.md file

1 Like