How to concatenate 100s of small datasets into a very large dataset? *Without* loading into memory?

🤗Datasets
2

You can concatenate these datasets without loading them into memory with concatenate_datasets.