Hi !
If you don’t have enough disk space, I’d suggest to do your processing on-the-fly instead of processing on your disk. To do so you just need to pass your processing function as a formatting transform that will be applied on-the-fly
This way your processing will be done one example at a time when you access the examples. In this case the processing is done in memory and doesn’t fill up your disk.