I cannot get it to work with “calibration” split name
In many cases, placing files and folders into the data
folder works well.
File names and splits
Could you explain what you mean by “built” please? Because when I browse other datasets, they never upload files like I did (it seems stupid to, so I expected that), they often use
parquet
(I don’t think it’s very appropriate for images? Maybezip
better?). Is that what you mean?
Yes. In parquet
(default) or in WebDataset
.