I see that you have a Your proposed upload is smaller than the minimum allowed size in your logs, and I am suspecting that is due to how aws works php - Amazon S3 - Your proposed upload is smaller than the minimum allowed size - Stack Overflow could you verify the size of chunk data/train-00253-of-00432.parquet ?
and let me know which version of the huggingface_hub and of datasets library you’re using ?
reading in the traceback I also saw ModuleNotFoundError: No module named 'apt_pkg' , could you start by fixing that one first if that does not work please report your findings on what I mentioned above.