RuntimeError: Error while uploading 'data/train-00040-of-00157-15109dabc9b3967a.parquet' to the Hub

Hi all,
I’m trying to upload a big dataset to the hub but the following error appears :

RuntimeError: Error while uploading ‘data/train-00040-of-00157-15109dabc9b3967a.parquet’ to the Hub.

Each time I run the notebook cell, a bit more of the dataset is uploaded to the hub so I finally get my dataset uploaded, but when trying to train a model on it I get the following error message :

OSError: image file is truncated (17 bytes not processed)

So that the dataset seems to be wrongly uploaded on the hub.
My version of Huggingface HUb is :

huggingface-hub 0.14.1 pypi_0 pypi

Can someone suggest me how to solve this problem?
Thank you very much in advance :slight_smile:

1 Like