HF cache no space left on device

[John6666]

Hmm… @lhoestq

"No space left on device" when using HuggingFace + SageMaker

Hi, I’m trying to train a model using a HuggingFace estimator in SageMaker but I keep getting this error after a few minutes: [1,15]: File “pyarrow/ipc.pxi”, line 365, in pyarrow.lib._CRecordBatchWriter.write_batch [1,15]: File “pyarrow/error.pxi”, line 97, in pyarrow.lib.check_status [1,15]:OSError: [Errno 28] Error writing bytes to file. Detail: [errno 28] No space left on device [1,15]: I’m not sure what is triggering this problem because the volume size is high (volume_size=1024) …