I am uploading .jsonl files which are about 70 GB. I am using
But there is a small problem for me, once I add the files using
git add ., I have the same size of the files added to the disk, as I know it is related to LSF and it should be like this.
Is there any solution to mitigate the disk issue? upload the files one by one? or any other tricks?