Oooh, I did not notice that the files are been uploaded as regular markdown files. This means that all the data is stored in the git history, not using LFS files stored on S3. This is most certainly the culprit. Usually we try to avoid storing data as “raw” as it makes everything very slow. This is why git+LFS (and now git+xet) has been developed.
If that doesn’t make any sense to you, it basically means that the way files are stored on the repo is not optimized. I would recommend:
- create a new separate repo
- make sure the .md files are tracked as LFS (can be done by modifying the .gitattributes files .gitattributes · mysocratesnote/jfk-files-text at main)
- upload files subpart by subpart (around 250 by 250 is good)
- once everything is uploaded, delete the original repo and move the new one under the previous namespace
Very sorry about this situation but I think starting with a clean state is really needed here.