Nevermind, found an answer to remove git history of all large file by running the following git command
git filter-branch --index-filter --f "git rm -rf --cached --ignore-unmatch “PATH TO FILE” HEAD
git push origin --force --all
2 Likes