The above issue was resolved with the help of a similar previous issue.
Link - Git LFS fail for Spaces with Github Workflow
The issue was apparently a common error of not filtering the “offensive files” from the git history.
refer - Nevermind, found an answer to remove git history of all large file by running the following git command
Thanks to all the contributors of the earlier issue/fix.