This is great news! Thank you all for that. It seems I managed to solve this 
Feedback for additional improvement can be:
- adaptive upload frequency that makes sure commit quota limit is not reached.
- and of course, better implementation of sharding so that user can upload large shards without any problem
Again, thanks a lot