Thank you!
I implemented all 3 recommendations and it helped in Colab! I am pretty sure I will handle it with Serverless framework and Lambda.
And it looks like I definitely need to go through the Transformer models - Hugging Face Course 
The feeling when you get unstuck - priceless!