Where to run inference on a fine-tuned sentence transformer model

Beginners
1

I’ve fine tuned a sentence transformer model (thenlper/gte-large) to generate embeddings. For now, I’ve used google colab to create the model. Now I need to generate real-time embeddings (i.e. not batch jobs) of new sentences. For now, I only want to generate embeddings for 10K - 20K sentences /day and the traffic is very bursty, but I need real-time inference. Where are the best options for running inference.

Thanks.