How to multithread my RAG Model?

Models
1

I have built a RAG model with LlamaIndex and now to reduce the response time, as well as for a new usecase, I want to execute multiple prompts at the same time which is not supported within the llamaIndex framework. So I tried using Threading library but I’m not getting the results as the model goes in error state when i try to execute more than one thread, btw I’m using free google colab as my production environment