How to fine tune a Text2Text model in Spanish as a ChatBot solution?

How can I fine tune a Text2Text model in Spanish for a CPU-based, lightweight chatbot implementation with a parameter limit, such as not exceeding one billion parameters? (Or just a small model)

I need a chatbot for my organization, trained specifically with information from the company so it can be used locally.