Finetune a chatbot for specfic task

Hi ,

I’m totally impressed by opensource LLaMa , Alpaca based chatbots and i’m asking if i can build a bot on top of these bots for doing specfic tasks that only reply only the topics i finetuned or trained and that will deal with an internal database
Or should i build something like Alpaca7b or stableLM and finetune it for my purposes.
and how can i finetune for both senarios i hope you help me