Fine tune text generation model

Hello, is it possible to fine tune a text generation model? I would like to generate an instance of a model to incorporate a dataset like the following: UCI Machine Learning Repository

It is a dataset that has numerical values of operation of a natural gas turbine that generates electricity.

I wanto to use the model to make inferences such as asking: What would be the CO emission if the power is XX, the ambient temperature is YY, etc.

I know that it is possible to add information as context in the prompt, but they are long in text.

I dont know if the wrigth way is to make an adapter

I was able to generate a jsonl file from that dataset.

Thanks for your time.