Train mpt-30b without AWS Sagemaker on cpu only

Could someone help me to write a script to finetune mpt-30b (which i already have downloaded), with multiple .parquet files i downloaded from the starcoder trainings database, and save it to a specific folder path?