Help, please! Seems fine tuning on LLM is not working

[Donor]

Same problem here. Tried different hyperparameters include dataset size, epoch, lr, or everything with generation configuration tuning, results are broken. Literally I’m crying right now…