Finetuning GPT2 with user defined loss

Hi @aclifton314,
I won’t be able to help you with the generate part, as for the data see if this post helps you, if you still have doubts then ping me, I’ll try to provide more explanation.