GPT_J custom dataset

Beginners
1

Hi,

I am a CS student trying to use GPTJ for my custom dataset.
I have successfully tried generate() API and that works.
To fine-tune it further, is there a way for me to train with my custom dataset.
Any pointers would be appreciated.

Thank you!

2

I checked documentation at GPT-J,
but don’t see any way to train GPTJ with my own custom dataset.
Could someone please confirm if its possible to do so and any pointer to API to use?

Thanks so much!