Finetune GPT2on ATOMIC2020

Description: We will finetune GPT2-JAX on ATOMIC2020 so that we can generate vertices for knowledge graphs

Model: GPT2-Large

Dataset: ATOMIC2020

Training scripts: Training scripts and data processing scripts will be written as part of the project

Expected result: An adaptable JAX pipeline for training knowledge graph systems.