Description: We will finetune GPT2-JAX on ATOMIC2020 so that we can generate vertices for knowledge graphs
Model: GPT2-Large
Dataset: ATOMIC2020
Training scripts: Training scripts and data processing scripts will be written as part of the project
Expected result: An adaptable JAX pipeline for training knowledge graph systems.