Pretrain GPT-Neo for Open Source GitHub Copilot Model

[ncoop57]

Hey y’all, we are using the discord server posted in the slack channel to communicate. We have our own channel called “copilot-codecompletion.” So head on over there for easier discussion if you are part of the project