The Goal of this project is to train an Unsupervised Code-Code Translation Model. There are a lot of different approaches which modeled Supervised with parallel corpora. There is this particular paper( [2006.03511] Unsupervised Translation of Programming Languages ), which tried to build a Code-Code T…

Unsupervised Code-Code Translation based on TransCoder

patrickvonplaten June 29, 2021, 2:27pm 3

Cool idea! @reshinthadith which model architecture would you like to use? Maybe simply FlaxRoBERTa?

Topic		Replies	Views
PreTrain RoBERTa/T5 from scratch for Programming Languages Flax/JAX Projects	27	3470	April 16, 2023
Finetuning a model for machine translation on a programming language Models	1	650	November 29, 2023
Pretrain GPT-Neo for Open Source GitHub Copilot Model Flax/JAX Projects	54	24013	January 18, 2022
Fine-tuning translator based on a single language Intermediate	0	289	September 22, 2021
Decoder only fine-tuning enough for UMT5 Models	0	337	November 29, 2023