T5 for commit message generation Commit message generation is known to be a difficult task due to the following reasons: No available clean and large dataset for pre-training and fine-tuning (Almost) No available pre-trained seq2seq models on both programming and natural languages corpora Context…

Train T5 model for commit message generation

bharat-raghunathan June 29, 2021, 5:51pm 18

Hi, I would like to join this team if spots are still available! I have some experience in Software Engineering and GitHub APIs that may help

2 Likes

Topic		Replies	Views
Auto-generation of Messages to Commits \| Project Proposing Flax/JAX Projects	4	1581	August 13, 2021
PreTrain RoBERTa/T5 from scratch for Programming Languages Flax/JAX Projects	27	3470	April 16, 2023
Pretrain GPT-Neo for Open Source GitHub Copilot Model Flax/JAX Projects	54	24012	January 18, 2022
Commit Message Generation Model Models	0	43	August 27, 2024
Example of how to pretrain T5? 🤗Transformers	15	16061	March 16, 2023