Pre-training/fine-tuning Seq2Seq model for spelling and/or grammar correction in English

[pierreguillou]

Hi @valhalla.

Just to say that I have continued to search this topic for spelling corrections (in particular, about ASR errors correction) and just posted informations that may be of interest to people of similar interest.

ASR spell correction

Hi. When searching for solutions about ASR errors corrections, I found this topic in the HF forum. I would like to discuss with you about 2 models. FastCorrect Recently, Microsoft Asia published FastCorrect paper (and more recently, FastCorrect 2). I like the 2 main ideas on which is based this model: Training of an edit distance model in order to adapt the tokens number of the source (sentence with errors from the ASR output) to the one of the target (sentence without errors): thus, the d…