|
Pre-training with Lamb optimizer
|
|
3
|
27
|
October 27, 2020
|
|
Guide: The best way to calculate the perplexity of fixed-length models
|
|
3
|
300
|
October 21, 2020
|
|
Load/save HF block sparse model
|
|
1
|
19
|
October 21, 2020
|
|
Resume Training / Finetune a language model and further finetune a classifier
|
|
1
|
33
|
October 19, 2020
|
|
Hyperparameter for distil bert
|
|
0
|
16
|
October 19, 2020
|
|
ELECTRA training reimplementation and discussion
|
|
9
|
1394
|
October 18, 2020
|
|
Is there an easy way to apply layer-wise decaying learning rate in huggingface trainer for RobertaMaskedForLM?
|
|
0
|
14
|
October 17, 2020
|
|
GPT2 for QA Pair Generation
|
|
8
|
148
|
October 13, 2020
|
|
Transformer for Abstractive Summarization for Chats Based on Performance
|
|
3
|
166
|
October 9, 2020
|
|
Pre-Train BERT (from scratch)
|
|
38
|
436
|
October 6, 2020
|
|
Evaluation metrics for BERT-like LMs
|
|
3
|
70
|
October 5, 2020
|
|
Seq2Seq Distillation: Methodology Questions
|
|
2
|
49
|
October 5, 2020
|
|
Obtaining BERT-base from BERT-large
|
|
3
|
54
|
October 2, 2020
|
|
How I fine-tune BART for summarization using large texts?
|
|
3
|
106
|
September 28, 2020
|
|
New seq2seq tool: search hparam space with run_eval.py
|
|
5
|
63
|
September 17, 2020
|
|
Not all BLEU scores were created equal
|
|
0
|
43
|
September 15, 2020
|
|
How to use T5 for sentence embedding?
|
|
4
|
112
|
September 12, 2020
|
|
Bart-base rouge scores
|
|
6
|
176
|
September 5, 2020
|
|
Finetuning for fp16 compatibility
|
|
0
|
64
|
September 3, 2020
|
|
Bertology-like Analysis for BART, T5?
|
|
0
|
65
|
August 31, 2020
|
|
Adding features to a pretrained language model
|
|
1
|
97
|
August 20, 2020
|
|
[Help needed] Extending Trainer for Meta learning
|
|
2
|
145
|
August 19, 2020
|
|
Science Tuesday: MARGE
|
|
6
|
950
|
August 14, 2020
|
|
Carrying Gradients Through Generate
|
|
3
|
129
|
August 6, 2020
|
|
BART question, it seems that pretraining is not work for a small model?
|
|
6
|
144
|
August 3, 2020
|
|
Why are segment and position embeddings so large?
|
|
2
|
233
|
August 2, 2020
|
|
Understanding what went wrong in attention
|
|
5
|
225
|
July 31, 2020
|
|
ACL 2020 highlights – Joe
|
|
3
|
650
|
July 30, 2020
|
|
Finetuning German BERT for QA on biomedical domain
|
|
1
|
103
|
July 28, 2020
|
|
Debiasing models by HEX projection
|
|
1
|
86
|
July 28, 2020
|
