Here is my code from transformers import Seq2SeqTrainer,Seq2SeqTrainingArguments, EarlyStoppingCallback, BertTokenizer,MT5ForConditionalGeneration from transformers.data.data_collator import DataCollatorForSeq2Seq,default_data_collator from torch.utils.data import Dataset, DataLoader import pandas …

Not sure how to compute BLEU through compute_metrics

xiami May 30, 2023, 6:25am 5

set predict_with_generate = True in training_args solved my problem

1 Like

Problem with custom metric for custom T5 model

Topic		Replies	Views
Compute the BLEU using pretrained T5-small Models	2	3199	April 13, 2022
Transformer for Translation from Scratch with Hugging Face/PyTorch Intermediate	5	2915	December 1, 2022
Unable to train model (Loss is 0.000000) DeepSpeed	2	831	October 17, 2023
Slow inference for translation Beginners	0	51	April 22, 2024
EncoderDeocoderModel with different checkpoint training Models	0	310	January 24, 2023