When using the Trainer, e.g. # set training arguments - these params are not really tuned, feel free to change training_args = Seq2SeqTrainingArguments( output_dir="./", evaluation_strategy="steps", per_device_train_batch_size=50, per_device_eval_batch_size=10, predict_with_gene…

How to sample from the validation set when using Trainer?

alvations November 1, 2022, 2:43pm 3

Thanks @sgugger for the prompt reply!

1 Like

Topic		Replies	Views
Evaluate subset of data during training 🤗Transformers	5	5715	July 6, 2024
Use Trainer API with two valiation sets 🤗Transformers	1	1872	February 28, 2022
Technical clarification on the validation data vs. the training data in the trainer API 🤗Transformers	1	764	January 6, 2022
Adapt Decision Transformer collator to handle evaluation 🤗Transformers	1	235	July 13, 2024
Trainer will evaluate using my entire validation set(60k), which gives me cuda memory usage issue:. Is there a param that allows evaluating only on some batches in validation set? Beginners	4	1334	April 29, 2022