Hi, I was going through the documentation and got a confusion trainer = Trainer( model=model, # the instantiated :hugs: Transformers model to be trained args=training_args, # training arguments, defined above train_dataset=train_dataset, # trainin…

Type of dataset in Trainer class

valhalla July 18, 2020, 9:23am 3

Hi @suyash21 this post has some explanation about the dataset expected by Trainer

1 Like

Topic		Replies	Views
Dataset expected by Trainer Beginners	5	8846	September 28, 2020
Use tf.data.Data with HuggingFace datasets 🤗Transformers	2	2632	March 22, 2021
Quick Tour: "Train using Tensorflow" gives `Dataset argument should be a datasets.Dataset` error Beginners	4	1058	May 29, 2023
Is Eval and Validation same in Trainer API? Beginners	4	1691	September 14, 2021
Guidance Needed on Choosing the Right Dataset Format for Transformer Model Training 🤗Datasets	1	1719	December 8, 2023