I am trying to run the standard Huggingface pipeline to pre-train BERT on my dataset. Here is the error when I attempt to train the model:[by calling trainer.train()] [Error message] The following columns in the training set don't have a corresponding argument in `BertForMaskedLM.forward` and have…

Huggingface Data Collator: Index put requires the source and destination dtypes match, got Float for the destination and Long for the source

Gurjot May 18, 2023, 8:24am 6

I’m also facing the same issue, any solution?

Topic		Replies	Views
BERT embeddings on big dataset 🤗Datasets	3	119	August 28, 2024
Machine Translation using Hugging Face problem Intermediate	0	323	May 8, 2023
Expected input batch_size (2048) to match target batch_size (4) Beginners	3	1598	May 23, 2022
Using huggingface transformers trainer method for hugging face datasets 🤗Datasets	1	1089	April 15, 2024
Fine tuning bert on next sentence prediction task Intermediate	5	4042	September 30, 2020