Hey everyone, Actually, I am trying to accommodate multiple subtasks including STS-b and NER into a multi-task model, however am unable to issue the tokens from the conll dataset into the DataCollator. Can anyone help me with this? The code snippet is shown below. class NLPDataCollator(DefaultData…

Using datacollator for multi-task training

nid989 January 22, 2022, 6:14pm 2

This error is displayed when I am trying to accommodate the NER dataset specifically entities extracted in the fashion show here

Topic		Replies	Views
Understanding DataCollation 🤗Transformers	0	18	July 18, 2024
Multilabel token classification (dataloader issues) 🤗Datasets	0	186	April 20, 2024
DataCollator uses Tokenizer while having BatchEncodings? 🤗Transformers	0	138	February 29, 2024
How to use Data Collator? Beginners	1	2380	April 26, 2021
Cannot get DataCollator to prepare tf dataset 🤗Transformers	0	477	July 15, 2022