I am trying to load a custom dataset locally. This is a test dataset, will be revised soon, and will probably never be public so we would not want to put it on the HF Hub, The dataset is in the same format as Conll2003. The idea is to train Bert on conll2003+the custom dataset. The setup I am te…

Loading Custom Datasets

lhoestq May 21, 2021, 2:04pm 6

What is the length of your dataset ? len(dataset["train"])

Can you also try to do dataset["train"][0] ?

Topic		Replies	Views
Token Classification run_NER.py AttributeError Models	1	892	July 8, 2022
Passing schema features to a load_dataset function 🤗Datasets	4	1435	August 26, 2021
Fine Tuning BERT model on custom dataset 🤗Transformers	3	1192	January 27, 2022
Fine Tuning IMDb tutorial - Unable to reproduce and adapt Beginners	19	8598	August 21, 2020
Create own dataset for NER Beginners	3	6267	November 22, 2023