Problem When Using Datasets to Open JSONL I am trying to open a JSONL format file using the datasets library. Here is my code: from datasets import load_dataset path = "./testdata.jsonl" dataset = load_dataset('json', data_files=path, split='train') The contents of testdata.jsonl are organized as…

Hi ! This behavior is expected since datasets uses Arrow which has fixed types. This means each sample should have the same subfields with the same types. Missing subfields are filled with None. You can restructure your data differently to fit this paradigm: either converting nested data as one str…

Using datasets to open jsonl

🤗Datasets

bluebingo July 2, 2025, 1:16am 12

Thank you, lhonestq!

1 Like

Topic		Replies	Views
Problem with loading custom dataset from jsonl file Beginners	1	12719	May 5, 2023
Json dump format for load_dataset 🤗Datasets	5	22036	September 5, 2024
Load Dataset Fail for Custom Json Format Beginners	3	8506	June 20, 2023
JSON parse error when load_dataset 🤗Datasets	0	96	August 10, 2024
Error with load model from JSON in datasets 🤗Datasets	2	673	November 25, 2023

Using datasets to open jsonl

Related topics