Problem When Using Datasets to Open JSONL I am trying to open a JSONL format file using the datasets library. Here is my code: from datasets import load_dataset path = "./testdata.jsonl" dataset = load_dataset('json', data_files=path, split='train') The contents of testdata.jsonl are organized as…

Hi ! This behavior is expected since datasets uses Arrow which has fixed types. This means each sample should have the same subfields with the same types. Missing subfields are filled with None. You can restructure your data differently to fit this paradigm: either converting nested data as one str…

Using datasets to open jsonl

🤗Datasets

bluebingo June 30, 2025, 8:03am 9

Thank you! I look forward to any official solutions that the developer might provide.

1 Like

Topic		Replies	Views
Problem with loading custom dataset from jsonl file Beginners	1	12729	May 5, 2023
Json dump format for load_dataset 🤗Datasets	5	22061	September 5, 2024
Load Dataset Fail for Custom Json Format Beginners	3	8511	June 20, 2023
JSON parse error when load_dataset 🤗Datasets	0	98	August 10, 2024
Error with load model from JSON in datasets 🤗Datasets	2	674	November 25, 2023

Using datasets to open jsonl

Related topics