Uploading json, jsonl files as subset on dataset repo

[sleeping4cat]

I wanted to upload json, jsonl, zip files as subsets but now I know how to upload parquet as subset files. is there any way using API or cli where I could upload any file-type as subset in a dataset repo?

[John6666]

It seems that the only way to create a subset of a dataset with a normal file is to write a script. However, this forum post is two years old, so the situation may have changed.

How to create subset when pushing to hub

Hey! I have a dataset of image and text, and I am trying to upload it to the hub using the script below. I was wondering how to create a subset, because everything is been put in “gabrielsantosrv–pracegover” subset. Thanks in advance from datasets import Dataset, load_dataset from PIL import Image import io import json def try_load_image(filepath): try: with open(filepath, 'rb') as f: image = Image.open(io.BytesIO(f.read())) if isinstance(image, Image…