In that case we recommend to have the Parquet files in main
, and create a new branch script
that would contain the original data and the loading script.
This way, this would use the Parquet files and would be used for the Viewer:
load_dataset("shunk031/JGLUE")
And this can be useful for those who want to use the loading script and the original data
load_dataset("shunk031/JGLUE", revision="script")
Feel free to mention the existence of this branch in the dataset README.md