I am not hosting my files on huggingface, but I am downloading a .zip file from my university dataset hub. Further, the files are processed in the _generate_examples functions of the GeneratorBasedBuilder. How can I make this compatible with the dataset viewer? It’s about: UKPLab/PeerQA · Datasets at Hugging Face .
Thanks for clarifying, @lhosteq! I see, it makes sense that the code cannot be executed. The code is required because it needs to download some and process some data that can’t be hosted on the hub due to licenses.
I have now added the permissible part using ds.push_to_hub(). I can see the parquet files have been uploaded, but the viewer is still showing that it cant be shown due to the remote code. Does it mean that the viewer only works if there is no loading script present?