Does the datasets library support GCloud storage?

Can the DownloadManager from datasets download from a gcloud private bucket?

Hi ! Currently this is not supported unfortunately. Right now we only support authentication to the private dataset repositories on the Hugging Face Hub - so feel free to host your data there if you want (it’s free anyway).

However I agree it would be super useful to enable accessing private buckets directly, and this is definitely something we’ll explore soon !

1 Like