I am trying to connect to MinIO using an S3 interface with the load_dataset() function. I noticed that the S3FileSystem class is marked as deprecated, and the code in similar topics uses it. I am hoping someone can point me in the right direction. If this is not yet a feature, I would be glad to hel…

Connect to MinIO using S3

mariosasko October 11, 2023, 12:59pm 4

We will eventually support this, but this is not a high priority right now (we are more focused on improving the Hub integration).

Topic		Replies	Views
How to use S3 path with `load_dataset` with streaming=True? 🤗Datasets	11	7717	November 23, 2022
Host and share datasets: S3 🤗Datasets	1	1213	July 22, 2022
Help creating dataset from s3 bucket with parquet files 🤗Datasets	2	1121	July 27, 2023
How to write a dataset load script using private S3 storage 🤗Datasets	2	1354	December 1, 2022
FileNotFoundError after using builder.download_and_prepare() to S3 🤗Datasets	2	663	January 4, 2024