IPFS cloud storage?

huggingface uses fsspec for the API for datasets, right? are there plans to use IPFS? seems like there is a read-only fsspec.

maybe instead of “democratizing machine learning”, it can be “decentralizing machine learning”? :smiley:

1 Like


I’m afraid the project you’ve linked is not mature enough, but we can reconsider adding the IPFS filesystem once this is changed.

good to know. thanks! can you point me in the direction of where to implement this when ipfsspec implements write functionality? it was kinda hard to follow with the plugins stuff in datasets. also the s3 fs implementation just has a docstring modifier