huggingface uses fsspec for the API for datasets, right? are there plans to use IPFS? seems like there is a read-only fsspec.
maybe instead of “democratizing machine learning”, it can be “decentralizing machine learning”? 
2 Likes
Hi,
I’m afraid the project you’ve linked is not mature enough, but we can reconsider adding the IPFS filesystem once this is changed.
good to know. thanks! can you point me in the direction of where to implement this when ipfsspec implements write functionality? it was kinda hard to follow with the plugins stuff in datasets. also the s3 fs implementation just has a docstring modifier
Big ooph when a nine year old project isn’t mature enough. You’re right, just hurts given this is a perfect use case for a distributed mirrored file storage system.