huggingface uses fsspec for the API for datasets, right? are there plans to use IPFS? seems like there is a read-only fsspec.
maybe instead of âdemocratizing machine learningâ, it can be âdecentralizing machine learningâ?
huggingface uses fsspec for the API for datasets, right? are there plans to use IPFS? seems like there is a read-only fsspec.
maybe instead of âdemocratizing machine learningâ, it can be âdecentralizing machine learningâ?
Hi,
Iâm afraid the project youâve linked is not mature enough, but we can reconsider adding the IPFS filesystem once this is changed.
good to know. thanks! can you point me in the direction of where to implement this when ipfsspec implements write functionality? it was kinda hard to follow with the plugins stuff in datasets. also the s3 fs implementation just has a docstring modifier
Big ooph when a nine year old project isnât mature enough. Youâre right, just hurts given this is a perfect use case for a distributed mirrored file storage system.