I know Hugging Face nowadays hosts PB-scale datasets. Given the popularity of HF and enormous scale of the data that it hosts, I am curious how HF’s backend infrastructure handles the huge data access traffic? In particular, how is the cache architecture designed in order to sustain the load?
Any pointers, or any information would be much appreciated.