Access to MNIST examples is 7 times slower than torchvision: import torchvision import datasets mnist_hf = datasets.load_dataset("mnist", split="train") mnist_hf_inmem = datasets.load_dataset("mnist", split="train", keep_in_memory=True) mnist_tv = torchvision.datasets.MNIST("~/home", train=True, d…

Accessing dataset is very slow compared to torchvision

CarloLucibello May 15, 2022, 5:45am 2

Topic		Replies	Views
Hugging face datasets -- reading image shape takes very long time Beginners	1	280	April 4, 2023
Load_datasets is extremely slow in loading HF datasets Beginners	1	2338	December 15, 2023
Local dataset loading performance: HF's arrow vs torch.load 🤗Datasets	5	1145	November 24, 2024
Loading local dataset shows less classes than are present 🤗Datasets	0	195	April 25, 2024
PyTorch Dataset/DataLoader classes 🤗Datasets	3	1139	November 25, 2021