To whom it may concern, I am currently working on a ASR project with many different datasets including the ESB dataset and the MLS dataset. However, I reached the maximum quota on the server I’m working with. My final goal is to evaluate my ASR model on these dataset groups so I should be able to b…

Hi! Some dataset scripts generate arrow files with embedded external files (image/audio files), and some don’t, hence the discrepancy. In Datasets 3.0, we will always embed these bytes. By disabling decoding of the audio column and fetching the file paths as follows:ds_raw_audio = ds.cast_column(…

Understanding the `Datasets` cache system

🤗Datasets

tonywu71 May 19, 2023, 8:50pm 3

Thank you so much, everything’s perfectly clear!

Topic		Replies	Views
Deleting Duplicate Saved Datasets 🤗Datasets	3	4576	September 7, 2022
Load_dataset without saving cache files 🤗Datasets	1	1862	April 19, 2023
Where are the actual files to download? Beginners	7	2057	January 8, 2024
How can I clean the dataset cache? 🤗Datasets	4	11545	March 1, 2024
How to handle the cache system properly? 🤗Datasets	3	42	August 2, 2025

Understanding the `Datasets` cache system

Related topics