Unable to load CommonVoice latest version

🤗Datasets
1

This line of code works well with commonvoice version 6.1.0 but i get error while using for version .70.0

from datasets import load_dataset, load_metric, Audio

common_voice_train = load_dataset("common_voice", "lg", split="train+validation",version="7.0.0")
common_voice_test = load_dataset("common_voice", "lg", split="test",version="7.0.0")

ValueError: Cannot name a custom BuilderConfig the same as an available BuilderConfig. Change the name. Available BuilderConfigs: ['ab', 'ar', 'as', 'br', 'ca', 'cnh', 'cs', 'cv', 'cy', 'de', 'dv', 'el', 'en', 'eo', 'es', 'et', 'eu', 'fa', 'fi', 'fr', 'fy-NL', 'ga-IE', 'hi', 'hsb', 'hu', 'ia', 'id', 'it', 'ja', 'ka', 'kab', 'ky', 'lg', 'lt', 'lv', 'mn', 'mt', 'nl', 'or', 'pa-IN', 'pl', 'pt', 'rm-sursilv', 'rm-vallader', 'ro', 'ru', 'rw', 'sah', 'sl', 'sv-SE', 'ta', 'th', 'tr', 'tt', 'uk', 'vi', 'vot', 'zh-CN', 'zh-HK', 'zh-TW']

what do i need to change. Thanks

2

cc @anton-l

3

For an alternative , download and load the data manually , see below may they help

from datasets import load_dataset

ds = load_dataset("./datasets/datasets/common_voice_7", “lg”, data_dir="./cv-corpus-7.0-2021-07-21/", ignore_verifications=True)

4

Hey @dunfash! At the moment only Common Voice 6 is available via the datasets library, but we’re working with the Mozilla Foundation team to enable automatic downloads for all versions of the CV dataset in the coming week!

1 Like