Terminating: fork() called from a process already using GNU OpenMP, this is unsafe

🤗Transformers
1

Hi, when i try to run prepare_dataset function in fine tuning ASR tutorial , i got this error.
I got this error
Terminating: fork() called from a process already using GNU OpenMP, this is unsafe.

There is no other logs available, so i have no clue what is the cause of it.

def prepare_dataset(batch):
    audio = batch["path"]
    # batched output is "un-batched"
    batch["input_values"] = processor(audio["array"], sampling_rate=audio["sampling_rate"]).input_values[0]
    batch["input_length"] = len(batch["input_values"])
    
    with processor.as_target_processor():
        batch["labels"] = processor(batch["text"]).input_ids
    return batch

urdudata = urdata.map(prepare_dataset, remove_columns=data.column_names["train"],
                      num_proc=4)
1 Like