I am trying to run the following lines of code:
from datasets import load_dataset
wiki_data = load_dataset(“wikipedia”, language=“en”, date=“20230101”, beam_runner=“DirectRunner”)
However, the script gets stuck after I’ve seen the message:
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args:
What can be the problem and how to solve it?