Loading datasets on MacOS X causing segmentation fault

Beginners
1

I get a segmentation fault when trying to import load_dataset from datasets on my MacOS X (M1). I am providing information that I hope would be relevant. Please let me know if I can overcome this in some way?

% python --version
Python 3.11.5
% pip install transformers
% pip install 'transformers[torch]'
% pip install datasets
% python -c "from datasets import load_dataset; print(load_dataset('squad', split='train')[0])"
zsh: segmentation fault  python3 -c
2

Versions installed:

  • transformers: 4.40.0
  • torch: 2.2.2
  • datasets: 2.19.0