Why is Trainer only using 1 (not 4) GPUs?

[drscotthawley]

Tried taking a look at accelerate example notebook for SimpleNLP, but it crashes with SIGSEV for me:

Simple NLP Example not working

I too am seeing the SIGSEV error when I run the Simple NLP example on an A100 pod: --------------------------------------------------------------------------- ProcessExitedException Traceback (most recent call last) Input In [25], in <cell line: 3>() 1 from accelerate import notebook_launcher ----> 3 notebook_launcher(training_function, num_processes=4) File ~/envs/wav2vec/lib/python3.9/site-packages/accelerate/launchers.py:129, in notebook_launcher(function, args, num…