Setup questions

Course
1

Use this topic for any questions related to Chapter 0 of the course.

2

Hi @sgugger, thank you for the course. Is it advisable to use a dockerized container as a coding environment on a windows machine? Or inside a WSL2 layer? Or does something or the other may create issues later? (Asking because I have faced a lot of issues with NCCL failure while trying to run XGboost et al on a RAPIDS installation on WSL2).

3

I haven’t personally tries on WSL2 but it should work pretty well as long as your GPU is recognized.

2 Likes
4

Hi, @sgugger!
In order to go through the first code snippet like

from transformers import pipeline
classifier = pipeline("sentiment-analysis")
classifier("I've been waiting for a HuggingFace course my whole life.")

I needed to do the next things after activating the virtual environment:

pip install ipykernel
python -m ipykernel install --user --name=.env

After that I was able to choose needed virtual environment in jupyter notebook and run the code without errors.
Otherwise I’ve had only Python 3 kernel in jupyter notebook and got messages like “ModuleNotFoundError: No module named ‘transformers’” even though I went through all the setup steps and which python and pip list showed expected results (for the first I saw path to the venv python and for second I saw transformers library in the list).

Is it just me or setup chapter doesn’t cover all the steps?

P.S. I’m using Windows 10 and Python 3.8.10

5

The setup does not cover locally installing jupyter notebook, either you are experienced enough to do it yourself, or we recommend using colab. That’s why those instructions are not included :slight_smile:

2 Likes
6

When I try running the command “from transformers import pipeline”
section 3 of chapter 1 of the course in colab, I am getting the following error:

OSError                                   Traceback (most recent call last)
<ipython-input-2-69a9fd07ccac> in <module>()
----> 1 from transformers import pipeline

20 frames
/usr/lib/python3.7/ctypes/__init__.py in __init__(self, name, mode, handle, use_errno, use_last_error)
    362 
    363         if handle is None:
--> 364             self._handle = _dlopen(self._name, mode)
    365         else:
    366             self._handle = handle

OSError: /usr/local/lib/python3.7/dist-packages/torchaudio/_torchaudio.so: undefined symbol: _ZN2at6detail10noopDeleteEPv

Any idea how to fix it?

7

It comes from torchaudio, for some reason. I’ve removed that from the deps installed so if you retry to open the notebook on Colab, it should work now.

1 Like
8

It is working now. Thank you.

1 Like
9

Thank you for creating this course! :blush:

I am going through the setup doc where it asks to install development version by running the following command.

!pip install transformers[sentencepiece]

Could you explain why we are passing sentencepiece as an extra instead of passing “dev” like below

!pip install transformers[dev]
10

The dev install was broken on Colab for a few days, because there were incompatible versions of torch and torchaudio, so we switch to something lighter.

1 Like