ImportError: cannot import name 'get_scheduler' from 'transformers'

Beginners
1

Hi, I’m new to Transformer models, just following the tutorials. On Huggingface website, under Course/ 3 Fine tuning a pretrained model/ full training, I just followed your code in course:

from transformers import get_scheduler

num_epochs = 3
num_training_steps = num_epochs * len(train_dataloader)
lr_scheduler = get_scheduler(
“linear”,
optimizer=optimizer,
num_warmup_steps=0,
num_training_steps=num_training_steps,
)
print(num_training_steps)

But it run into this error:

ImportError Traceback (most recent call last)
in
----> 1 from transformers import get_scheduler
2
3 num_epochs = 3
4 num_training_steps = num_epochs * len(train_dataloader)
5 lr_scheduler = get_scheduler(

ImportError: cannot import name ‘get_scheduler’ from ‘transformers’ (/Users/myname/opt/anaconda3/lib/python3.8/site-packages/transformers/init.py)

I’ve re installed torch, still the same error. How to fix this?

2

Try

from transformers.optimization import get_scheduler
3

Continuing the discussion from ImportError: cannot import name 'get_scheduler' from 'transformers':

Thanks very much! However, I tried but it gave me the same error message:
from transformers.optimization import get_scheduler

num_epochs = 3
num_training_steps = num_epochs * len(train_dataloader)
lr_scheduler = get_scheduler(
“linear”,
optimizer=optimizer,
num_warmup_steps=0,
num_training_steps=num_training_steps,
)
print(num_training_steps)

ImportError Traceback (most recent call last)
in
----> 1 from transformers.optimization import get_scheduler
2
3 num_epochs = 3
4 num_training_steps = num_epochs * len(train_dataloader)
5 lr_scheduler = get_scheduler(

ImportError: cannot import name ‘get_scheduler’ from ‘transformers.optimization’

4

Can you check the version of transformers in your environment? I’m just making a guess because I ran it in colab and it’s importing fine.

5

My transformers is 3.1.0. Should I change it? I’m running in Jupyter notebook, doest it matter?

Thanks a lot!

6

I tried to use Colab, same code, all worked! Also some of my previous didn’t work code worked too! Guess has something to do with Jupiter Notebook. Thanks a lot Merve!