comment out
#from transformers import AdamW
change the optimizer to PyTorch AdamW implementation
optimizer = torch.optim.AdamW(optimizer_grouped_parameters, lr=1e-5)
comment out
#from transformers import AdamW
change the optimizer to PyTorch AdamW implementation
optimizer = torch.optim.AdamW(optimizer_grouped_parameters, lr=1e-5)