While fine-tuning my network, I would like to set up a polynomial learning rate scheduler by setting
However, when I visualize the learning rate on the wandb dashboard, I’m observing a linear decrease of the learning rate instead of polynomial. (Screenshot below)
What might be causing the issue? I’ve tested without setting the
learning_rate and the behavior was exactly the same.