Hi, not sure if I understand correctly
- Which “learn rate finder function” you use ? ( just curious as I am familiar of the idea coming from fast.ai team )
- spike in 10^-1 looks plausible to me since it’s too much big learning rate
- Did you initialize your model from some checkpoints ? If yes, maybe the model is already good and have small loss in the beginning, so small loss with LR=10^-7 is also plausible