Yes, I worded it incorrectly but I hope it is clear what I meant, as I mentioned lr.
I don’t think your snippet is completely correct though (missing parameters in the second dict), and I am also not sure whether you can include the same params in two separate dicts, or what the consequences are when you do this. (In your snippet the pos embeddings are included in both model.parameters() and the second params dict.) Might need to make that distinction exclusive, but
I am not sure on that.