LR Scheduler help about adamwr

[mpyrozhok]

You can change your learning rate in any way you like, but the whole point of writing a scheduler is to abstract lr changes into a separate class. It looks like you're trying to incorporate your schedule straight into the main training loop. You can look at this file to get the idea of how it is usually done in PyTorch. Maybe it could also be helpful to walk through some tutorials at PyTorch site to get a feeling of how the training loop is constructed and how schedulers fit in it.