Codes have been rewritten since the original author has publicized the codes. Below is a visual analysis among the four optimizers.
KruskalLin/Lookahead
Very simple implementation of lookahead optimizer in pytorch
README
Contributors
Very simple implementation of lookahead optimizer in pytorch
Codes have been rewritten since the original author has publicized the codes. Below is a visual analysis among the four optimizers.