congjianluo / tensorflowasgd

The tensorflow ASGD optimizer implement.

Tensorflow ASGD Optimizer

Custom Asynchronous Stochastic Gradient Descent Optimizer in Tensorflow.

It works like PyTorch ASGD. https://pytorch.org/docs/stable/_modules/torch/optim/asgd.html#ASGD

You can import it:

from TensorFlowASGD import AsynchronousStochasticGradientDescent

and use replace the optimizer tha you used:

optimizer = AsynchronousStochasticGradientDescent()

A simple LeNet example:

tensorflowasgd's Issues

代码问题

你好，感谢分享代码。请问你一个问题，感觉在代码中ax_t的更新并没有assing到var上啊，也就是说权值更新一直是按照SGD来的？