Gated Orthogonal Recurrent Unit
If you find this work useful, please cite arXiv:1706.02761.
requires TensorFlow 1.2.0
To use GORU in your model, simply copy GORU.py.
Then you can use GORU in the same way you use built-in LSTM:
from GORU import GORUCell
cell = GORUCell(n_hidden, fft=True)
Args:
n_hidden
:Integer
.capacity
:Optional
.Integer
. Only works for tunable style.fft
:Optional
.Bool
. IfTrue
, GORU is set to FFT style. Default isTrue
.
Three tasks for RNN in the paper are shown here. Use -h
for more information
python copying_task.py --model GORU
python denoise_task.py --model GORU
python paren_task.py --model GORU