Www.ics.uci.edu

Note 2 to entry: there are two common kinds of RNN which are the Long Short Term Memory networks (LSTM) and the Gated Recurrent Unit (GRU) networks. Each of the LSTM cells have both an internal memory and a hidden state. LSTM have been introduced to solve the vanishing gradient problem in RNN. GRU is a simpler variant of LSTM. ................
................