Recurrent neural network

Recurrent neural network (RNN) is a class of artificial neural network that utilizes information arbitrarily in long sequences. It represents history by neurons with recurrent connections. It can learn to compress unlimited history in low dimensional space. Contrary to the traditional neural network that all inputs and outputs are independent of each other.

Recurrent networks have the capability to form short term memory that enable them to deal with position invariance which feedforward networks cannot do. RNNs are called recurrent due to its performance of the same task for every element of a sequence with the output being depended on the previous computations.