Dynamical systems have memory

Dynamical systems, both continuous-state and finite-state ones, exhibit memory. This is due to the fact that the current location in state space is influenced by all previous locations. Recurrent neural networks use this memory in resolving short-term dependencies, especially in LSTMs.

Resources

Backlinks