Long Short-term Memory

DMCA

Long Short-term Memory (1995)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Sepp Hochreiter , Jürgen Schmidhuber

Citations:

454 - 58 self

BibTeX

@MISC{Hochreiter95longshort-term,
    author = {Sepp Hochreiter and Jürgen Schmidhuber},
    title = {Long Short-term Memory},
    year = {1995}
}

OpenURL

Abstract

"Recurrent backprop" for learning to store information over extended time intervals takes too long. The main reason is insufficient, decaying error back flow. We briefly review Hochreiter's 1991 analysis of this problem. Then we overcome it by introducing a novel, efficient method called "Long Short Term Memory" (LSTM). LSTM can learn to bridge minimal time lags in excess of 1000 time steps by enforcing constant error flow through internal states of special units. Multiplicative gate units learn to open and close access to constant error flow. LSTM's update

Keyphrases

short-term memory minimal time lag internal state review hochreiter main reason constant error flow error flow long short term memory multiplicative gate unit efficient method recurrent backprop extended time interval time step special unit

DMCA