LSTM — Forget, Input, Output Gates & Cell State
Long Short-Term Memory: gating mechanisms for selective memory
Manual Gate Control
Forget gate f:
0.5
Input gate i:
0.5
Cell candidate g̃:
0.5
Output gate o:
0.5
Step forward
Reset state
Run demo sequence
Cell c(t)
0.000
Hidden h(t)
0.000
f
= sigmoid(·) — forget
i
= sigmoid(·) — input
g̃
= tanh(·) — candidate
o
= sigmoid(·) — output
c(t) = f·c(t-1) + i·g̃
h(t) = o·tanh(c(t))