1.4.1 LSTM Weights
A memory cell has weight parameters for the input, output, as well as an internal state that is built up through exposure to input time steps.
...
Internal State.
Internal state used in the calculation of the output for this time step