The learning mechanism of the recurrent neural network thus involves:
...
(3) the optimization algorithm, that changes the parameters of the RNN based on the gradient.
status
not read
reprioritisations
last reprioritisation on
suggested re-reading day
started reading on
finished reading on
Parent (intermediate) annotation
Open it The learning mechanism of the recurrent neural network thus involves: (1) the forward propagation step where the cross- entropy loss is calculated; (2) the backpropagation step where the gradient of the parameters with respect to the loss is calculated; and finally, (3) the optimization algorithm, that changes the parameters of the RNN based on the gradient.