Definition
A recurrent neural network processes a sequence by updating and carrying hidden state from one step to the next.
Distinguish it from nearby terms
A transformer relates sequence positions through attention and can process training tokens more parallelly; an RNN advances recurrently.
Check your understanding
Explain what information the hidden state must preserve and why long dependencies can be difficult.