 To process the formula_1 token, the model combines the internal state representing the sentence up to token formula_2 with the information of the new token to create a new latent state, that represents the sentence up to token formula_3.Theoretically, the information from one token can propagate arbitrarily far down the sequence, if at every point the internal state continues to encode information about the token.In practice, however, this mechanism is imperfect