 A clear example of the utility of attention is in machine translation.In an English-to-French machine translation system, the first word of the French output most probably depends heavily on the beginning of the English input.However, in a classic encoder-decoder LSTM model, in order to produce the first word of the French output the model is only given the state vector of the "last" English word.