 Each decoder does the opposite, taking all the encodings and processing them, using their incorporated contextual information to generate an output sequence.To achieve this, each encoder and decoder makes use of an attention mechanism, which for each input, weighs the relevance of every input and draws information from them accordingly when producing the output.Each decoder also has an additional attention mechanism which draws information from the outputs of previous decoders, before the decoder draws information from the encodings.