 formula_23 is large), this does not necessarily mean that token formula_14 will attend to token formula_7 (i.e.formula_26 is large).The output of the attention unit for token formula_7 is the weighted sum of the value vectors of all tokens, weighted by formula_12, the attention from formula_7 to each token.