 Since Transformer models have multiple attention heads, they have the possibility of capturing many levels and types of relevance relations, from surface-level to semantic.The multiple outputs for the multi-head attention layer are concatenated to pass into the feed-forward neural network layers.Each encoder consists of two major components