<p>There is at least one <a href="https://arxiv.org/pdf/2002.08264.pdf" rel="nofollow noreferrer">paper</a> which adapts the attention mechanism to a non-nlp area: The molecule attention transformer. Molecules are constructed like a graph, similar to a sentence. An atom has a distance to the other atoms and they are dependent to each other, like words are in a sentence. In the paper, they "adapt Transformer (Devlin et al., 2018) to  chemical  molecules  by  augmenting  the  self-attention with inter-atomic distances and molecular graph structure."</p>

<p>But there are probably more application fields for transformers, at least where data has a graph-like structure and nodes are somehow dependent to each other.</p>
Attention examples that used on non-NLP area?
<p>When I am looking for attention implementation examples, encoder-decoder structure with attention always comes to the first. Is there any examples that using attention for other area besides NLP?</p>