What is exactly the attention mechanism introduced to RNN (recurrent neural network)? It would be nice if you could make it easy to understand!
Is Hebbian learning mechanism is essential to learn for better understanding artificial neural network? Is it okay to skip Hebbian mechanism?