Department of Computer Science, ETH Zurich
Bobby He, Thomas Hofmann
transformers;signal propagation theory;self-attention;initialisation;simpler architectures;skip connections;normalisation;fast training speed
Simplifying Transformer Blocks