Tohoku University, RIKEN AIP; Kyoto University, RIKEN AIP
Word embedding;Euclidean norm;Skip-gram with Negative Sampling;Softmax function;Kullback-Leibler divergence;Information geometry;Exponential family of probability distributions
Norm of Word Embedding Encodes Information Gain