Paper under double-blind review
Pretrained Word Representations;Lightweight Representations;NLP;Social Bias;Word Embeddings
BERT Wears GloVes: Distilling Static Embeddings from Pretrained Contextual Representations