before_revision: Recently, contextualized word embeddings outperform static word embeddings on many NLP tasks. However, we still don't know much about the mechanism inside these internal representationsproduced by BERT . Do they have any common patterns? What are the relations between word sense and context ? We find that nearly all the contextualized word vectors of BERT and RoBERTa have some common patterns . For BERT, the 557^{th} element is always the smallest. For RoBERTa, the 588^{th} element is always the largest  and the 77^{th} element is the smallest. We call them as "tails" of models. We  find that these "tails" are the major cause of anisotrpy of the vector space. After "cutting the tails", the same word's different vectors are more similar to each other. The internal representations also perform better on word-in-context (WiC) task. These suggest that " cutting the tails" can decrease the influence of context and better represent word sense .
after_revision: Recently, contextualized word embeddings outperform static word embeddings on many NLP tasks. However, we still do not know much about the mechanism inside these representations . Do they have any common patterns? If so, where do these patterns come from ? We find that almost all the contextualized word vectors of BERT and RoBERTa have a common pattern . For BERT, the 557^{th} element is always the smallest. For RoBERTa, the 588^{th} element is always the largest , and the 77^{th} element is the smallest. We call them "tails" of models. We introduce a new neuron-level method to analyze where these "tails" come from. We find that these "tails" are closely related to the positional information. We also investigate what will happen if we "cutting the tails" (zero-out). Our results show that "tails" are the major cause of anisotropy of vector space. After "cutting the tails", a word's different vectors are more similar to each other. The internal representations have a better ability to distinguish a word's different senses with the word-in-context (WiC) dataset. The performance on the word sense disambiguation task is better for BERT and unchanged for RoBERTa. We can also better induce phrase grammar from the vector space. These suggest that " tails" are less related to the sense and syntax information in vectors. These findings provide insights into the inner workings of contextualized word vectors .
edit_actions: R
edit_actions: don't
edit_actions: do not
edit_actions: fluency
edit_actions: coherence fluency fluency
edit_actions: R
edit_actions: internal representationsproduced by BERT
edit_actions: representations
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: What are the relations between word sense and context
edit_actions: If so, where do these patterns come from
edit_actions: clarity
edit_actions: clarity style clarity
edit_actions: R
edit_actions: nearly
edit_actions: almost
edit_actions: style
edit_actions: style clarity style
edit_actions: R
edit_actions: some common patterns
edit_actions: a common pattern
edit_actions: clarity
edit_actions: clarity style fluency
edit_actions: A
edit_actions: ,
edit_actions: fluency
edit_actions: fluency fluency fluency
edit_actions: D
edit_actions: as
edit_actions: fluency
edit_actions: fluency coherence fluency
edit_actions: A
edit_actions: introduce a new neuron-level method to analyze where these "tails" come from. We
edit_actions: meaning-changed
edit_actions: coherence meaning-changed meaning-changed
edit_actions: R
edit_actions: the
edit_actions: closely related to the positional information. We also investigate what will happen if we "cutting the tails" (zero-out). Our results show that "tails" are the
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed
edit_actions: R
edit_actions: anisotrpy of the
edit_actions: anisotropy of
edit_actions: fluency
edit_actions: fluency fluency fluency
edit_actions: R
edit_actions: the same
edit_actions: a
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: also perform better on
edit_actions: have a better ability to distinguish a word's different senses with the
edit_actions: clarity
edit_actions: style clarity clarity
edit_actions: R
edit_actions: task.
edit_actions: dataset. The performance on the word sense disambiguation task is better for BERT and unchanged for RoBERTa. We can also better induce phrase grammar from the vector space.
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed
edit_actions: D
edit_actions: cutting the
edit_actions: style
edit_actions: style style style
edit_actions: R
edit_actions: can decrease the influence of context and better represent word sense
edit_actions: are less related to the sense and syntax information in vectors. These findings provide insights into the inner workings of contextualized word vectors
edit_actions: meaning-changed
edit_actions: style meaning-changed meaning-changed