before_revision: One key principle for assessing textual similarity is measuring the degree of semantic overlap between two texts by considering the word alignment. Such alignment-based approaches are both intuitive and interpretable; however, they are empirically inferior to the simple cosine similarity between general-purpose sentence vectors. To remedy this , we focus on  the fact that the norm of word vectors is a good proxy for word importance, and the angle of them is a good proxy for word similarity. Alignment-based approaches do not distinguish the norm and direction , whereas sentence-vector approaches automatically use the norm as the word importance. Accordingly, we propose to decouple word vectors into their norm and direction then computing the alignment-based similarity using earth mover's distance (  optimal transport cost), which we refer to as word rotator's distance. Furthermore, we demonstrate how to grow the norm and direction of word vectors (vector converter) ; this is a new systematic approach derived from the sentence-vector estimation methods , which can significantly improve the performance of the proposed method . On several STS benchmarks, our simple proposed methods outperformed not only alignment-based approaches but also strong baselines. 
after_revision: A key principle in assessing textual similarity is measuring the degree of semantic overlap between two texts by considering the word alignment. Such alignment-based approaches are intuitive and interpretable; however, they are empirically inferior to the simple cosine similarity between general-purpose sentence vectors. To address this issue , we focus on and demonstrate the fact that the norm of word vectors is a good proxy for word importance, and their angle is a good proxy for word similarity. Alignment-based approaches do not distinguish them , whereas sentence-vector approaches automatically use the norm as the word importance. Accordingly, we propose a method that first decouples word vectors into their norm and direction , and then computes alignment-based similarity using earth mover's distance ( i.e., optimal transport cost), which we refer to as word rotator's distance. Besides, we find how to grow the norm and direction of word vectors (vector converter) , which is a new systematic approach derived from sentence-vector estimation methods . On several textual similarity datasets, the combination of these simple proposed methods outperformed not only alignment-based approaches but also strong baselines. The source code is available at URL
edit_actions: R
edit_actions: One key principle for
edit_actions: A key principle in
edit_actions: clarity
edit_actions: clarity clarity fluency
edit_actions: D
edit_actions: both
edit_actions: clarity
edit_actions: clarity clarity fluency
edit_actions: R
edit_actions: remedy this
edit_actions: address this issue
edit_actions: clarity
edit_actions: clarity clarity style
edit_actions: A
edit_actions: and demonstrate
edit_actions: clarity
edit_actions: clarity coherence clarity
edit_actions: R
edit_actions: the angle of them
edit_actions: their angle
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: the norm and direction
edit_actions: them
edit_actions: clarity
edit_actions: style clarity clarity
edit_actions: R
edit_actions: to decouple
edit_actions: a method that first decouples
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: R
edit_actions: then computing the
edit_actions: , and then computes
edit_actions: clarity
edit_actions: clarity clarity clarity
edit_actions: A
edit_actions: i.e.,
edit_actions: coherence
edit_actions: coherence fluency coherence
edit_actions: R
edit_actions: Furthermore, we demonstrate
edit_actions: Besides, we find
edit_actions: coherence
edit_actions: clarity coherence coherence
edit_actions: R
edit_actions: ; this
edit_actions: , which
edit_actions: coherence
edit_actions: clarity coherence coherence
edit_actions: D
edit_actions: the
edit_actions: fluency
edit_actions: fluency fluency clarity
edit_actions: D
edit_actions: , which can significantly improve the performance of the proposed method
edit_actions: clarity
edit_actions: clarity coherence clarity
edit_actions: R
edit_actions: STS benchmarks, our
edit_actions: textual similarity datasets, the combination of these
edit_actions: clarity
edit_actions: clarity meaning-changed clarity
edit_actions: A
edit_actions: The source code is available at URL
edit_actions: meaning-changed
edit_actions: meaning-changed meaning-changed meaning-changed