Cosine similarity is magnitude Agnostic

While the L1, L2 norms, and p-norm in general are distance functions which take into consideration the magnitude of the two vectors involved, the cosine similarity only indicates how strong are they aligned, regardless of their magnitude. Cosine similarity is the default choice in comparing word embeddings.

Resources

Backlinks