torch.nn.functional.cosine_similarity

torch.nn.functional.cosine_similarity(x1, x2, dim=1, eps=1e-8) → Tensor

Returns cosine similarity between x1 and x2, computed along dim.

$$\text{similarity} = \dfrac{x_1 \cdot x_2}{\max(\Vert x_1 \Vert _2 \cdot \Vert x_2 \Vert _2, \epsilon)}$$

Parameters

• x1 (Tensor) – First input.

• x2 (Tensor) – Second input (of size matching x1).

• dim (int, optional) – Dimension of vectors. Default: 1

• eps (float, optional) – Small value to avoid division by zero. Default: 1e-8

Shape:

• Input: $(\ast_1, D, \ast_2)$ where D is at position dim.

• Output: $(\ast_1, \ast_2)$ where 1 is at position dim.

Example:

>>> input1 = torch.randn(100, 128)
>>> input2 = torch.randn(100, 128)
>>> output = F.cosine_similarity(input1, input2)
>>> print(output)