Contrastive Learning

Contrastive Loss

Resources

• https://lilianweng.github.io/posts/2021-05-31-contrastive/#contrastive-loss

$L=(1-y)\cdot \frac{1}{2}{D}^2+y\cdot \frac{1}{2}{\left\{\max (0,m-D)\right\}}^2$

Used for example in Siamese Networks.