Cohen Kappa

Introduced to me when looking at inter-annotator agreement.

Resources

• https://en.wikipedia.org/wiki/Cohen%27s_kappa

Cohen’s kappa measures the agreement between two raters who each classify N items into C mutually exclusive categories. The definition of κ {\textstyle \kappa } is

$$\kappa \equiv \frac{p_o-p_e}{1-p_e}=1-\frac{1-p_o}{1-p_e},$$