Kappa statistics can be used for inter and intra-rater reliability measurements. They can also be used in situations where there are multiple raters (such as 20 physicians measuring 100 patients knees), and for multiple observations (for example, if the physicians assessed the knees as normal, slightly swollen, moderately swollen or extremely swollen).