Inter-rater reliability
MEASURE OF CONSENSUS IN RATINGS GIVEN BY MULTIPLE OBSERVERS
Inter-rater agreement; Inter-observer reliability; Inter-judge reliability; Interrater reliability; Interrater agreement; Limit of agreement; Agreement limit; Limits of agreement; Inter-rater variability; Inter-observer variability; Observer variability; Intra-observer variability; Inter-annotator agreement; Inter‐rater
In statistics, inter-rater reliability (also called by various similar names, such as inter-rater agreement, inter-rater concordance, inter-observer reliability, inter-coder reliability, and so on) is the degree of agreement among independent observers who rate, code, or assess the same phenomenon.