For example, this framework provides several possible measures that are applicable when a researcher wants to assess the consensus between judges who are asked to code a number of items into mutually exclusive qualitative categories. Measures of this latter type have been proposed by several researchers, including Perrault and Leigh in 1989.
To illustrate, this framework offers various methods that can be employed when a researcher seeks to determine the level of agreement among judges who are asked to categorize a number of items into separate, qualitative groups. Researchers such as Perrault and Leigh proposed these measures in their 1989 work.