The paper discusses several reliability measures: Scott’s pi, Krippendorff’s alpha, free marginal adjustment (Bennett, Alpert and Goldstein’s <InlineEquation ID="IEq1"> <EquationSource Format="TEX">$$S$$</EquationSource> <EquationSource Format="MATHML"> <math xmlns:xlink="http://www.w3.org/1999/xlink"> <mi>S</mi> </math> </EquationSource> </InlineEquation>), Cohen’s kappa, and Perreault and Leigh’s <InlineEquation ID="IEq2"> <EquationSource Format="TEX">$$I$$</EquationSource> <EquationSource Format="MATHML"> <math xmlns:xlink="http://www.w3.org/1999/xlink"> <mi>I</mi> </math> </EquationSource> </InlineEquation> and the assumptions on which they are based. It is suggested that...</equationsource></equationsource></inlineequation></equationsource></equationsource></inlineequation>