A procedure for determining the effect of testletnonequivalence on the operating characteristics ofa testlet-based computerized mastery test (CMT) isintroduced. The procedure involves estimating theCMT decision rule twice-once with testlets treatedas equivalent and once with testlets treated...

This study presents a general method for estimating the classification reliability of complex decisions based on multiple scores from a single test administration. The proposed method consists of four steps that can be applied to a variety of measurement models and configural rules for combining...