Empirically Relevant Critical Values For Hypothesis Tests: The Bootstrap to the Rescue

Tests of statistical hypotheses can be based on either of two critical values: the Type I critical value or the size-corrected critical value. The former usually depends on unknown population parameters and cannot be evaluated exactly in applications, but it can often be estimated very accurately by using the bootstrap. The latter does not depend on unknown population parameters but is likely to yield a test with low power. The critical values used in most Monte Carlo studies of the powers of tests are neither Type I nor size-corrected. They are irrelevant to empirical research.