The replicability and credibility crisis in psychology and economics sparked the debate on underpowered experiments, publication biases, and p-hacking. Analyzing the number of independent observations of experiments published in Experimental Economics, Games and Economic Behavior, and the...

I derive a rigorous method to help determine whether a true parameter takes a value between two arbitrarily chosen points for a given level of confidence via a multiple testing procedure which strongly controls the familywise error rate. For any test size, the distance between the upper and...

Researchers utilizing regression discontinuity design (RDD) commonly test for running variable (RV) manipulation around a cutoff, but incorrectly assert that insignificant manipulation test statistics are evidence of negligible manipulation. I introduce simple frequentist equivalence testing...

In this paper we address a challenging aspect that arises in the regulatory requirement of back-testing the accuracy of distributional forecasts. The latter are core to measurement and capitalization of counterparty risk for banks under the IMM (Internal Models Method). The problem is very...

We argue that frequentist hypothesis testing - the dominant statistical evaluation paradigm in empirical research - is fundamentally unsuited for analysis of the nonexperimental data prevalent in economics and other social sciences. Frequentist tests comprise incompatible repeated sampling...

We develop a method of testing linearity using power transforms of regressors, allowing for stationary processes and time trends. The linear model is a simplifying hypothesis that derives from the power transform model in three different ways, each producing its own identification problem. We...

Women are underrepresented in academia in general and economics in particular. I introduce a test to detect an under-researched form of hiring bias: implicit quotas. I derive a test under the null hypothesis of gender-blind hiring that requires no additional information about individual hires...

The problem of determining the probability model (distribution) that generates observed data commonly arises in econometrics, decision making under ambiguity, robust control, and allied fields. We develop novel procedures that use the Hellinger distance to distinguish distributions based on...

Permutation techniques, where one recompute the test statistic over permutations of data, have a long history in statistics and have become increasingly useful as the availability of computational power has increased. Until now, no permutation tests for examining returns to scale assumptions,...

We propose a new specification test to assess the validity of the judge leniency design. We characterize a set of sharp testable implications, which exploit all the relevant information in the observed data distribution to detect violations of the judge leniency design assumptions. The proposed...