The paper proposes a new algorithm for finding the confidence set of a collection of forecasts or prediction models. Existing numerical implementations for finding the confidence set use an elimination approach where one starts with the full collection of models and successively eliminates the...

We develop a method of testing linearity using power transforms of regressors, allowing for stationary processes and time trends. The linear model is a simplifying hypothesis that derives from the power transform model in three different ways, each producing its own identification problem. We...

Backtesting stock market investment strategies is fraught with danger – for example, overfitting. The signal to noise ratio in stock markets is so low that overfitting is inevitable. Simulation offers a means of assessing and compensating for the dangers. It is not obvious at first how...

This paper provides practical insights into common statistical measures used to validate a model's discriminatory power for the probability of default (PD), loss liven default (LGD) and exposure at default (EAD). The study has more of an informative value without delivering empirical evidence....

Generalized Information Matrix Tests (GIMTs) have recently been used for detecting the presence of misspecification in regression models in both randomized controlled trials and observational studies. In this paper, a unified GIMT framework is developed for the purpose of identifying,...

We provide a methodology for testing a polynomial model hypothesis by extending the approach and results of Baek, Cho, and Phillips (2015; Journal of Econometrics; BCP) that tests for neglected nonlinearity using power transforms of regressors against arbitrary nonlinearity. We examine and...

We argue that frequentist hypothesis testing - the dominant statistical evaluation paradigm in empirical research - is fundamentally unsuited for analysis of the nonexperimental data prevalent in economics and other social sciences. Frequentist tests comprise incompatible repeated sampling...

This paper demonstrates that unit root tests can suffer from inflated Type I error rates when data are cointegrated. Results from Monte Carlo simulations show that three commonly used unit root tests - the ADF, Phillips-Perron, and DF-GLS tests - frequently overreject the true null of a unit...

Inference using large datasets is not nearly as straightforward as conventional econometric theory suggests when the disturbances are clustered, even with very small intra-cluster correlations. The information contained in such a dataset grows much more slowly with the sample size than it would...

The paper develops an asymptotically valid F test that is robust to spatial autocorrelation in a GMM framework. The test is based on the class of series covariance matrix estimators and fixed-smoothing asymptotics. The fixed-smoothing asymptotics and F approximation are established under mild...