This paper introduces the model confidence set (MCS) and applies it to the selection of models. An MCS is a set of models that is constructed so that it will contain the best model with a given level of confidence. The MCS is in this sense analogous to a confidence interval for a parameter. The...

Abstract A nonparametric method for comparing multiple forecast models is developed and implemented. The hypothesis of Optimal Predictive Ability generalizes the Superior Predictive Ability hypothesis from a single given loss function to an entire class of loss functions. Distinction is drawn...

We consider a cross-calibration test of predictions by multiple potential experts in a stochastic environment. This test checks whether each expert is calibrated conditional on the predictions made by other experts. We show that this test is good in the sense that a true expert - one informed of...

Forecasts are useless whenever the forecast error variance fails to be smaller than the unconditional variance of the target variable. This paper develops tests for the null hypothesis that forecasts become uninformative beyond some limiting forecast horizon h. Following Diebold and Mariano (DM,...

We develop a forecasting method for the manufacturer and online seller of a product collection that changes periodically and radically. The firm, an industry leader in technology and quality, has experienced double-digit annual sales growth. In seeking to minimize supply-demand mismatch costs...

VaR remains important in market risk management as Basel keeps most of the backtesting based on 1% VaR. Comparative backtesting as practiced in the current literature suffers from a major double problem. On the one hand, the score functions, although strictly consistent, may assign very good or...

We present in this paper an alternative approach to determining and predicting the fluctuations in the daily prices and stock returns of a first-generation bank in the Nigerian Stock Market (NSM). The approach uses a three-state Markov to estimate the expected duration of the asset returns in...