Out-of-sample forecasting tests of DSGE models against time-series benchmarks such as an unrestricted VAR are increasingly used to check a) the specification b) the forecasting capacity of these models. We carry out a Monte Carlo experiment on a widely-used DSGE model to investigate the power of...

Common approaches to test for the economic value of directional forecasts are based on the classical Chi-square test for independence, Fisher’s exact test or the Pesaran and Timmerman (1992) test for market timing. These tests are asymptotically valid for serially independent observations....

Forecast evaluations aim to choose an accurate forecast for making decisions by using loss functions. However, different loss functions often generate different ranking results for forecasts, which complicates the task of comparisons. In this paper, we develop statistical tests for comparing...

We introduce a learning framework in which a principal seeks to determine the ability of a strategic agent. The principal assigns a test consisting of a finite sequence of tasks. The test is adaptive: each task that is assigned can depend on the agent's past performance. The probability of...

We study the problem of testing an expert whose theory has a learnable and predictive parametric representation, as do standard processes used in statistics. We design a test in which the expert is required to submit a date T by which he will have learned enough to deliver a sharp, testable...

Since central banks have limited information concerning the transmission channel of monetary policy, they are faced with the difficult task of simultaneously controlling the policy target and estimating the impact of policy actions. A tradeoff between estimation and control arises because policy...

Empirical evidence on the out-of-sample performance of asset-pricing anomalies is mixed so far and arguably is often subject to data-snooping bias. This paper proposes a method that can significantly reduce this bias. Specifically, we consider a long-only strategy that involves only published...

We consider a cross-calibration test of predictions by multiple potential experts in a stochastic environment. This test checks whether each expert is calibrated conditional on the predictions made by other experts. We show that this test is good in the sense that a true expert - one informed of...

We suggest a robust form of conditional moment test as a constructive test for functional misspecification in multiplicative error models. The proposed test has power solely against violations of the conditional mean restriction but is not affected by any other type of model misspecification....