Backtesting risk measures represents a challenge and complex methods are often required. In this paper, we propose a new framework for backtesting that can be applied to every law invariant risk measures. We base our approach on the formalization of the concept of level of coverage associated...

Macroeconomic risk assessments play an important role in the forecasts of many institutions. However, to the best of our knowledge their performance has not been investigated yet. In this work, we study the Bank of England?s risk forecasts for inflation. We find that these forecasts do not...

This paper evaluates current strategies for the empirical modeling of forecast behavior. In particular, we focus on the reliability of using proxies from time series models of heteroskedasticity to describe changes in predictive confidence. We address this issue by examining the relationship...

Macroeconomic risk assessments play an important role in the forecasts of many institutions. However, to the best of our knowledge their performance has not been investigated yet. In this work, we study the Bank of England's risk forecasts for inflation. We find that these forecasts do not...

Macroeconomic risk assessments play an important role in the forecasts of many institutions. A risk forecast is related to the potential asymmetry of the forecast density. In this work, we investigate how the optimality of such risk forecasts can be tested. We find that the Pearson mode skewness...

Surveying the forecasting practice of several central banks, we find that all these banks issue statements about risks to their macroeconomic forecasts. Often the balance of these risks is assessed as well. Upward [downward] risks to the forecast commonly imply that the outturn is expected to...

We have argued that from the standpoint of a policy maker, the uncertainty of using the average forecast is not the variance of the average, but rather the average of the variances of the individual forecasts that incorporate idiosyncratic risks. With a slight reformulation of the loss function...

The forecasting uncertainty around point macroeconomic forecasts is usually measured by the historical performance of the forecasting model, using measures such as root mean squared forecasting errors (RMSE). This measure, however, has the major drawback that it is constant over time and hence...