In this paper we present an evaluation framework for predictions of binary events in probabilistic electricity price forecasting. It employs the MSE-equivalent QPS together with the DM test and allows for further insights about deficiencies of the considered models. Additionally, techniques from...