We argue that comprehensive out-of-sample (OOS) evaluation using statistical decision theory (SDT) should replace the current practice of K-fold and Common Task Framework validation in machine learning (ML) research. SDT provides a formal framework for performing comprehensive OOS evaluation...

"Although uncertainty is common in patient care, it has not been largely addressed in research on evidence-based medicine. Patient Care Under Uncertainty strives to correct this huge omission. For the past few years, renowned economist Charles Manski has been applying the statistical tools of...

The Wald development of statistical decision theory addresses decision making with sample data. Wald's concept of a statistical decision function (SDF) embraces all mappings of the form [data → decision]. An SDF need not perform statistical inference; that is, it need not use data to draw...