We argue that comprehensive out-of-sample (OOS) evaluation using statistical decision theory (SDT) should replace the current practice of K-fold and Common Task Framework validation in machine learning (ML) research. SDT provides a formal framework for performing comprehensive OOS evaluation...

This paper uses Wald's concept of the risk of a statistical decision function to address the question: How should sample data on treatment response be used to guide treatment choices in a heterogeneous population? Statistical treatment rules (STRs) are statistical decision functions that map...

"Although uncertainty is common in patient care, it has not been largely addressed in research on evidence-based medicine. Patient Care Under Uncertainty strives to correct this huge omission. For the past few years, renowned economist Charles Manski has been applying the statistical tools of...