Showing 1 - 10 of 17
We argue that comprehensive out-of-sample (OOS) evaluation using statistical decision theory (SDT) should replace the current practice of K-fold and Common Task Framework validation in machine learning (ML) research. SDT provides a formal framework for performing comprehensive OOS evaluation...
Persistent link: https://www.econbiz.de/10014512123
Persistent link: https://www.econbiz.de/10001337661
Persistent link: https://www.econbiz.de/10001586856
The Wald development of statistical decision theory addresses decision making with sample data. Wald's concept of a statistical decision function (SDF) embraces all mappings of the form [data → decision]. An SDF need not perform statistical inference; that is, it need not use data to draw...
Persistent link: https://www.econbiz.de/10011962436
Persistent link: https://www.econbiz.de/10014515902
Persistent link: https://www.econbiz.de/10013503040
Persistent link: https://www.econbiz.de/10013503310
Persistent link: https://www.econbiz.de/10000958394
This paper modifies the Wald development of statistical decision theory to offer new perspective on the performance of certain statistical treatment rules. We study the quantile performance of test rules, ones that use the outcomes of hypothesis tests to allocate a population to two treatments....
Persistent link: https://www.econbiz.de/10010433474
Persistent link: https://www.econbiz.de/10001500178