Reducing variability of crossvalidation for smoothing-parameter choice
One of the attractions of crossvalidation, as a tool for smoothing-parameter choice, is its applicability to a wide variety of estimator types and contexts. However, its detractors comment adversely on the relatively high variance of crossvalidatory smoothing parameters, noting that this compromises the performance of the estimators in which those parameters are used. We show that the variability can be reduced simply, significantly and reliably by employing bootstrap aggregation or bagging. We establish that in theory, when bagging is implemented using an adaptively chosen resample size, the variability of crossvalidation can be reduced by an order of magnitude. However, it is arguably more attractive to use a simpler approach, based for example on half-sample bagging, which can reduce variability by approximately 50%. Copyright 2009, Oxford University Press.
Year of publication: |
2009
|
---|---|
Authors: | Hall, Peter ; Robinson, Andrew P. |
Published in: |
Biometrika. - Biometrika Trust, ISSN 0006-3444. - Vol. 96.2009, 1, p. 175-186
|
Publisher: |
Biometrika Trust |
Saved in:
Online Resource
Saved in favorites
Similar items by person
-
Interval-based hypothesis testing and its applications to economics and finance
Kim, Jae H., (2019)
-
LEITES, LAURA P., (2012)
-
An alternative objective function for fitting regression trees to functional response variables
Lane, Stephen E., (2011)
- More ...