Model selection principles in misspecified models
type="main" xml:id="rssb12023-abs-0001"> <title type="main">Summary</title> <p>Model selection is of fundamental importance to high dimensional modelling featured in many contemporary applications. Classical principles of model selection include the Bayesian principle and the Kullback–Leibler divergence principle, which lead to the Bayesian information criterion and Akaike information criterion respectively, when models are correctly specified. Yet model misspecification is unavoidable in practice. We derive novel asymptotic expansions of the two well-known principles in misspecified generalized linear models, which give the generalized Bayesian information criterion and generalized Akaike information criterion. A specific form of prior probabilities motivated by the Kullback–Leibler divergence principle leads to the generalized Bayesian information criterion with prior probability, <math xmlns="http://www.w3.org/1998/Math/MathML" xmlns:wiley="http://www.wiley.com/namespaces/wiley/wiley" altimg="urn:x-wiley:13697412:media:rssb12023:rssb12023-math-0001" wiley:location="equation/rssb12023-math-0001.gif"><mrow><msub><mrow><mtext >GBIC</mtext></mrow><mrow><mi>p</mi></mrow></msub></mrow></math>, which can be naturally decomposed as the sum of the negative maximum quasi-log-likelihood, a penalty on model dimensionality, and a penalty on model misspecification directly. Numerical studies demonstrate the advantage of the new methods for model selection in both correctly specified and misspecified models.
Year of publication: |
2014
|
---|---|
Authors: | Lv, Jinchi ; Liu, Jun S. |
Published in: |
Journal of the Royal Statistical Society Series B. - Royal Statistical Society - RSS, ISSN 1369-7412. - Vol. 76.2014, 1, p. 141-167
|
Publisher: |
Royal Statistical Society - RSS |
Saved in:
Online Resource
Saved in favorites
Similar items by person
-
Panning for gold : ‘model‐X’ knockoffs for high dimensional controlled variable selection
Candès, Emmanuel, (2018)
-
High dimensional covariance matrix estimation using a factor model
Fan, Jianqing, (2008)
-
Aggregation of nonparametric estimators for volatility matrix
Fan, Jianqing, (2007)
- More ...