Degeneracy in the maximum likelihood estimation of univariate Gaussian mixtures with EM
As is well known, the likelihood in the Gaussian mixture is unbounded for any parameters such that a Dirac is placed at any observed sample point. The behavior of the EM algorithm near a degenerated solution is studied. It is established that there exists a domain of attraction around degeneracy and that convergence to these particular solutions is extremely fast. It confirms what many practitioners already noted in their experiments. Some available proposals to avoid degenerating are discussed but the presented convergence results make it possible to defend the pragmatic approach to the degeneracy problem in EM which consists in random restarts.
Year of publication: |
2003
|
---|---|
Authors: | Biernacki, Christophe ; Chrétien, Stéphane |
Published in: |
Statistics & Probability Letters. - Elsevier, ISSN 0167-7152. - Vol. 61.2003, 4, p. 373-382
|
Publisher: |
Elsevier |
Keywords: | Degeneracy Maximum likelihood EM algorithm Gaussian mixtures Speed of convergence |
Saved in:
Online Resource
Saved in favorites
Similar items by person
-
A generative model for rank data based on insertion sort algorithm
Biernacki, Christophe, (2013)
-
A predictive deviance criterion for selecting a generative model in semi-supervised classification
Vandewalle, Vincent, (2013)
-
The morphology of built-up landscapes in Wallonia (Belgium): A classification using fractal indices
THOMAS, Isabelle,
- More ...