Proposal adaptation in simulated annealing for continuous optimization problems
In recent years, adaptive Markov Chain Monte Carlo (MCMC) methods have become a standard tool for Bayesian parameter estimation. In adaptive MCMC, the past iterations are used to tune the proposal distribution of the algorithm. The same adaptation mechanisms can be used in Simulated Annealing (SA), a popular optimization method based on MCMC. The difficulty in using adaptation directly in SA is that the target function changes along the iterations in the annealing process, and the adaptation should keep up with the annealing. In this paper, a mechanism for automatically tuning the proposal distribution in SA is proposed. The approach is based on the Adaptive Metropolis algorithm of Haario et al. (Bernoulli 7(2):223–242, <CitationRef CitationID="CR11">2001</CitationRef>), combined with a weighting mechanism to account for the cooling target. The proposed adaptation mechanism does not add any computational complexity to the problem in terms of objective function evaluations. The effect of adaptation is demonstrated using two benchmark problems, showing that the proposed adaptation mechanism can significantly improve optimization results compared to non-adaptive SA. The approach is presented for continuous optimization problems and generalization to integer and mixed-integer problems is a topic of future research. Copyright Springer-Verlag Berlin Heidelberg 2013
Year of publication: |
2013
|
---|---|
Authors: | Solonen, Antti |
Published in: |
Computational Statistics. - Springer. - Vol. 28.2013, 5, p. 2049-2065
|
Publisher: |
Springer |
Subject: | Adaptive MCMC | Importance sampling | Optimization | Simulated annealing |
Saved in:
Online Resource
Saved in favorites
Similar items by subject
-
SIMANN: A Global Optimization Algorithm using Simulated Annealing
Goffe, William L., (1996)
-
A novel hybrid meta-heuristic technique applied to the well-known benchmark optimization problems
Abtahi, Amir-Reza, (2017)
-
Velik, Rosemarie, (2016)
- More ...