Abstract
We explore a homotopy sampling procedure and its generalization, loosely based on importance sampling, known as annealed importance sampling. The procedure makes use of a known probability distribution to find, via homotopy, the unknown normalization of a target distribution, as well as samples of the target distribution. We propose a reformula-tion of the method that leads to a rejection sampling alternative. Estimates of the error as a function of homotopy stages and sample averages are derived for the algorithmic version of the method. These estimates are useful in making computational efficiency decisions on how the calculation should proceed, given a computer architecture. Consideration is given to how the procedure can be adapted to Bayesian stationary and nonstationary estimation problems. The connec-tion between homotopy sampling and thermodynamic integration is made. Emphasis is placed on the non-stationary problems, and in particular, on a sequential estimation technique known as particle filtering. It is shown that a mod-ification of the particle filter framework to include the homotopy process can improve the computational robustness of particle filters.
Original language | English |
---|---|
Pages (from-to) | 71-89 |
Number of pages | 19 |
Journal | International Journal for Uncertainty Quantification |
Volume | 12 |
Issue number | 5 |
DOIs | |
State | Published - 2022 |
Funding
The reviewers were very helpful in suggesting improvements to the paper. It was during the review that they pointed out that the specific expression for the homotopy functional θs(x) [cf. Eq. (2)] was proposed earlier by Neal. We are pleased to have the opportunity to acknowledge this here in a timely way. The submitted paper [4] was authored by a contractor of the U.S. Government under Contract No. DE-AC05-00OR22725. Accordingly, the U.S. Government retains a nonexclusive, royalty-free license to publish or reproduce the published form of this contribution, or allow others to do so, for U.S. Government purposes. This work was also supported by NSF DMS Grant No. 0304890 and NSF OCE Grant No. 1434198. Part of this work was carried out at NERSC, in Bergen, Norway, and at Stockholm University through its Rossby Fellowship Program.
Funders | Funder number |
---|---|
NSF OCE | 1434198 |
U.S. Government | DE-AC05-00OR22725 |
National Science Foundation | 0304890 |
Stockholms Universitet |
Keywords
- Bayesian estimation
- data assimilation
- homotopy
- sampling
- sequential Monte Carlo