CALCULATING PROBABILITY DENSITIES WITH HOMOTOPY AND APPLICATIONS TO PARTICLE FILTERS

Juan M. Restrepo, Jorge M. Ramírez

Research output: Contribution to journalArticlepeer-review

Abstract

We explore a homotopy sampling procedure and its generalization, loosely based on importance sampling, known as annealed importance sampling. The procedure makes use of a known probability distribution to find, via homotopy, the unknown normalization of a target distribution, as well as samples of the target distribution. We propose a reformula-tion of the method that leads to a rejection sampling alternative. Estimates of the error as a function of homotopy stages and sample averages are derived for the algorithmic version of the method. These estimates are useful in making computational efficiency decisions on how the calculation should proceed, given a computer architecture. Consideration is given to how the procedure can be adapted to Bayesian stationary and nonstationary estimation problems. The connec-tion between homotopy sampling and thermodynamic integration is made. Emphasis is placed on the non-stationary problems, and in particular, on a sequential estimation technique known as particle filtering. It is shown that a mod-ification of the particle filter framework to include the homotopy process can improve the computational robustness of particle filters.

Original languageEnglish
Pages (from-to)71-89
Number of pages19
JournalInternational Journal for Uncertainty Quantification
Volume12
Issue number5
DOIs
StatePublished - 2022

Funding

The reviewers were very helpful in suggesting improvements to the paper. It was during the review that they pointed out that the specific expression for the homotopy functional θs(x) [cf. Eq. (2)] was proposed earlier by Neal. We are pleased to have the opportunity to acknowledge this here in a timely way. The submitted paper [4] was authored by a contractor of the U.S. Government under Contract No. DE-AC05-00OR22725. Accordingly, the U.S. Government retains a nonexclusive, royalty-free license to publish or reproduce the published form of this contribution, or allow others to do so, for U.S. Government purposes. This work was also supported by NSF DMS Grant No. 0304890 and NSF OCE Grant No. 1434198. Part of this work was carried out at NERSC, in Bergen, Norway, and at Stockholm University through its Rossby Fellowship Program.

FundersFunder number
NSF OCE1434198
U.S. GovernmentDE-AC05-00OR22725
National Science Foundation0304890
Stockholms Universitet

    Keywords

    • Bayesian estimation
    • data assimilation
    • homotopy
    • sampling
    • sequential Monte Carlo

    Fingerprint

    Dive into the research topics of 'CALCULATING PROBABILITY DENSITIES WITH HOMOTOPY AND APPLICATIONS TO PARTICLE FILTERS'. Together they form a unique fingerprint.

    Cite this