Issue ESAIM: Proc. Volume 19, 2007 Conference Oxford sur les méthodes de Monte Carlo séquentielles Page(s) 101 - 107 DOI http://dx.doi.org/10.1051/proc:071913 Published online 30 October 2007

ESAIM: Proc., 2007, Vol. 19, pp. 101-107
DOI: 10.1051/proc:071913

Limit theorems for weighted samples with applications to sequential Monte Carlo methods

R. Douc¹ and E. Moulines<sup>2

1</sup>  CMAP, École Polytechnique, Palaiseau, France
²  Laboratoire Traitement et Communication de l'Information, CNRS / GET Télécom Paris, France

(Published online: 30 October 2007)

Abstract
In the last decade, sequential Monte-Carlo methods (SMC) emerged as a key tool in computational statistics (see for instance [Doucet, De Freitas and Gordon,Sequential Monte Carlo Methods in Practice. Springer, New York, 2001], [Liu. Monte Carlo Strategies in Scientific Computing. Springer, New York, 2001], [Künsch. Complex Stochastic Systems, 109-173, CRC Publisher, Boca raton, 2001]). These algorithms approximate a sequence of distributions by a sequence of weighted empirical measures associated to a weighted population of particles, which are generated recursively.

Despite many theoretical advances (see for instance [Gilks and Berzuini. J. Roy. Statist. Soc. Ser. B, 63(1), 127-146, 2001], [Künsch. Ann. Statist., 33(5), 1983-2021, 2005], [Del Moral. Feynman-Kac Formulae. Genealogical and Interacting Particle Systems with Applications, Springer, 2004], [Chopin. Ann. Statist., 32(6), 2385-2411, 2004]), the asymptotic property of these approximations remains a question of central interest. In this paper, we analyze sequential Monte Carlo (SMC) methods from an asymptotic perspective, that is, we establish law of large numbers and invariance principle as the number of particles gets large. We introduce the concepts of weighted sample consistency and asymptotic normality, and derive conditions under which the transformations of the weighted sample used in the SMC algorithm preserve these properties. To illustrate our findings, we analyze SMC algorithms to approximate the filtering distribution in state-space models. We show how our techniques allow to relax restrictive technical conditions used in previously reported works and provide grounds to analyze more sophisticated sequential sampling strategies, including branching, selection at randomly selected times, etc..

Mathematics Subject Classification. 62L10, 65C05, 5C35, 65C60

Key words: importance sampling, sampling importance resampling, martingale arrays, particle filter, sequential Monte Carlo


© EDP Sciences, ESAIM 2007

What is OpenURL?