General state space Markov chains and MCMC algorithm

General state space Markov chains and MCMC algorithm (2004)

Cached

Download Links

by Gareth O. Roberts , Jeffrey S. Rosenthal

Venue:	PROBABILITY SURVEYS
Citations:	84 - 28 self

BibTeX

@MISC{Roberts04generalstate,
    author = {Gareth O. Roberts and Jeffrey S. Rosenthal},
    title = {General state space Markov chains and MCMC algorithm},
    year = {2004}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

This paper surveys various results about Markov chains on general (non-countable) state spaces. It begins with an introduction to Markov chain Monte Carlo (MCMC) algorithms, which provide the motivation and context for the theory which follows. Then, sufficient conditions for geometric and uniform ergodicity are presented, along with quantitative bounds on the rate of convergence to stationarity. Many of these results are proved using direct coupling constructions based on minorisation and drift conditions. Necessary and sufficient conditions for Central Limit Theorems (CLTs) are also presented, in some cases proved via the Poisson Equation or direct regeneration constructions. Finally, optimal scaling and weak convergence results for Metropolis-Hastings algorithms are discussed. None of the results presented is new, though many of the proofs are. We also describe some Open Problems.

Citations

3012	Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images - Geman, Geman - 1984
1644	Equation of state calculation by fast computing machines - Metropolis, AN, et al. - 1953
886	Monte Carlo sampling methods using Markov chains and their applications - Hastings - 1970
607	Probability: Theory and Examples - Durrett - 1996
607	Markov chains for exploring posterior distributions,” Annals of Statistics - Tierney - 1994
449	Applied probability and queues - Asmussen - 2003
445	Inference from iterative simulation using multiple sequences (with discussion). Stat Sci - Gelman, DB - 1992
426	D.: Markov chain Monte Carlo in practice - Gilks, Richardson, et al. - 1996
417	Markov chains and stochastic stability - Meyn, Tweedie - 1993
404	Stochastic Processes - Doob - 1990
337	DB: Exact sampling with couple Markov chains and applications to statistical mechanics. Random Structures Algorithms - JG, Wilson - 1996
315	Sampling based approaches to calculating marginal densities - Gelfand, Smith - 1990
295	Bayesian computations via the Gibbs sampler and related Markov chain Monte Carlo methods - Smith, Roberts - 1993
246	Group representations in Probability and Statistics - Diaconis - 1988
246	Lectures on the Coupling Method - Lindvall - 1992
204	Markov processes: Characterization and convergence - Ethier, Kurtz - 1986
200	Random walk on finite groups and rapidly mixing Markov chains - Aldous - 1983
199	General irreducible Markov chains and non-negative operators - Nummelin - 1984
164	Minorization conditions and convergence rates for Markov chain Monte - Rosenthal - 1995
161	B: Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review. JASA - Cowles, Carlin - 1996
158	Improved bounds for mixing rates of Markov chains and multicommodity flow - Sinclair - 1992
129	Central limit theorem for additive functionals of reversible Markov processes and applications to simple exclusion - Kipnis, Varadhan - 1986
112	Weak convergence and optimal scaling of random walk Metropolis algorithms - Roberts, Gelman, et al. - 1997
103	Practical markov chain monte carlo - Geyer - 1992
98	Geometric Convergence and Central Limit Theorems for Multidimensional Hastings and Metropolis Algorithms - Roberts, Tweedie - 1996
83	A new approach to the limit theory of recurrent Markov chains - Athreya, Ney - 1978
77	Computable bounds for convergence rates of Markov chains - Meyn, Tweedie - 1994
73	Regeneration in markov chain samplers - Mykland, Tierney, et al. - 1995
73	Geometric ergodicity and hybrid Markov chains - ROBERTS, ROSENTHAL - 1997
66	Bounds on regeneration times and convergence rates for Markov chains - Roberts, Tweedie - 1999
65	Probability and Measure, 3rd ed - Billingsley - 1995
62	Optimal scaling for various Metropolis-Hastings algorithms - Roberts, Rosenthal - 2009
62	A bound for the error in the normal approximation to the distribution of a sum of dependent random variables - Stein - 1971
58	Convergence rates of Markov chains - Rosenthal - 1995
55	2001), Honest exploration of intractable probability distributions via Markov chain Monte - Jones, Hobert
55	Optimal scaling of discrete approximations to Langevin diffusions - Roberts, Rosenthal - 1998
44	2000), Perfect simulation using dominating processes on ordered state spaces, with application to locally stable point processes - Kendall, Møller
42	Exposé de la théorie des châines simples constantes de Markov à un nombre fini d’états. Revue Mathematique de l’Union Interbalkanique - Doeblin - 1938
42	Markov chain Monte Carlo: Some practical implications of theoretical results (with discussion - Roberts, Rosenthal - 1998
41	Log Gaussian Cox processes - Mller, Syversveen, et al. - 1998
39	Subgeometric rates of convergence of f-ergodic Markov chains - Tuominen, Tweedie - 1994
37	Polynomial convergence rates of Markov chains - Jarner, Roberts - 2002
37	Convergence of Gibbs sampler for a model related to James-Stein estimators - Rosenthal - 1996
36	Extension of Fill’s perfect rejection sampling algorithm to general chains - Fill, Machida, et al. - 1999
32	The Lindeberg-Lévy theorem for martingales - Billingsley - 1961
29	Renewal theory and computable convergence rates for geometrically ergodic markov chains. Annals of Applied Probability - Baxendale - 2005
29	On the Applicability of Regenerative Simulation in Markov Chain Monte Carlo - Hobert, Jones, et al. - 2002
27	Shift-coupling and convergence rates of ergodic averages - Roberts, Rosenthal - 1997
25	Sufficient burn-in for Gibbs samplers for a hierarchical random effects - Jones, Hobert - 2004
22	Rates of convergence for data augmentation on finite sample spaces - Rosenthal - 1993