This paper is also the originator of the Markov Chain Monte Carlo methods developed in the following chapters. The potential of these two simultaneous innovations has been discovered much latter by statisticians (Hastings 1970; Geman and Geman 1984) than by of physicists (see also Kirkpatrick et al. 1983). 5.5.5 ] PROBLEMS 211

This article proposes a new framework for the construction of reversible Markov chain samplers that jump between parameter subspaces of differing dimensionality, which is flexible and entirely constructive. It should therefore have wide applicability in model determination problems. The methodology is illustrated with applications to multiple change-point analysis in one and two dimensions, and to a Bayesian comparison of binomial experiments. Some key words: Change-point analysis, Image segmentation, Jump diffusion, Markov chain Monte Carlo, Multiple binomial experiments, Multiple shrinkage, Step function, Voronoi tessellation. 1 Introduction

Abstract not found

Two important questions that must be answered whenever a Markov chain Monte Carlo (MCMC) algorithm is used are (Q1) What is an appropriate burn-in? and (Q2) How long should the sampling continue after burn-in? Developing rigorous answers to these questions presently requires a detailed study of the convergence properties of the underlying Markov chain. Consequently, in most practical applications of MCMC, exact answers to (Q1) and (Q2) are not sought. The goal of this paper is to demystify the analysis that leads to honest answers to (Q1) and (Q2). The authors hope that this article will serve as a bridge between those developing Markov chain theory and practitioners using MCMC to solve practical problems. The ability to formally address (Q1) and (Q2) comes from establishing a drift condition and an associated minorization condition, which together imply that the underlying Markov chain is geometrically ergodic. In this paper, we explain exactly what drift and minorization are as well as how and why these conditions can be used to form rigorous answers to (Q1) and (Q2). The basic ideas are as follows. The results of Rosenthal (1995) and Roberts and Tweedie (1999) allow one to use drift and minorization conditions to construct a formula giving an analytic upper bound on the distance to stationarity. A rigorous answer to (Q1) can be calculated using this formula. The desired characteristics of the target distribution are typically estimated using ergodic averages. Geometric ergodicity of the underlying Markov chain implies that there are central limit theorems available for ergodic averages (Chan and Geyer 1994). The regenerative simulation technique (Mykland, Tierney and Yu 1995, Robert 1995) can be used to get a consistent estimate of the variance of the asymptotic nor...

We investigate the relationships between Dirichlet process (DP) based models and allocation models for a variable number of components, based on exchangeable distributions. It is shown that the DP partition distribution is a limiting case of a Dirichlet± multinomial allocation model. Comparisons of posterior performance of DP and allocation models are made in the Bayesian paradigm and illustrated in the context of univariate mixture models. It is shown in particular that the unbalancedness of the allocation distribution, present in the prior DP model, persists a posteriori. Exploiting the model connections, a new MCMC sampler for general DP based models is introduced, which uses split/merge moves in a reversible jump framework. Performance of this new sampler relative to that of some traditional samplers for DP processes is then explored.

Most regression problems in practice require flexible semiparametric forms of the predictor for modelling the dependence of responses on covariates. Moreover, it is often necessary to add random effects accounting for overdispersion caused by unobserved heterogeneity or for correlation in longitudinal or spatial data. We present a unified approach for Bayesian inference via Markov chain Monte Carlo (MCMC) simulation in generalized additive and semiparametric mixed models. Different types of covariates, such as usual covariates with fixed effects, metrical covariates with nonlinear effects, unstructured random effects, trend and seasonal components in longitudinal data and spatial covariates are all treated within the same general framework by assigning appropriate priors with different forms and degrees of smoothness. The approach is particularly appropriate for discrete and other fundamentally nonGaussian responses, where Gibbs sampling techniques developed for Gaussian m...

In this paper we derive conditions for geometric ergodicity of the random walk-based Metropolis algorithm on R k . We show that at least exponentially light tails of the target density is a necessity. This extends the one-dimensional result of (Mengersen and Tweedie, 1996). For sub-exponential target densities we characterize the geometrically ergodic algorithms and we derive a practical sufficient condition which is stable under addition and multiplication. This condition is especially satisfied for the class of densities considered in (Roberts and Tweedie, 1996).

Structured additive regression models are perhaps the most commonly used class of models in statistical applications. It includes, among others, (generalised) linear models, (generalised) additive models, smoothing-spline models, state-space models, semiparametric regression, spatial and spatio-temporal models, log-Gaussian Cox-processes, geostatistical and geoadditive models. In this paper we consider approximate Bayesian inference in a popular subset of structured additive regression models, latent Gaussian models, where the latent field is Gaussian, controlled by a few hyperparameters and with non-Gaussian response variables. The posterior marginals are not available in closed form due to the non-Gaussian response variables. For such models, Markov chain Monte Carlo methods can be implemented, but they are not without problems, both in terms of convergence and computational time. In some practical applications, the extent of these problems is such that Markov chain Monte Carlo is simply not an appropriate tool for routine analysis. We show that, by using an integrated nested Laplace approximation and its simplified version, we can directly compute very accurate approximations to the posterior marginals. The main benefit of these approximations

e wrong, which is even worse. Please let us know of any successes or failures. Beware - Gibbs sampling can be dangerous!. BUGS c flcopyright MRC Biostatistics Unit 1995. ALL RIGHTS RESERVED. The support of the Economic and Social Research Council (UK) is gratefully acknowledged. The work was funded in part by ESRC (UK) Award Number H519 25 5023. 1 2 Contents 1 Introduction 5 1.1 What is BUGS? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.2 For what kind of problems is BUGS best suited? . . . . . . . . . . . . . . . . . . . . . 5 1.3 Markov Chain Monte Carlo (MCMC) techniques . . . . . . . . . . . . . . . . . . . . 5 1.4 A simple example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 1.5 Hardware platforms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.6 Software . . .

Gaussian Markov random field (GMRF) models are commonlyufz to model spatial correlation in disease mapping applications. For Bayesian inference by MCMC, so far mainly single-siteuinglealgorithms have been considered. However, convergence and mixing properties ofsuD algorithms can be extremely poordu to strong dependencies ofparameters in the posteriordistribuQ84K In this paper, we propose variou block sampling algorithms in order to improve the MCMC performance. The methodology is rather general, allows for non-standardfu6 conditionals, and can be applied in amoduzK fashion in a large nugef of di#erent scenarios. For illu##Kzf0 n we consider three di#erent applications: twoformu8Df0z3 for spatial modelling of a single disease (with andwithou additionaluditionalfL parameters respectively), and one formu## ion for the joint analysis of two diseases. TheresuKK indicate that the largest benefits are obtained ifparameters and the corresponding hyperparameter areuefz#L jointly in one large block. Implementation ofsuQ block algorithms is relatively easy usyf methods for fast sampling ofGaungf3 Markov random fields (Rus 2001). By comparison, Monte Carlo estimates based on single-siteungle-s can be rather misleading, even for very long rugfOu resuL6 may have wider relevance for efficient MCMCsimu6z8#f in hierarchical models with Markov random field components.