Results 1 - 10
of
17
Markov chains for exploring posterior distributions
- Annals of Statistics
, 1994
"... Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at ..."
Abstract
-
Cited by 607 (6 self)
- Add to MetaCart
Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at
Markov Chain Monte Carlo Simulation Methods in Econometrics
, 1993
"... We present several Markov chain Monte Carlo simulation methods that have been widely used in recent years in econometrics and statistics. Among these is the Gibbs sampler, which has been of particular interest to econometricians. Although the paper summarizes some of the relevant theoretical literat ..."
Abstract
-
Cited by 61 (3 self)
- Add to MetaCart
We present several Markov chain Monte Carlo simulation methods that have been widely used in recent years in econometrics and statistics. Among these is the Gibbs sampler, which has been of particular interest to econometricians. Although the paper summarizes some of the relevant theoretical literature, its emphasis is on the presentation and explanation of applications to important models that are studied in econometrics. We include a discussion of some implementation issues, the use of the methods in connection with the EM algorithm, and how the methods can be helpful in model specification questions. Many of the applications of these methods are of particular interest to Bayesians, but we also point out ways in which frequentist statisticians may find the techniques useful.
Studying Convergence of Markov Chain Monte Carlo Algorithms Using Coupled Sample Paths
, 1994
"... . I describe a simple procedure for investigating the convergence properties of Markov Chain Monte Carlo sampling schemes. The procedure employs multiple runs from a sampler, using the same random deviates for each run. When the sample paths from all sequences converge, it is argued that approximate ..."
Abstract
-
Cited by 21 (1 self)
- Add to MetaCart
. I describe a simple procedure for investigating the convergence properties of Markov Chain Monte Carlo sampling schemes. The procedure employs multiple runs from a sampler, using the same random deviates for each run. When the sample paths from all sequences converge, it is argued that approximate equilibrium conditions hold. The procedure also provides a simple diagnostic for detecting modes in multimodal posteriors. Several examples of the procedure are provided. In Ising models, the relation between the correlation parameter and the convergence rate of rudimentary Gibbs samplers is investigated. In another example, the effects of multiple modes on the convergence of coupled paths are explored using mixtures of bivariate normal distributions. The technique is also used to evaluate the convergence properties of a Gibbs sampling scheme applied to a model for rat growth rates (Gelfand et al 1990). Acknowledgements I would like to thank Steve MacEachern, Julian Besag, Donald Rubin, A...
Semiparametric Bayesian Analysis Of Survival Data
- Journal of the American Statistical Association
, 1996
"... this paper are motivated and aimed at analyzing some common types of survival data from different medical studies. We will center our attention to the following topics. ..."
Abstract
-
Cited by 18 (0 self)
- Add to MetaCart
this paper are motivated and aimed at analyzing some common types of survival data from different medical studies. We will center our attention to the following topics.
The Number of Iterations, Convergence Diagnostics and Generic Metropolis Algorithms
- In Practical Markov Chain Monte Carlo (W.R. Gilks, D.J. Spiegelhalter and
, 1995
"... Introduction In order to use Markov chain Monte Carlo, MCMC, it is necessary to determine how long the simulation needs to be run. It is also a good idea to discard a number of initial "burnin " simulations, since from an arbitrary starting point it would be unlikely that the initial simulations ca ..."
Abstract
-
Cited by 17 (3 self)
- Add to MetaCart
Introduction In order to use Markov chain Monte Carlo, MCMC, it is necessary to determine how long the simulation needs to be run. It is also a good idea to discard a number of initial "burnin " simulations, since from an arbitrary starting point it would be unlikely that the initial simulations came from the stationary distribution intended for the Markov chain. Also, consecutive simulations from Markov chains are dependent, sometimes highly so. Since saving all simulations can require a large amount of storage, researchers using MCMC sometimes prefer saving only every third, fifth, tenth, etc. simulation, especially if the chain is highly dependent. This is sometimes referred to as thinning the chain. While neither burn-in nor thinning are mandatory practices, they both reduce the amount of data saved from a MCMC run. In this chapter, we outline a way of determining in advance the number of iterations needed for a given level of precision in a MCMC algorithm.
Simulation-Based Methods for Blind Maximum-Likelihood Filter Identification
, 1999
"... Blind linear system identication consists in estimating the parameters of a linear timeinvariant ..."
Abstract
-
Cited by 13 (9 self)
- Add to MetaCart
Blind linear system identication consists in estimating the parameters of a linear timeinvariant
Estimating Ratios of Normalizing Constants for Densities with Different Dimensions
- STATISTICA SINICA
, 1997
"... In Bayesian inference, a Bayes factor is defined as the ratio of posterior odds versus prior odds where posterior odds is simply a ratio of the normalizing constants of two posterior densities. In many practical problems, the two posteriors have different dimensions. For such cases, the current Mont ..."
Abstract
-
Cited by 11 (2 self)
- Add to MetaCart
In Bayesian inference, a Bayes factor is defined as the ratio of posterior odds versus prior odds where posterior odds is simply a ratio of the normalizing constants of two posterior densities. In many practical problems, the two posteriors have different dimensions. For such cases, the current Monte Carlo methods such as the bridge sampling method (Meng and Wong 1996), the path sampling method (Gelman and Meng 1994), and the ratio importance sampling method (Chen and Shao 1994) cannot directly be applied. In this article, we extend importance sampling, bridge sampling, and ratio importance sampling to problems of different dimensions. Then we find global optimal importance sampling, bridge sampling, and ratio importance sampling in the sense of minimizing asymptotic relative mean-square errors of estimators. Implementation algorithms, which can asymptotically achieve the optimal simulation errors, are developed and two illustrative examples are also provided.
Bayesian Analysis of Multivariate Survival Data Using Monte Carlo Methods
- Canadian Journal of Statistics
, 1995
"... This paper deals with the analysis of multivariate survival data from a Bayesian perspective using Markov Chain Monte Carlo methods. Metropolis along with Gibbs algorithm (Metropolis et al., 1953; Muller, 1991) is used to calculate some of the marginal posteriors. Multivariate survival model is prop ..."
Abstract
-
Cited by 9 (4 self)
- Add to MetaCart
This paper deals with the analysis of multivariate survival data from a Bayesian perspective using Markov Chain Monte Carlo methods. Metropolis along with Gibbs algorithm (Metropolis et al., 1953; Muller, 1991) is used to calculate some of the marginal posteriors. Multivariate survival model is proposed since, survival times within the same `group' are correlated as a consequence of a frailty random block effect (Vaupel et al., 1979). The conditional proportional hazards model of Clayton and Cuzick (1985) is used with a martingale structured prior process (Arjas and Gasbarra, 1994) for the discretized baseline hazard. Besides the calculation of the marginal posteriors of the parameters of interest, this paper presents some Bayesian EDA diagnostic techniques to detect model adequacy. The methodology is exemplified with the kidney infection data where the times to infections within the same patients are expected to be correlated. Key Words: Autocorrelated prior process, credible regions,...
Continuous Contour Monte Carlo for Marginal Density Estimation with an Application to Spatial Statistical Model
, 2006
"... The problem of marginal density estimation for a multivariate density function f(x) can be generally stated as a problem of density function estimation for a random vector λ(x) of dimension lower than that of x. In this paper, we propose a technique, the so-called continuous Contour Monte Carlo (CCM ..."
Abstract
-
Cited by 7 (3 self)
- Add to MetaCart
The problem of marginal density estimation for a multivariate density function f(x) can be generally stated as a problem of density function estimation for a random vector λ(x) of dimension lower than that of x. In this paper, we propose a technique, the so-called continuous Contour Monte Carlo (CCMC) algorithm, for solving this problem. CCMC can be viewed as a continuous version of the contour Monte Carlo (CMC) algorithm recently proposed in the literature. CCMC abandons the use of sample space partitioning and incorporates the techniques of kernel density estimation into its simulations. CCMC is more general than other marginal density estimation algorithms. First, it works for any density functions, even for those having a rugged or unbalanced energy landscape. Second, it works for any transformation λ(x) regardless of the availability of the analytical form of the inverse transformation. In this paper, CCMC is applied to estimate the unknown normalizing constant function for a spatial autologistic model, and the estimate is then used in a Bayesian analysis for the spatial autologistic model in place of the true normalizing constant function. Numerical results on the US cancer mortality data indicate that the Bayesian method can produce much more accurate estimates than the MPLE and MCMLE methods for the parameters of the spatial autologistic model.
Bayesian Nonparametric Mixture Modeling
, 1993
"... (Statistics) BAYESIAN NONPARAMETRIC MIXTURE MODELING by Guoliang Cao Institute of Statistics and Decision Sciences Duke University Date: Approved: Mike West, Advisor Donald Burdick Michael Lavine Peter Muller Dennis A. Turner An abstract of a dissertation submitted in partial fulfillment of the ..."
Abstract
-
Cited by 2 (0 self)
- Add to MetaCart
(Statistics) BAYESIAN NONPARAMETRIC MIXTURE MODELING by Guoliang Cao Institute of Statistics and Decision Sciences Duke University Date: Approved: Mike West, Advisor Donald Burdick Michael Lavine Peter Muller Dennis A. Turner An abstract of a dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Institute of Statistics and Decision Sciences in the Graduate School of Duke University Abstract This dissertation explores a Bayesian nonparametric approach to mixture modeling and the use of the Gibbs sampling scheme to approximate posterior estimates. The predictive distribution is modeled as a mixture of normal distributions by using a Dirichlet process prior for the unknown means and variances. The definition and some properties of mixtures of Dirichlet processes are reviewed. Analytically evaluating the predictive distribution is very tedious and difficult in this case. An approximation based on Monte Carlo integration is pro...

