Results 1  10
of
17
Estimating the integrated likelihood via posterior simulation using the harmonic mean identity
 Bayesian Statistics
, 2007
"... The integrated likelihood (also called the marginal likelihood or the normalizing constant) is a central quantity in Bayesian model selection and model averaging. It is defined as the integral over the parameter space of the likelihood times the prior density. The Bayes factor for model comparison a ..."
Abstract

Cited by 23 (2 self)
 Add to MetaCart
The integrated likelihood (also called the marginal likelihood or the normalizing constant) is a central quantity in Bayesian model selection and model averaging. It is defined as the integral over the parameter space of the likelihood times the prior density. The Bayes factor for model comparison and Bayesian testing is a ratio of integrated likelihoods, and the model weights in Bayesian model averaging are proportional to the integrated likelihoods. We consider the estimation of the integrated likelihood from posterior simulation output, aiming at a generic method that uses only the likelihoods from the posterior simulation iterations. The key is the harmonic mean identity, which says that the reciprocal of the integrated likelihood is equal to the posterior harmonic mean of the likelihood. The simplest estimator based on the identity is thus the harmonic mean of the likelihoods. While this is an unbiased and simulationconsistent estimator, its reciprocal can have infinite variance and so it is unstable in general. We describe two methods for stabilizing the harmonic mean estimator. In the first one, the parameter space is reduced in such a way that the modified estimator involves a harmonic mean of heaviertailed densities, thus resulting in a finite variance estimator. The resulting
Bayesian Simultaneous Equations Analysis using Reduced Structures
, 1997
"... Diffuse priors lead to pathological posterior behavior when used in Bayesian analyses of Simultaneous Equation Models (SEMs). This results from the local nonidentication of certain parameters in SEMs. When this, a priori known, feature is not captured appropriately, an a posteriori favor for certain ..."
Abstract

Cited by 20 (3 self)
 Add to MetaCart
Diffuse priors lead to pathological posterior behavior when used in Bayesian analyses of Simultaneous Equation Models (SEMs). This results from the local nonidentication of certain parameters in SEMs. When this, a priori known, feature is not captured appropriately, an a posteriori favor for certain specific parameter values results which is not the consequence of strong data information but of local nonidentification. We show that a proper consistent Bayesian analysis of a SEM explicitly has to consider the reduced form of the SEM as a standard linear model on which nonlinear (reduced rank) restrictions are imposed, which result from a singular value decomposition. The priors/posteriors of the parameters of the SEM are therefore proportional to the priors/posteriors of the parameters of the linear model under the condition that the restrictions hold. This leads to a framework for constructing priors and posteriors for the parameters of SEMs. The framework is used to construct priors and pos...
Priors, Posteriors and Bayes Factors for a Bayesian Analysis of Cointegration
 Journal of Econometrics
, 1999
"... Cointegration occurs when the long run multiplier of a vector autoregressive model exhibits rank reduction. Priors and posteriors of the parameters of the cointegration model are therefore proportional to priors and posteriors of the long run multiplier given that it has reduced rank. Rank reduction ..."
Abstract

Cited by 19 (3 self)
 Add to MetaCart
Cointegration occurs when the long run multiplier of a vector autoregressive model exhibits rank reduction. Priors and posteriors of the parameters of the cointegration model are therefore proportional to priors and posteriors of the long run multiplier given that it has reduced rank. Rank reduction of the long run multiplier is modelled using a decomposition resulting from its singular value decomposition. It specifies the long run multiplier matrix as the sum of a matrix that equals the product of the adjustment parameters and the cointegrating vectors, i.e. the cointegration specification, and a matrix that models the deviation from cointegration. Priors and posteriors for the parameters of the cointegration model are obtained by restricting the latter matrix to zero in the prior and posterior of the unrestricted long run multiplier. The special decomposition of the long run multiplier results in unique posterior densities. This theory leads to a complete Bayesian framework for cointegration analysis. It includes prior specification, simulation schemes for obtaining posterior distributions and determination of the cointegration rank via Bayes factors. We illustrate the analysis with several simulated series, the UK data
Bayesian Variable Selection for Proportional Hazards Models
, 1996
"... The authors consider the problem of Bayesian variable selection for proportional hazards regression models with right censored data. They propose a semiparametric approach in which a nonparametric prior is specified for the baseline hazard rate and a fully parametric prior is specified for the regr ..."
Abstract

Cited by 15 (1 self)
 Add to MetaCart
The authors consider the problem of Bayesian variable selection for proportional hazards regression models with right censored data. They propose a semiparametric approach in which a nonparametric prior is specified for the baseline hazard rate and a fully parametric prior is specified for the regression coe#cients. For the baseline hazard, they use a discrete gamma process prior, and for the regression coe#cients and the model space, they propose a semiautomatic parametric informative prior specification that focuses on the observables rather than the parameters. To implement the methodology, they propose a Markov chain Monte Carlo method to compute the posterior model probabilities. Examples using simulated and real data are given to demonstrate the methodology. R ESUM E Les auteurs abordent d'un point de vue bayesien le problemedelaselection de variables dans les modeles de regression des risques proportionnels en presence de censure a droite. Ils proposent une approche semip...
Continuous Contour Monte Carlo for Marginal Density Estimation with an Application to Spatial Statistical Model
, 2006
"... The problem of marginal density estimation for a multivariate density function f(x) can be generally stated as a problem of density function estimation for a random vector λ(x) of dimension lower than that of x. In this paper, we propose a technique, the socalled continuous Contour Monte Carlo (CCM ..."
Abstract

Cited by 7 (3 self)
 Add to MetaCart
The problem of marginal density estimation for a multivariate density function f(x) can be generally stated as a problem of density function estimation for a random vector λ(x) of dimension lower than that of x. In this paper, we propose a technique, the socalled continuous Contour Monte Carlo (CCMC) algorithm, for solving this problem. CCMC can be viewed as a continuous version of the contour Monte Carlo (CMC) algorithm recently proposed in the literature. CCMC abandons the use of sample space partitioning and incorporates the techniques of kernel density estimation into its simulations. CCMC is more general than other marginal density estimation algorithms. First, it works for any density functions, even for those having a rugged or unbalanced energy landscape. Second, it works for any transformation λ(x) regardless of the availability of the analytical form of the inverse transformation. In this paper, CCMC is applied to estimate the unknown normalizing constant function for a spatial autologistic model, and the estimate is then used in a Bayesian analysis for the spatial autologistic model in place of the true normalizing constant function. Numerical results on the US cancer mortality data indicate that the Bayesian method can produce much more accurate estimates than the MPLE and MCMLE methods for the parameters of the spatial autologistic model.
Bayes Estimates of Markov Trends in Possibly Cointegrated Series: An Application to US Consumption and Income
 JOURNAL OF BUSINESS AND ECONOMIC STATISTICS
, 1999
"... Stylized facts show that average growth rates of US per capita consumption and income differ in recession and expansion periods. Since a linear combination of such series does not have to be a constant mean process, standard cointegration analysis between the variables to examine the permanent in ..."
Abstract

Cited by 7 (3 self)
 Add to MetaCart
Stylized facts show that average growth rates of US per capita consumption and income differ in recession and expansion periods. Since a linear combination of such series does not have to be a constant mean process, standard cointegration analysis between the variables to examine the permanent income hypothesis may not be valid. To model the changing growth rates in both series, we introduce a multivariate Markov trend model, which accounts for di#erent growth rates in consumption and income during expansions and recessions and across variables within both regimes. The deviations from the multivariate Markov trend are modeled by a vector autoregressive model. Bayes estimates of this model are obtained using Markov chain Monte Carlo methods. The empirical results suggest the existence of a cointegration relation between US per capita disposable income and consumption, after correction for a multivariate Markov trend. This results is also obtained when per capita investment is added to the vector autoregression.
Variable selection for multivariate logistic regression models
 Journal of Statistical Planning and Inference
, 2003
"... In this paper, we use multivariate logistic regression models to incorporate correlation among binary response data. Our objective is to develop a variable subset selection procedure to identify important covariates in predicting correlated binary responses using a Bayesian approach. In order to inc ..."
Abstract

Cited by 5 (0 self)
 Add to MetaCart
In this paper, we use multivariate logistic regression models to incorporate correlation among binary response data. Our objective is to develop a variable subset selection procedure to identify important covariates in predicting correlated binary responses using a Bayesian approach. In order to incorporate available prior information, we propose a class of informative prior distributions on the model parameters and on the model space. The propriety of the proposed informative prior is investigated in detail. Novel computational algorithms are also developed for sampling from the posterior distribution as well as for computing posterior model probabilities. Finally, a simulated data example and a real data example from a prostate cancer study are used to illustrate the proposed methodology.
Priors, posterior odds and Lagrange multiplier statistics in Bayesian analyses of cointegration
, 1997
"... Using the standard linear model as a base, a unified theory of Bayesian Analyses of Cointegration Models is constructed. This is achieved by defining (natural conjugate) priors in the linear model and using the implied priors for the cointegration model. Using these priors, posterior results for the ..."
Abstract

Cited by 4 (1 self)
 Add to MetaCart
Using the standard linear model as a base, a unified theory of Bayesian Analyses of Cointegration Models is constructed. This is achieved by defining (natural conjugate) priors in the linear model and using the implied priors for the cointegration model. Using these priors, posterior results for the cointegration model are obtained using a MetropolisHasting sampler. To compare the cointegration models mutually and with the vector autoregressive model under stationarity, we use two strategies. The first strategy uses the Bayesian interpretation of a Lagrange Multiplier statistic. The second strategy compares the models using prior and posterior odds ratios. The latter enables us to compute prior and posterior distributions over the cointegration rank and shows close resemblance with the posterior information criterium from Phillips and Ploberger (1996). To show the applicability of the derived theory, the constructed procedures are applied to data from Johansen and Juselius (1990) and a few simulated data sets.
Testing For Cointegration Rank Using Bayes Factors
, 2002
"... This paper proposes Bayesian methods for estimating the cointegration rank using Bayes factors. We consider natural conjugate priors for computing Bayes factors. First, we estimate the cointegrating vectors for each possible rank. Then, we compute the Bayes factors for each rank against 0 rank. M ..."
Abstract

Cited by 1 (0 self)
 Add to MetaCart
This paper proposes Bayesian methods for estimating the cointegration rank using Bayes factors. We consider natural conjugate priors for computing Bayes factors. First, we estimate the cointegrating vectors for each possible rank. Then, we compute the Bayes factors for each rank against 0 rank. Monte Carlo simulations show that using Bayes factor with conjugate priors produces fairly good results. We apply the method to demand for money in the US.