2007
DOI: 10.1093/biomet/asm017
|View full text |Cite
|
Sign up to set email alerts
|

Bayesian predictive information criterion for the evaluation of hierarchical Bayesian and empirical Bayes models

Abstract: The problem of evaluating the goodness of the predictive distributions of hierarchical Bayesian and empirical Bayes models is investigated. A Bayesian predictive information criterion is proposed as an estimator of the posterior mean of the expected log likelihood of the predictive distribution when the specified family of probability distributions does not contain the true distribution. The proposed criterion is developed by correcting the asymptotic bias of the posterior mean of the log likelihood as an esti… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

1
192
0

Year Published

2009
2009
2018
2018

Publication Types

Select...
5
3

Relationship

0
8

Authors

Journals

citations
Cited by 212 publications
(193 citation statements)
references
References 24 publications
1
192
0
Order By: Relevance
“…Model comparison was conducted based on Bayesian predictive information criterion (BPIC) values (Ando, 2007), which relate the model's deviance to its complexity (see Table 1). SOA-independent binomial models provided, in general, a very good fit of participants' response patterns, indicated by Bayesian p values around the ideal value of 0.5 and R 2 values higher than 90 %.…”
Section: Modelmentioning
confidence: 99%
See 1 more Smart Citation
“…Model comparison was conducted based on Bayesian predictive information criterion (BPIC) values (Ando, 2007), which relate the model's deviance to its complexity (see Table 1). SOA-independent binomial models provided, in general, a very good fit of participants' response patterns, indicated by Bayesian p values around the ideal value of 0.5 and R 2 values higher than 90 %.…”
Section: Modelmentioning
confidence: 99%
“…Note that RMSD is estimated larger and R 2 smaller, when using the full posterior predictive distribution rather than the maximum a posteriori (MAP) estimate as is often done. For model comparison, the Bayesian predictive information criterion (BPIC) (Ando, 2007) was assessed with model complexity pV measured as half the posterior variance of the model-level deviance (Gelman et al, 2004).…”
mentioning
confidence: 99%
“…The use of the prior (2.6) for B-spline function has been investigated by Ando (2004), Konishi et al (2004) and Lang and Brezger (2004).…”
Section: The Bayesian Estimation Via the Markov Chain Monte Carlo Methodsmentioning
confidence: 99%
“…Although the progress in MCMC simulation methods has made SV modeling popular, the assessment of the goodness of its extension is still ongoing. In this paper, to evaluate the goodness of the estimated models, we employ several Bayesian model selection criteria that include the Bayes factor (Kass and Raftery (1995), Kim et al (1998), Chib et al (2002)), the Bayesian predictive information criterion (Ando (2004(Ando ( , 2006c) and the deviance information criterion , Berg et al (2004)). To examine the goodness of the constructed model from various angles, three kinds of model selection criteria are used.…”
Section: Introductionmentioning
confidence: 99%
“…For this study, we take the mean values of the parameters from the MCMC as an estimate of the maximum likelihood parameters, and then use conjugate-gradient optimization to improve this estimate to obtain our final maximum log likelihood. Other criteria, such as the Deviance Information Criterion (DIC) and Bayesian Predictive Information Criterion (BPIC) are directly computable from the MCMC chain, however the DIC has problems with overfitting the data and the BPIC is an unnecessarily complicated calculation for this simple problem (Ando 2007). At first impression, transdimensional MCMC would appear to be a good candidate for determining the maximum degree l of spherical harmonic analysis, and it has the advantage of determining model complexity in a single inversion, rather than requiring multiple inversions for different spaces of models as is the case for IC approaches.…”
Section: Model Space Selection Via the Aiccmentioning
confidence: 99%