Abstract
Model criticism and comparison of Bayesian hierarchical models is often based on posterior or leave-one-out cross-validatory predictive checks. Cross-validatory checks are usually preferred because posterior predictive checks are difficult to assess and tend to be too conservative. However, techniques for statistical inference in such models often try to avoid full (manual) leave-one-out cross-validation, since it is very time-consuming. In this paper we will compare two approaches for estimating Bayesian hierarchical models: Markov chain Monte Carlo (MCMC) and integrated nested Laplace approximations (INLA). We review how both approaches allow for the computation of leave-one-out cross-validatory checks without re-running the model for each observation in turn. We then empirically compare the two approaches in an extensive case study analysing the spatial distribution of bovine viral diarrhoe (BVD) among cows in Switzerland.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Azzalini, A. & Capitano, A. (1999). Statistical applications of the multivariate skew normal distribution., Journal of the Royal Statistical Society: Series B 61: 579–602.
Bernardinelli, L., Clayton, D. & Montomoli, C. (1995). Bayesian estimates of disease maps: How important are priors?, Statistics in Medicine 14: 2411–2431.
Berry, G. & Armitage, P. (1995). Mid-p confidence intervals: a brief review, Statistician 44: 417–423.
Besag, J., York, J. & Mollié, A. (1991). Bayesian image restoration with two applications in spatial statistics, Annals of the Institute of Statistical Mathematics 43(1): 1–59.
Bland, J. & Altman, D. (1986). Statistical methods for assessing agreement between two methods of clinical measurement, Lancet i: 307–310.
Breslow, N. & Clayton, D. (1993). Approximate inference in generalized linear mixed models, Journal of the American Statistical Association 88: 9–25.
Casella, G. & Robert, C. (1996). Rao-Blackwellisation of sampling schemes, Biometrika 83: 81–94.
Clayton, D. & Bernardinelli, L. (1992). Bayesian methods for mapping disease risk, in J. Cuzick et al. (eds), Geographical and Environmental Epidemiology. Methods for Small Area Studies, Oxford University Press, pp. 205–220.
Czado, C., Gneiting, T. & Held, L. (2009). Predictive model assessment for count data, Biometrics. In press.
Dawid, A. P. (1984). Statistical theory: The prequential approach, Journal of the Royal Statistical Society. Series A (General) 147: 278–292.
Fahrmeir, L. (1992). Posterior mode estimation by extended kalman filtering for multivariate dynamic generalized linear models, Journal of the American Statistical Association 87: 501–509.
Fahrmeir, L. & Kneib, T. (2009). Discussion of Rue et al. (2009), Journal of the Royal Statistical Society: Series B 71: 367.
Fahrmeir, L., Kneib, T. & Lang, S. (2004). Penalized structured additive regression for space-time data: a Bayesian perspective, Statistica Sinica 14(3): 731–761.
Fahrmeir, L. & Lang, S. (2001). Bayesian inference for generalized additive mixed models based on Markov random field priors, Journal of the Royal Statistical Society. Series C. Applied Statistics 50(2): 201–220.
Geisser, S. (1993). Predictive Inference: An Introduction, Chapman & Hall, London.
Gelfand, A. E. (1996). Model determination using sampling-based methods, in W. R. Gilks, S. Richardson & D. J. Spiegelhalter (eds), Markov chain Monte Carlo in Practice, Chapman & Hall, pp. 145–161.
Gelfand, A. E. & Smith, A. F. M. (1990). Sampling-based approaches to calculating marginal densities, Journal of the American Statistical Association 85(410): 398–409.
Gelman, A., Meng, X.-L. & Stern, H. (1996). Posterior predictive assessment of model fitness via realized discrepancies, Statistica Sinica 6: 733–807.
Gneiting, T. & Raftery, A. E. (2007). Strictly proper scoring rules, prediction, and estimation, Journal of the American Statistical Association 102: 359–378.
Gössl, C., Auer, D. P. & Fahrmeir, L. (2001). Bayesian spatiotemporal inference in functional magnetic resonance imaging, Biometrics 57(2): 554–562.
Hjort, N. L., Dahl, F. A. & Steinbakk, G. H. (2006). Post-processing posterior predictive p-values, Journal of the American Statistical Association 101(475): 1157–1174.
Kirkwood, B. & Sterne, J. (2003). Medical Statistics, 2nd edn, Blackwell Publishing, Oxford.
Knorr-Held, L. & Rue, H. (2002). On block updating in Markov random field models for disease mapping, Scandinavian Journal of Statistics 29(4): 597–614.
Lee, Y., Nelder, J. A. & Pawitan, Y. (2006). Generalized Linear Models with Random Effects - Unified Analysis via H-likelihood, Chapman & Hall/CRC.
Marshall, E. C. & Spiegelhalter, D. J. (2003). Approximate cross-validatory predictive checks in disease-mapping methods, Statistics in Medicine 22(4): 1649–1660.
Marshall, E. C. & Spiegelhalter, D. J. (2007). Identifying outliers in Bayesian hierarchical models: a simulation-based approach, Bayesian Analysis 2(2): 409–444.
Martino, S. & Rue, H. (2009). Implementing approximate Bayesian inference using Integrated Nested Laplace Approximation: A manual for the INLA program. http://www.math.ntnu.no/˜hrue/GMRFLib.
Natário, I. & Knorr-Held, L. (2003). Non-parametric ecological regression and spatial variation, Biometrical Journal 45(6): 670–688.
Newton, M. A. & Raftery, A. E. (1994). Approximate Bayesian inference by the weighted likelihood bootstrap (with discussion), Journal of the Royal Statistical Society: Series B 56: 3–48.
Pettit, L. I. (1990). The conditional predictive ordinate for the normal distribution, Journal of the Royal Statistical Society: Series B 52: 175–184.
Plummer, M. (2008). Penalized loss functions for Bayesian model comparison, Biostatistics 9(3): 523–539.
Raftery, A. E. (1996). Hypothesis testing and model selection, in W. R. Gilks, S. Richardson & D. J. Spiegelhalter (eds), Markov chain Monte Carlo in Practice, Chapman & Hall, pp. 163–187.
Riebler, A. & Held, L. (2009). The analysis of heterogeneous time trends in multivariate age-period-cohort models, Technical report, University of Zurich, Biostatistics Unit. Conditionally accepted for Biostatistics.
Robert, C. & Casella, G. (2004). Monte Carlo Statistical Methods, Springer.
Rue, H. & Held, L. (2005). Gaussian Markov Random Fields: Theory and Applications, Chapman & Hall/CRC Press, London.
Rue, H. & Martino, S. (2007). Approximate Bayesian inference for hierarchical Gaussian Markov random field models, Journal of Statistical Planning and Inference 137: 3177–3192.
Rue, H., Martino, S. & Chopin, N. (2009). Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations (with discussion), Journal of the Royal Statistical Society: Series B 71: 319–392.
Schrödle, B. & Held, L. (2009). Evaluation of case reporting data from Switzerland: Spatio-temporal disease mapping using INLA, Technical report, University of Zurich, Biostatistics Unit.
Spiegelhalter, D. J., Best, N. G., Carlin, B. R. & van der Linde, A. (2002). Bayesian measures of model complexity and fit (with discussion), Journal of the Royal Statistical Society: Series B 64: 583–639.
Stern, H. & Cressie, N. (2000). Posterior predictive model checks for disease mapping models, Statistics in Medicine 19: 2377–2397.
Tierney, L. & Kadane, J. B. (1986). Accurate approximations for posterior moments and marginal densities, J. Amer. Statist. Assoc. 81(393): 82–86.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Held, L., Schrödle, B., Rue, H. (2010). Posterior and Cross-validatory Predictive Checks: A Comparison of MCMC and INLA. In: Kneib, T., Tutz, G. (eds) Statistical Modelling and Regression Structures. Physica-Verlag HD. https://doi.org/10.1007/978-3-7908-2413-1_6
Download citation
DOI: https://doi.org/10.1007/978-3-7908-2413-1_6
Published:
Publisher Name: Physica-Verlag HD
Print ISBN: 978-3-7908-2412-4
Online ISBN: 978-3-7908-2413-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)