Missing data are a pervasive challenge in the analysis of multivariate categorical data and can lead to biased estimation and reduced statistical efficiency when handled inappropriately. Bayesian latent class multiple imputation provides a flexible framework for addressing this problem by exploiting the underlying latent structure of the data. However, conventional Bayesian latent class imputation models generally assume that latent class membership is independent of observed covariates, potentially limiting estimation accuracy when covariates are informative of the latent class structure. This study proposes a covariate-dependent Bayesian latent class model for multiple imputation under the MAR mechanism. The proposed approach models latent class membership using multinomial logistic regression, allowing observed covariates to influence class allocation while preserving the latent class formulation for the response variables. Bayesian inference is performed using Gibbs sampling, with Pólya--Gamma data augmentation facilitating efficient posterior estimation of the regression coefficients. The performance of the proposed model was evaluated through a comprehensive simulation study under varying strengths of covariate effects and sample sizes, and compared with the conventional Bayesian latent class model. Performance was assessed using multiple imputation inference, latent class proportion recovery, regression coefficient recovery, posterior stability, and empirical coverage probabilities. The proposed model produced unbiased inference and demonstrated improved estimation accuracy when covariates were associated with latent class membership, while maintaining performance comparable to the conventional model when covariate effects were absent. Furthermore, RMSE decreased consistently as the sample size increased, providing empirical evidence of posterior concentration and improved estimation precision. These findings demonstrate that incorporating covariates into Bayesian latent class multiple imputation provides a practical and effective extension of the conventional latent class framework for multivariate categorical data with missing values under the MAR mechanism.
| Published in | American Journal of Theoretical and Applied Statistics (Volume 15, Issue 5) |
| DOI | 10.11648/j.ajtas.20261505.14 |
| Page(s) | 231-242 |
| Creative Commons |
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited. |
| Copyright |
Copyright © The Author(s), 2026. Published by Science Publishing Group |
Multiple Imputation, Latent Class Model, Missing at Random, Multivariate Categorical Data, Multinomial Logistic Regression, Bayesian Latent Class model, Covariate-dependent Latent Class Model
| [1] | O. F. Ayilara, L. Zhang, T. T. Sajobi, R. Sawatzky, E. Bohm, and L. M. Lix, "Impact of missing data on bias and precision when estimating change in patient-reported outcomes from a clinical registry," Health and Quality of Life Outcomes, vol. 17, no. 1, p. 106, 2019, |
| [2] | T. B. Pepinsky, "A note on listwise deletion versus multiple imputation," Political Analysis, vol. 26, no. 4, pp. 480-488, 2018, |
| [3] | D. B. Rubin, Multiple Imputation for Nonresponse in Surveys. New York: John Wiley & Sons, 1987, |
| [4] | S. van Buuren, Flexible Imputation of Missing Data, 2nd ed. Boca Raton, FL: Chapman & Hall/CRC, 2018, |
| [5] | C. K. Enders, Applied Missing Data Analysis. New York, NY: Guilford Publications, 2022. |
| [6] | R. J. A. Little and D. B. Rubin, Statistical Analysis with Missing Data, 3rd ed. John Wiley & Sons, 2019, |
| [7] | J. L. Schafer and R. M. Yucel, "Computational strategies for multivariate linear mixed-effects models with missing values," Journal of Computational and Graphical Statistics, vol. 11, no. 2, pp. 437-457, 2002, |
| [8] | J. L. Schafer, Analysis of Incomplete Multivariate Data. Boca Raton, FL: Chapman & Hall/CRC, 1997, |
| [9] | S. van Buuren and K. Groothuis-Oudshoorn, "mice: Multivariate imputation by chained equations in R," Journal of Statistical Software, vol. 45, no. 3, pp. 1-67, 2011, |
| [10] | J. K. Vermunt, J. R. Van Ginkel, L. A. Van der Ark, and K. Sijtsma, "Multiple imputation of incomplete categorical data using latent class analysis," Sociological Methodology, vol. 38, no. 1, pp. 369-397, 2008, |
| [11] | D. Vidotto, J. K. Vermunt, and K. Van Deun, "Bayesian latent class models for the multiple imputation of categorical data," Methodology, vol. 14, no. 2, pp. 56-68, 2018, |
| [12] | G. J. McLachlan and D. Peel, Finite Mixture Models. John Wiley & Sons, 2000, |
| [13] | D. W. van der Palm, L. A. van der Ark, and J. K. Vermunt, "Divisive latent class modeling as a density estimation method for categorical data," Journal of Classification, vol. 33, no. 1, pp. 52-72, 2016, |
| [14] | R. J. A. Little and D. B. Rubin, Statistical Analysis with Missing Data, 2nd ed. New York: John Wiley & Sons, 2002, |
| [15] | P. D. Allison, "Missing data," in The SAGE Handbook of Quantitative Methods in Psychology, R. E. Millsap and A. Maydeu-Olivares, Eds. Thousand Oaks, CA: SAGE Publications, 2009, pp. 72-89, |
| [16] | M. Gebregziabher and S. M. DeSantis, "Latent class based multiple imputation approach for missing categorical data," Journal of Statistical Planning and Inference, vol. 140, no. 11, pp. 3252-3262, 2010, |
| [17] | P. F. Lazarsfeld and N. W. Henry, Latent Structure Analysis. Boston: Houghton Mifflin, 1968. |
| [18] | L. A. Goodman, "The analysis of systems of qualitative variables when some of the variables are unobservable. Part I: A modified latent structure approach," American Journal of Sociology, vol. 79, no. 5, pp. 1179-1259, 1974, |
| [19] | M. Jankovi'c, E. Masthoff, M. Spreen, P. De Looff, and S. Bogaerts, "A latent class analysis of forensic psychiatric patients in relation to risk and protective factors," Frontiers in Psychology, vol. 12, p. 695354, 2021, |
| [20] | B. Hoogerheide, E. Visser, E. T. Maas, S. H. Booij, and H. Riese, "Latent class analysis in a transdiagnostic psychiatric population to identify classes of psychosocial functioning: Using data from routine clinical practice," Journal of Affective Disorders, vol. 379, pp. 710-720, 2025, |
| [21] | T. H. Bijmolt, L. J. Paas, and J. K. Vermunt, "Country and consumer segmentation: Multi-level latent class analysis of financial product ownership," International Journal of Research in Marketing, vol. 21, no. 4, pp. 323-340, 2004, |
| [22] | C. C. Clogg, "New developments in latent structure analysis," in Factor Analysis and Measurement in Sociological Research, S. Leinhardt, Ed. Beverly Hills, CA: Sage Publications, 1981, pp. 215-246. |
| [23] | K. Bandeen-Roche, D. L. Miglioretti, S. L. Zeger, and P. J. Rathouz, "Latent variable regression for multiple discrete outcomes," Journal of the American Statistical Association, vol. 92, no. 440, pp. 1375-1386, 1997, |
| [24] | C. C. Clogg and L. A. Goodman, "Latent structure analysis of a set of multidimensional contingency tables," Journal of the American Statistical Association, vol. 79, no. 388, pp. 762-771, 1984, |
| [25] | J. K. Vermunt and J. Magidson, "Latent class cluster analysis," in Applied Latent Class Analysis, J. A. Hagenaars and A. L. McCutcheon, Eds. Cambridge: Cambridge University Press, 2002, pp. 89-106, |
| [26] | J. K. Vermunt, "Latent class modeling with covariates: Two improved three-step approaches," Political Analysis, vol. 18, no. 4, pp. 450-469, 2010, |
| [27] | C. M. Dayton and G. B. Macready, "Concomitant-variable latent-class models," Journal of the American Statistical Association, vol. 83, no. 401, pp. 173-178, 1988, |
| [28] | K. Nylund-Gibson and A. Y. Choi, "Ten frequently asked questions about latent class analysis," Translational Issues in Psychological Science, vol. 4, no. 4, pp. 440-461, 2018, |
| [29] | A. Agresti, Categorical Data Analysis, 3rd ed. Hoboken, NJ: John Wiley & Sons, 2013, |
| [30] | A. Gelman, J. B. Carlin, H. S. Stern, D. B. Dunson, A. Vehtari, and D. B. Rubin, Bayesian Data Analysis, 3rd ed. Boca Raton, FL: Chapman & Hall/CRC, 2013, |
| [31] | C. P. Robert, The Bayesian Choice: From Decision-Theoretic Foundations to Computational Implementation, 2nd ed. New York, NY: Springer, 2007, |
| [32] | D. B. Rubin, "Inference and missing data," Biometrika, vol. 63, no. 3, pp. 581-592, 1976, |
| [33] | S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-6, no. 6, pp. 721-741, 1984, |
| [34] | N. G. Polson, J. G. Scott, and J. Windle, "Bayesian inference for logistic models using P'olya-Gamma latent variables," Journal of the American Statistical Association, vol. 108, no. 504, pp. 1339-1349, 2013, |
| [35] | J. L. Schafer, Analysis of Incomplete Multivariate Data. Boca Raton, FL: Chapman & Hall/CRC, 1997, |
| [36] | K. P. Murphy, Probabilistic Machine Learning: An Introduction. Cambridge, MA: MIT Press, 2022. |
| [37] | L. Wasserman, All of Statistics: A Concise Course in Statistical Inference, 1st ed. New York, NY: Springer, 2004, |
| [38] | A. W. van der Vaart, Asymptotic Statistics, ser. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge, UK: Cambridge University Press, 1998, |
| [39] | S. Ghosal and A. W. van der Vaart, Fundamentals of Nonparametric Bayesian Inference. Cambridge, UK: Cambridge University Press, 2017, |
| [40] | L. S. T. Ho, B. T. Nguyen, V. Dinh, and D. Nguyen, "Posterior concentration and fast convergence rates for generalized Bayesian learning," arXiv preprint arXiv:2111.10243, 2021. [Online]. Available: |
APA Style
Murithi, D. F., Ngure, J. N., Musau, V. M. (2026). Bayesian Latent Class Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism. American Journal of Theoretical and Applied Statistics, 15(5), 231-242. https://doi.org/10.11648/j.ajtas.20261505.14
ACS Style
Murithi, D. F.; Ngure, J. N.; Musau, V. M. Bayesian Latent Class Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism. Am. J. Theor. Appl. Stat. 2026, 15(5), 231-242. doi: 10.11648/j.ajtas.20261505.14
@article{10.11648/j.ajtas.20261505.14,
author = {Daniel Fundi Murithi and Josephine Njeri Ngure and Victor Muthama Musau},
title = {Bayesian Latent Class Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism},
journal = {American Journal of Theoretical and Applied Statistics},
volume = {15},
number = {5},
pages = {231-242},
doi = {10.11648/j.ajtas.20261505.14},
url = {https://doi.org/10.11648/j.ajtas.20261505.14},
eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ajtas.20261505.14},
abstract = {Missing data are a pervasive challenge in the analysis of multivariate categorical data and can lead to biased estimation and reduced statistical efficiency when handled inappropriately. Bayesian latent class multiple imputation provides a flexible framework for addressing this problem by exploiting the underlying latent structure of the data. However, conventional Bayesian latent class imputation models generally assume that latent class membership is independent of observed covariates, potentially limiting estimation accuracy when covariates are informative of the latent class structure. This study proposes a covariate-dependent Bayesian latent class model for multiple imputation under the MAR mechanism. The proposed approach models latent class membership using multinomial logistic regression, allowing observed covariates to influence class allocation while preserving the latent class formulation for the response variables. Bayesian inference is performed using Gibbs sampling, with Pólya--Gamma data augmentation facilitating efficient posterior estimation of the regression coefficients. The performance of the proposed model was evaluated through a comprehensive simulation study under varying strengths of covariate effects and sample sizes, and compared with the conventional Bayesian latent class model. Performance was assessed using multiple imputation inference, latent class proportion recovery, regression coefficient recovery, posterior stability, and empirical coverage probabilities. The proposed model produced unbiased inference and demonstrated improved estimation accuracy when covariates were associated with latent class membership, while maintaining performance comparable to the conventional model when covariate effects were absent. Furthermore, RMSE decreased consistently as the sample size increased, providing empirical evidence of posterior concentration and improved estimation precision. These findings demonstrate that incorporating covariates into Bayesian latent class multiple imputation provides a practical and effective extension of the conventional latent class framework for multivariate categorical data with missing values under the MAR mechanism.},
year = {2026}
}
TY - JOUR T1 - Bayesian Latent Class Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism AU - Daniel Fundi Murithi AU - Josephine Njeri Ngure AU - Victor Muthama Musau Y1 - 2026/09/20 PY - 2026 N1 - https://doi.org/10.11648/j.ajtas.20261505.14 DO - 10.11648/j.ajtas.20261505.14 T2 - American Journal of Theoretical and Applied Statistics JF - American Journal of Theoretical and Applied Statistics JO - American Journal of Theoretical and Applied Statistics SP - 231 EP - 242 PB - Science Publishing Group SN - 2326-9006 UR - https://doi.org/10.11648/j.ajtas.20261505.14 AB - Missing data are a pervasive challenge in the analysis of multivariate categorical data and can lead to biased estimation and reduced statistical efficiency when handled inappropriately. Bayesian latent class multiple imputation provides a flexible framework for addressing this problem by exploiting the underlying latent structure of the data. However, conventional Bayesian latent class imputation models generally assume that latent class membership is independent of observed covariates, potentially limiting estimation accuracy when covariates are informative of the latent class structure. This study proposes a covariate-dependent Bayesian latent class model for multiple imputation under the MAR mechanism. The proposed approach models latent class membership using multinomial logistic regression, allowing observed covariates to influence class allocation while preserving the latent class formulation for the response variables. Bayesian inference is performed using Gibbs sampling, with Pólya--Gamma data augmentation facilitating efficient posterior estimation of the regression coefficients. The performance of the proposed model was evaluated through a comprehensive simulation study under varying strengths of covariate effects and sample sizes, and compared with the conventional Bayesian latent class model. Performance was assessed using multiple imputation inference, latent class proportion recovery, regression coefficient recovery, posterior stability, and empirical coverage probabilities. The proposed model produced unbiased inference and demonstrated improved estimation accuracy when covariates were associated with latent class membership, while maintaining performance comparable to the conventional model when covariate effects were absent. Furthermore, RMSE decreased consistently as the sample size increased, providing empirical evidence of posterior concentration and improved estimation precision. These findings demonstrate that incorporating covariates into Bayesian latent class multiple imputation provides a practical and effective extension of the conventional latent class framework for multivariate categorical data with missing values under the MAR mechanism. VL - 15 IS - 5 ER -