Bayesian clustering of multiple zero-inflated outcomes

Abstract

Several applications involving counts present a large proportion of zeros (excess-of-zeros data). A popular model for such data is the hurdle model, which explicitly models the probability of a zero count, while assuming a sampling distribution on the positive integers. We consider data from multiple count processes. In this context, it is of interest to study the patterns of counts and cluster the subjects accordingly. We introduce a novel Bayesian approach to cluster multiple, possibly related, zero-inflated processes. We propose a joint model for zero-inflated counts, specifying a hurdle model for each process with a shifted Negative Binomial sampling distribution. Conditionally on the model parameters, the different processes are assumed independent, leading to a substantial reduction in the number of parameters as compared with traditional multivariate approaches. The subject-specific probabilities of zero-inflation and the parameters of the sampling distribution are flexibly modelled via an enriched finite mixture with random number of components. This induces a two-level clustering of the subjects based on the zero/non-zero patterns (outer clustering) and on the sampling distribution (inner clustering). Posterior inference is performed through tailored Markov chain Monte Carlo schemes. We demonstrate the proposed approach on an application involving the use of the messaging service WhatsApp. This article is part of the theme issue ‘Bayesian inference: challenges, perspectives, and prospects’.

A special issue on Bayesian inference: challenges, perspectives and prospects

“…Beatrice Franzolini & co-authors [ 28 ] study an integer-supported zero-inflated model called the hurdle model, with the addition of a clustering mechanism, connecting with Sara Wade’s article [ 24 ]. The work builds on earlier advances on finite mixtures with random number of components, to bring higher computational efficiency in the Bayesian analysis of the model than when using non-parametric alternatives.…”