The success of creative products depends upon the felt experience of consumers. Capturing such consumer reactions requires the fusing of different types of experiential covariates and perceptual data in an integrated modeling framework. In this paper, the authors develop a novel multimodal machine learning framework that combines multimedia data (e.g., metadata, acoustic features and user generated textual data) in creative product settings and apply it for predicting the success of musical albums and playlists. The authors estimate the proposed model on a unique dataset which they collected using different online sources. The model integrates different types of nonparametrics to flexibly accommodate diverse types of effects. It uses penalized splines to capture the nonlinear impact of acoustic features and a supervised hierarchical Dirichlet process to represent crowd-sourced textual tags. It captures dynamics via a state-space specification. The authors show the predictive superiority of the model with respect to several benchmarks. The results illuminate the dynamics of musical success over the past five decades. The authors then use the components of the model for marketing decisions such as forecasting the success of new albums, album tuning and diagnostics, construction of playlists for different generations of music listeners, and contextual recommendations.

No abstract