Design of Contextual Filtered Features for Better Smartphone-User Receptivity Prediction

Abstract

For the successful engagement of users with incoming interventions, the delivery of Just-In-Time (or opportune moment-OM) interventions is of the utmost importance. This can be accomplished with a machine learning model that utilizes user context data. Smartwatch and smartphone interactions further open the space for further improvement by considering the user's state and environmental information. In this work, a novel feature engineering approach for predicting smartphone user receptivity to Just-In-Time (JIT) interventions is proposed. Proposed approach utilizes rich information from user-smartphone interactions and smartwatch sensor data to extract contextually filtered features. The superiority of the proposed feature engineering method is demonstrated by developing a machine learning model that predicts a participant's receptivity prior to administering an Experience Sampling Method (ESM) questionnaire. The proposed approach is evaluated using the KEmoPhone dataset, which contains 3,334 ESM answers collected over the course of one week from 73 participants. To reduce the bias that may result in selecting specific classifier, multiple classifiers are tested and their average ROC-AUC metrics are compared. The results show that the proposed feature engineering method -CFF improves the prediction performance, achieving an ROC-AUC of 56.5% as opposed to 54.7% obtained using conventional features (statistical moments of time series over an 80 min window). Such superior performance is consistent across multiple machine learning classification algorithms. Full research code will be released in jupyter notebooks for facilitating the research in the domain at https://github.com/Jumabek/receptivity upon the publication of this research work.