Using programming by demonstration for multimodality in mobile-human interactions

Abstract

The emergence of sensor-based modalites enriches the human-mobile interaction. However, mobile applications end-users are oen faced with interaction restrictions and do not yet have the possibility to modify their interaction modalities, according to their needs. In this paper, we present an approach that allows smartphone users to add and modify the interaction modalities of their already installed mobile applications, according to their preferences and needs. The approach is based on a Wrapper