Machine recognition of emotion has become one of the main targets for developing next-generation user interaction in computer systems. While affect recognition technology has achieved substantial progress recently, the application of user emotion recognition to software user interface is in its early stages. In this paper, we describe the development of an emotion-aware user interface with a focus on visual appearance. Further, we propose an emotion-aware UI-authoring platform that helps designers create emotion-aware visual effects. In order to demonstrate its feasibility, we developed a prototype framework built with the authoring tool DAT4UX. The tool can integrate the resulting design into a mobile application equipped with emotion recognition facility. A proof-of-concept application featuring an emotion-aware interface is developed using the tool.

Since affective computing has been introduced in 90s, affect recognition technology has achieved substantial progress recently. However, the application of user emotion recognition into software user interface is in its early stages. In this paper, we describe a new approach for developing mobile user interface which could react differently depending on user emotion states. First, an emotion reaction model is presented which determines user interface reactions for each emotional state. We introduce a pair of mappings from user states to different user interface versions. The reacting versions are implemented by a set of variations for a view. Further, we present an authoring framework to help developers/designers to create emotion-aware reactions based on the proposed emotion reaction model. The authoring framework is necessary to alleviate the burden of creating and handling multi versions for views at the development process. A prototype implementation is presented as an extension of the existing authoring tool DAT4UX. Moreover, a proof-of-concept application featuring an emotion-aware interface is developed using the tool.