Evaluating User Experience for Interactive Television: Towards the Development of a Domain-Specific User Experience Questionnaire

Abstract

Abstract. This paper presents a questionnaire-based approach to evaluate the user experience (UX) while interacting with interactive Television (iTV) systems. Current contributions in the field of UX propose generic methods applicable to various application domains, whereas our contribution is dedicated to the specific domain of interactive TV systems. Based on a classification of UX dimensions from a literature review, the first version of the questionnaire is focusing on the dimension's aesthetics, emotion, stimulation and identification. A validation study with 106 participants was performed to assess the relations between the evaluated UX dimensions, as well as their fit to the underlying theoretical assumptions. Results showed that the UX dimensions aesthetics, emotion and stimulation are important for the domain of iTV, while identification was not confirmed. The study revealed significant correlations between the type of IPTV system used and the emotional and stimulation dimension. Additionally, a significant effect of the TV reception mode and the type of IPTV box owned on the emotion towards the system was observed. Beyond the contribution of the questionnaire that is directly applicable for any iTV system, the findings described in the paper demonstrate the need for user experience evaluation methods targeted at specific domains: the validation of the questionnaire shows that identification is not a central dimension of user experience when interacting with interactive TV.

Enriching Task Models with Usability and User Experience Evaluation Data

“…Table 3 shows the type of data that was recorded and measured. In terms of UX the dimensions were derived from the domain specific IPTV-UX questionnaire [6].…”

User-Test Results Injection into Task-Based Design Process for the Assessment and Improvement of Both Usability and User Experience

“…In terms of user experience dimensions are measured using questionnaires or interviews, observation like videos or eye-tracking, sometimes using bio-physiological feedback. Typical dimensions for user experience are aesthetics, emotion, identification, stimulation, meaning/value or social connectedness [7]. Data that is collected during such a user test thus can be (a) qualitative data like responses of a user in an interview, (b) quantitative data -ranging from ordeal to ratio data.…”

“…The analysed data then is injected in the task model (7). The important novelty aspect of this proposed process is that it enhances the task models used with the data gathered during the evaluation.…”

“…(see Table 1). For qualitative data like answers in interviews we summarized the number of positive and/or negative comments related to usability and identified comments related to six user experience dimensions including aesthetics, emotion, identification, stimulation, social connectedness and meaning/value [7].…”

User Experience Evaluation Methods in the Games Development Life Cycle

“…The term user experience was only rarely used in the games industry (Federoff 2002), but became extremely prominent in the field of HCI. Today the communities of human-computer interaction and game research are starting to learn from each other (Bernhaupt et al 2015). On the one hand, user experience evaluation methods from HCI are used during the game development to improve user experience, on the other side HCI is borrowing and investigating aspects of the gaming experience like immersion, fun or flow to better understand the concept of user experience and apply it to standard software design and development.…”