Objective. VR is evolving into everyday technology. For all diverse application areas, it is essential to understand the user’s condition to ensure a safe, pleasant, and meaningful VR experience. However, VR experience evaluation is still in its infancy. The present paper takes up this research desideratum by conflating diverse expertise and learnings about experience evaluation in general and VR experiences in particular into a systematic evaluation framework (appRaiseVR).Method. To capture diverse expertise, we conducted two focus groups (bottom-up approach) with experts working in different fields of experience evaluation (e. g., Movie Experience, Theatre Experiences). First, we clustered the results of both focus groups. Then, we conflated those results and the learnings about experience evaluation stemming from the field of user experience into the final framework (top-down approach).Results. The framework includes five steps providing high-level guidance through the VR evaluation process. The first three steps support the definition of the experience and evaluation conditions (setting, level, plausibility). The last two steps guide the selection to find an appropriate time course and tools of measure.Conclusion. appRaiseVR offers high-level guidance for evaluators with different expertise and contexts. Finally, establishing similar evaluation procedures might contribute to safe, pleasant, and meaningful VR experiences.

Air traffic control (ATC) is a safety-critical work domain that has a history of applying tangible elements in its workstations. In the past, development was mostly technology-driven, which resulted in usability challenges like handling multiple input and output devices. In this work, we followed a user-centred design approach with air traffic controllers (ATCOs). Starting from the users' need for haptic feedback, we developed a novel tangible interaction concept for ATC. We iterated a set of tangibles -Fin, Whale, Coin, and Flatterer -based on formative evaluations with 24 ATCOs. From our qualitative results we extracted dimensions relevant to ATCOs' user experience including familiarity, efficiency and engagement. Our results can provide guidance and inspiration for the design of future ATC interfaces.

To increase capacity and safety in air traffic control, digital strip systems have superseded paper strips in lower airspace control centers in Europe. Previous ethnographic studies on paper strip systems anticipated a radical change in work practices with digital strip systems, but we are not aware of any studies that evaluated these predictions. We carried out contextual inquiries with controllers and focused on face-to-face and radio communication, interactions with the digital strip system and the workspace in general. In turn, we contribute (1) detailed descriptions of controllers' work practices, such as using tacit information from radio communication and 'standard advocates vs. tinkerers' operation modes, (2) respective implications for design and (3) discuss how the observed work practices are similar or different from the reported practices in the literature of the two preceding decades. Our key insights are, that documentation speed is faster with digital strips, although a high load in the case of radio frequency persists. Controllers retrieve tacit information from the radio communication and combine it with scattered cues from several displays to form empathic decisions that sometimes exceed the standard protocol. We conclude that the role of tacit information holds opportunities for future flight systems and should be considered in a holistic approach to individualized workspaces for controllers.

Air traffic control (ATC) is a safety-critical, cooperative work domain, which faces usability challenges due to technology driven development in the past. In this work, we followed a user-centered design process to explore how novel interaction concepts increase user experience in ATC. Based on controllers’ needs we envisioned one unified interface together with three possible interaction concepts (the mouse interface, flight-dial and tangible interface) addressing different aspects of ATC. We prototypically implemented the interaction concepts and iterated each prototype based on feedback from 24 controllers. Qualitative data from these iterative formative evaluations indicated that controllers prefer interfaces that are efficient to use, minimalistic, customizable and context sensitive. A summative evaluation (N = 12) showed that the hedonic quality of all three concepts were higher compared to the system currently in use. Our results and insights can provide guidance and inspiration for the future design of ATC interfaces.