Design and Evaluation of Three Interaction Models for Manipulating Internet of Things (IoT) Devices in Virtual Reality

Abstract

More and more things are getting connected to the internet, including lights, speakers, and refrigerators. These connected things are an example of what a smart home system that is part of the Internet of Things (IoT) can incorporate. IoT enables advanced services by interconnecting physical and virtual things. But, building interactive prototypes for smart home systems can be difficult and costly, since it involves a number of different devices and systems with varying technological readiness level. Virtual reality (VR) is a technology that can create computer-generated environments and has been used as a design tool in many different domains, such as architecture, city planning, and industrial design. However, the focus has traditionally been on visualizing design proposals rather than letting the intended users directly interact with them. Recently, we have seen an intensified development of VR headsets such as HTC Vive and Oculus Rift. These headsets come with relatively welldeveloped hand controllers, which can be used to interact with the virtual environment. This opens up opportunities to develop and evaluate interactive virtual smart home systems. This paper presents three interaction models developed and evaluated using the new generation of VR technology. The interaction models were then compared in a user study with 18 participants. Some statistically significant differences and subjective preferences could be observed in the quantitative and qualitative data respectively. The main contribution of this paper is to elucidate knowledge about using VR as a prototyping tool to explore IoT interaction. Moreover, this study implies that you can collect and analyze data for statistical analysis using VR.

Evaluating an Augmented Reality Prototype for Enhanced User Guidance in an Industrial Production Context

“…AR can empower maintainers with immediate task execution capabilities, as reported by multiple sources, with HMDs playing a central role. AR can also help in daily work routines in a natural manner [15].…”

Superhuman Hearing - Virtual Prototyping of Artificial Hearing: a Case Study on Interactions and Acoustic Beamforming

“…The same VR approach significantly facilitates the learning process by enabling trainees to safely work with robots in VR [47]. Similarly, recent work regarding virtual prototypes for smart home systems [3] considered the interaction design (selection and control model) of virtual Internet of Things (IoT) devices.…”

Prototyping IoT-Based Virtual Environments: An Approach toward the Sustainable Remote Management of Distributed Mulsemedia Setups

“…Admittedly, more work related to the generation of virtual devices is required for a better acceptance of this simulator by its target audience, which is Industry. More focused on interaction, in [33], the new generation of VR technology (head-mounted displays and game engines) was explored in the form of a prototyping tool to control and monitor a virtual smart home environment.…”