"In VR, everything is possible!": Sketching and Simulating Spatially-Aware Interactive Spaces in Virtual Reality

Abstract

Figure 1. We created a virtual environment for designers, in which they can generate and arrange an arbitrary number of devices that execute realworld web applications (A). This allows simulation of existing interactive spaces and multi-device systems (B, C) [71], as well as sketching of new interactions with diverse tracking systems or futuristic devices, e.g., a cylindrical touch screen (D).

Breaking the Screen: Interaction Across Touchscreen Boundaries in Virtual Reality for Mobile Knowledge Workers

“…Petford et al [84] compared the selection performance of mouse and raycast pointing in full coverage displays (not in VR). Recently, Jetter et al [50] proposed to interactively design a space with various display form factors in VR. Wagner et al proposed a desk metaphor for controlling visual analytics that reappropriates a physical desk in VR [120].…”

Perspective and Evolution of Gesture Recognition for Sign Language: A Review

“…The tracked movements of the user are transformed into arbitrary coordinate systems and data formats; therefore, the VR environment serves as a kind of meta-layer to integrate and simulate different virtual tracking systems. [ 127 ].…”

Virtual Reality in Design Processes

“…These articles demonstrate a variety of immersion levels. Immersive VR with HMDs was the most common level, used in six articles (Gyldendahl Jensen, 2017;Häkkilä et al, 2018;Jetter et al, 2020;Kim et al, 2020;Nisha, 2019;Zhang & Chen, 2019). In addition, one article examined an MR system that employs see-through HMDs (Lu & Ishida, 2020).…”

“…": Sketching and simulating spatially-aware interactive spaces in virtual reality. (Jetter et al, 2020) • Using immersive virtual reality to support designing skills in vocational education. (Kim et al, 2020) • Implementation and evaluation of a high-presence interior layout simulation system using mixed reality.…”

“…The following methodologies were used in the included studies: Experiments (Chowdhury & Schnabel, 2020;Kim et al, 2020;Lu & Ishida, 2020;Sun et al, 2017;Zhang & Chen, 2019), Case studies (Häkkilä et al, 2018;Maftei & Harty, 2015;Sopher et al, 2019;Wu, 2018), Design-based research (Gyldendahl Jensen, 2017), Action research (Nisha, 2019), User study (Jetter et al, 2020) or Comparative study (Halabi, 2019). Data were gathered through surveys or questionnaires with some degree of selfassessment (Chowdhury & Schnabel, 2020;Halabi, 2019;Häkkilä et al, 2018;Lu & Ishida, 2020;Nisha, 2019;Sun et al, 2017;Wu, 2018;Zhang & Chen, 2019), observation (Gonzalez, 2018;Gyldendahl Jensen, 2017;Jetter et al, 2020;Maftei & Harty, 2015;Nisha, 2019;Sopher et al, 2019), interviews (Jetter et al, 2020;Nisha, 2019;Sopher et al, 2019), or audio-recordings from the experiment (Chowdhury & Schnabel, 2020), as well as the collection of student projects (Nisha, 2019;Sopher et al, 2019), student grades (Halabi, 2019), participants' design assessments (Chowdhury & Schnabel, 2020;Kim et al, 2020) or log data from the VR-interface (Kim et al, 2020;Sun et al, 2017). 13 of the 15 studies reported their number of participants.…”