VRSketchIn

Drey, Tobias; Gugenheimer, Jan; Karlbauer, Julian; Milo, Maximilian; Rukzio, Enrico

doi:10.1145/3313831.3376628

Cited by 96 publications

(17 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Researchers combined calibration techniques and tracking systems to spatially map flat virtual surfaces onto physical ones. Examples are passive and active markers for optical tracking systems (Poupyrev et al, 1998;Lindeman et al, 1999;Clergeaud and Guitton, 2017;Arora et al, 2018;Drey et al, 2020) or controllers affixed to physical objects (Wang et al, 2019). Also AR devices like the Microsoft HoloLens provide spatial mapping features for physical planes which were used in the past (Arora et al, 2018).…”

Section: Surface Tracking and Calibrationmentioning

confidence: 99%

“…Previous work showed handwriting and sketching surfaces in XR based on projecting 3D lines onto flat virtual surfaces or by manipulating pixel colors of the surface texture. While some surfaces which were implemented in previous work only visualize the user drawing (Elmgren, 2017;Wang et al, 2019;Drey et al, 2020), others also integrate saving and loading features (Poupyrev et al, 1998;Clergeaud and Guitton, 2017;Arora et al, 2018;Chen et al, 2019;Jetter et al, 2020). Traditional 2D desktop applications can be brought into XR environments.…”

Section: Virtual Surfacesmentioning

confidence: 99%

See 1 more Smart Citation

Off-The-Shelf Stylus: Using XR Devices for Handwriting and Sketching on Physically Aligned Virtual Surfaces

Kern

Kullmann

Ganal

et al. 2021

Front. Virtual Real.

View full text Add to dashboard Cite

This article introduces the Off-The-Shelf Stylus (OTSS), a framework for 2D interaction (in 3D) as well as for handwriting and sketching with digital pen, ink, and paper on physically aligned virtual surfaces in Virtual, Augmented, and Mixed Reality (VR, AR, MR: XR for short). OTSS supports self-made XR styluses based on consumer-grade six-degrees-of-freedom XR controllers and commercially available styluses. The framework provides separate modules for three basic but vital features: 1) The stylus module provides stylus construction and calibration features. 2) The surface module provides surface calibration and visual feedback features for virtual-physical 2D surface alignment using our so-called 3ViSuAl procedure, and surface interaction features. 3) The evaluation suite provides a comprehensive test bed combining technical measurements for precision, accuracy, and latency with extensive usability evaluations including handwriting and sketching tasks based on established visuomotor, graphomotor, and handwriting research. The framework’s development is accompanied by an extensive open source reference implementation targeting the Unity game engine using an Oculus Rift S headset and Oculus Touch controllers. The development compares three low-cost and low-tech options to equip controllers with a tip and includes a web browser-based surface providing support for interacting, handwriting, and sketching. The evaluation of the reference implementation based on the OTSS framework identified an average stylus precision of 0.98 mm (SD = 0.54 mm) and an average surface accuracy of 0.60 mm (SD = 0.32 mm) in a seated VR environment. The time for displaying the stylus movement as digital ink on the web browser surface in VR was 79.40 ms on average (SD = 23.26 ms), including the physical controller’s motion-to-photon latency visualized by its virtual representation (M = 42.57 ms, SD = 15.70 ms). The usability evaluation (N = 10) revealed a low task load, high usability, and high user experience. Participants successfully reproduced given shapes and created legible handwriting, indicating that the OTSS and it’s reference implementation is ready for everyday use. We provide source code access to our implementation, including stylus and surface calibration and surface interaction features, making it easy to reuse, extend, adapt and/or replicate previous results (https://go.uniwue.de/hci-otss).

show abstract

Section: Surface Tracking and Calibrationmentioning

confidence: 99%

Section: Virtual Surfacesmentioning

confidence: 99%

Off-The-Shelf Stylus: Using XR Devices for Handwriting and Sketching on Physically Aligned Virtual Surfaces

Kern

Kullmann

Ganal

et al. 2021

Front. Virtual Real.

View full text Add to dashboard Cite

show abstract

“…The users performed spatial inspections very frequently during the sketching process. VR facilitates spatial inspections, which should be a major reason for the improved performance because it benefits a more holistic approach (Drey et al, 2020).…”

Section: Three-dimensional Immersive Sketching Versus Two-dimensional...mentioning

confidence: 99%

Is virtual reality the solution? A comparison between 3D and 2D creative sketching tools in the early design process

Houzangbe

Masson

Fleury

et al. 2022

Front. Virtual Real.

View full text Add to dashboard Cite

Creativity is key in the early phases of innovation processes. With the rapid evolution of technologies, designers now have access to various tools to support this activity. Virtual reality (VR) takes over multiple domains, especially during conception. However, is VR really facilitating creativity in the initial ideation phases? We compare two sketching modalities through dedicated creativity support tools (CSTs): one in VR and one on a 2D interactive whiteboard. We propose a two-part creativity task (divergent and convergent thinking) for two groups of 30 participants each. We record user experience, creative experience, and creative performance. Our results show that VR is more stimulating, attractive, and engaging. We also observe a better level of creativity for the participants using the VR CST. Our results indicate that VR is an effective and relevant tool to boost creativity and that this effect might carry over to following creative tasks.

show abstract

“…In the last few years, sketch interaction has inspired many studies, especially in combination with 3D environments. In VRSketchIn [14], Drey et al use a 6DoF-tracked pen and tablet to explore 3D mid-air sketches in combination with a 2D constrained sketch on a surface. They explore 2D and 3D sketch in design space, analyzing these two diferent metaphors and related emerging patterns.…”

Section: Sketch In Mixed Environmentmentioning

confidence: 99%

Mixing Modalities of 3D Sketching and Speech for Interactive Model Retrieval in Virtual Reality

Giunchi

Sztrajman

James

et al. 2021

ACM International Conference on Interactive Media Experiences

View full text Add to dashboard Cite

Sketch and speech are intuitive interaction methods that convey complementary information and have been independently used for 3D model retrieval in virtual environments. While sketch has been shown to be an efective retrieval method, not all collections are easily navigable using this modality alone. We design a new challenging database for sketch comprised of 3D chairs where each of the components (arms, legs, seat, back) are independently colored. To overcome this, we implement a multimodal interface for querying 3D model databases within a virtual environment. We base the sketch on the state-of-the-art for 3D Sketch Retrieval, and use a Wizard-of-Oz style experiment to process the voice input. In this way, we avoid the complexities of natural language processing which frequently requires fne-tuning to be robust. We conduct two user studies and show that hybrid search strategies emerge from the combination of interactions, fostering the advantages provided by both modalities. CCS CONCEPTS• Human-centered computing → HCI design and evaluation methods; Virtual reality; • Computing methodologies → Object recognition; • Information systems → Retrieval models and ranking.

show abstract

VRSketchIn

Cited by 96 publications

References 43 publications

Off-The-Shelf Stylus: Using XR Devices for Handwriting and Sketching on Physically Aligned Virtual Surfaces

Off-The-Shelf Stylus: Using XR Devices for Handwriting and Sketching on Physically Aligned Virtual Surfaces

Is virtual reality the solution? A comparison between 3D and 2D creative sketching tools in the early design process

Mixing Modalities of 3D Sketching and Speech for Interactive Model Retrieval in Virtual Reality

Contact Info

Product

Resources

About