When Realities Interweave: Exploring the Design Space of Immersive Tangible XR

Uhl, Jakob Carl; Schrom-Feiertag, Helmut; Regal, Georg; Hirsch, Linda; Weiß, Yannick; Tscheligi, Manfred

doi:10.1145/3569009.3571843

Cited by 3 publications

(5 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Te lowest rating system component was mixed-reality technology (mean ± SD � 4.11 ± 0.23). Te reason this model received such a high score is because mixed-reality technology can actually increase students' practical skills, which is in line with research by Uhl et al [39].…”

Section: Discussionsupporting

confidence: 86%

A Digital Painting Learning Model Using Mixed-Reality Technology to Develop Practical Skills in Character Design for Animation

Piankarnka,

Lertbumroongchai,

Piriyasurawong

2023

Advances in Human-Computer Interaction

View full text Add to dashboard Cite

This research aims to (1) synthesize the digital painting learning process by using mixed-reality technology to develop practical skills in character design for animation and (2) develop and evaluate digital painting learning models using mixed-reality technology to develop practical skills in character design for animation. This research was conducted by studying documentation and related research and designing digital painting learning models using mixed-reality technology to develop practical skills in character design for animation. Using a questionnaire, a total of 9 experts evaluated the model’s suitability. The statistics used in the research were the mean and standard deviation. The study found that a component of the digital painting learning process involves using mixed-reality technology to develop practical skills in character design for animation. It consists of the following four components: (1) input data, (2) the digital painting learning process, (3) output assessment, and (4) feedback. The expert’s evaluation of the model’s suitability found that the digital painting learning model using mixed-reality technology to develop practical skills in character design for animation was at the highest level (mean ± SD = 4.38 ± 0.21). This research is beneficial to faculty who teach character design and development for animation. The results of the study can be applied to teaching and learning.

show abstract

Section: Discussionsupporting

confidence: 86%

A Digital Painting Learning Model Using Mixed-Reality Technology to Develop Practical Skills in Character Design for Animation

Piankarnka,

Lertbumroongchai,

Piriyasurawong

2023

Advances in Human-Computer Interaction

View full text Add to dashboard Cite

show abstract

“…This realism can be augmented through tangible interactions and haptic feedback (Muender et al, 2019), enhancing the sensorimotor contingencies that underpin the user's sense of presence and immersion within the MR environment. Recently, Skarbez et al's framework was applied to the field of first responder training in MR (Uhl, Regal, Schrom-Feiertag, Murtinger, & Tscheligi, 2023).…”

Section: Immersion and The Sense Of Presence In Mixed Realitymentioning

confidence: 99%

“…Conversely, within the MED1stMR project this need was addressed, by integrating haptic technology into the training system in the form of an advanced training manikin. Insights into the interaction design with such a tangible manikin in MR were gathered with a forerunner prototype during the project and compared to other modalities of interacting with virtual patients (Uhl et al, 2024;.…”

Section: Haptic Manikinmentioning

confidence: 99%

“…The role of tangible interaction in augmenting MR training's realism and effectiveness especially in the realm of medical training is immense (Escobar-Castillejos, Noguez, Neri, Magana, & Benes, 2016). For instance, the incorporation of a tangible manikin into the MR environment serves as a prime example of how physical objects can enrich a virtual training module (Uhl, Schrom-Feiertag, Regal, Gallhuber, & Tscheligi, 2023). In the medical context, where tactile sensation and the ability to perform physical manipulations are critical, the tangible manikin becomes an invaluable asset.…”

Section: Immersion and The Sense Of Presence In Mixed Realitymentioning

confidence: 99%

See 1 more Smart Citation

Mixed Reality Training for Medical First Responders: System Evaluation and Recommendations

Zechner,

Uhl,

Baetzner

et al. 2024

Preprint

Self Cite

View full text Add to dashboard Cite

Purpose: This study assesses the integration of Mixed Reality (MR) technologies in medical first responder (MFR) training, focusing on identifying key factors influencing behavioral intention to use MR systems and practical implications for technology acceptance and enhanced realism through haptic feedback. Methods: Through a User-Centered Design approach, involving co-creation workshops, iterative development, and evaluations in pilot and field trials across six countries, this study evaluated technology acceptance, presence, user experience, and workload among MFRs. Both quantitative measures and qualitative feedback were collected to analyze the determinants of technology acceptance and user engagement. Results: The MED1stMR Training System, developed as a result, demonstrates that performance expectancy, effort expectancy, and social presence are significant predictors of behavioral intention to use MR training systems among MFRs. High technology acceptance and positive user experience were reported, with specific emphasis on the educational value of haptic feedback in skill training. Trainer feedback highlighted the importance of real-time performance metrics and openness to AI-driven training assistance for enhancing training outcomes. Conclusion: The study underscores the critical role of realistic patient interaction and the importance of aligning training challenges with users' skills to create engaging MR training environments for MFRs. Identifying factors influencing behavioral intention offers valuable insights for the development of MR training systems, suggesting a focus on social presence and interactive capabilities to improve realism and educational value. The findings advocate for the integration of adaptive training features and further exploration of AI support in scenario optimization and performance enhancement.

show abstract

“…For this work, especially interesting are VR training approaches applied for first responders, e.g., police training [9][10][11], medical first responder training [12], firefighters [13], disaster risk reduction and civil protection [14,15], and training for chemical, biological, radioactive, and nuclear (CBRN) events, e.g., [16][17][18].…”

Section: Introductionmentioning

confidence: 99%

Challenges in Virtual Reality Training for CBRN Events

Regal,

Pretolesi,

Schrom-Feiertag

et al. 2023

MTI

View full text Add to dashboard Cite

The contemporary geopolitical environment and strategic uncertainty shaped by asymmetric and hybrid threats urge the future development of hands-on training in realistic environments. Training in immersive, virtual environments is a promising approach. Immersive training can support training for contexts that are otherwise hard to access, dangerous, or have high costs. This paper discusses the challenges for virtual reality training in the CBRN (chemical, biological, radioactive, nuclear) domain. Based on initial considerations and a literature review, we conducted a survey and three workshops to gather requirements for CBRN training in virtual environments. We structured the gathered insights into four overarching themes—the future of CBRN training, ethical and safety requirements, evaluation and feedback, and tangible objects and tools. We provide insights on these four themes and discuss recommendations.

show abstract

When Realities Interweave: Exploring the Design Space of Immersive Tangible XR

Cited by 3 publications

References 27 publications

A Digital Painting Learning Model Using Mixed-Reality Technology to Develop Practical Skills in Character Design for Animation

A Digital Painting Learning Model Using Mixed-Reality Technology to Develop Practical Skills in Character Design for Animation

Mixed Reality Training for Medical First Responders: System Evaluation and Recommendations

Challenges in Virtual Reality Training for CBRN Events

Contact Info

Product

Resources

About