Hand Tracking in Extended Reality Educational Applications

Buń, Paweł; Husár, Jozef; Kaščak, Jakub

doi:10.1007/978-3-030-99310-8_25

Cited by 7 publications

(4 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…K. Dorfmuller-Ulhaas pioneered the research on detailed optical kinematic hand tracking, which enabled the grasping of objects with natural finger closure movements (Dorfmuller-Ulhaas and Schmalstieg, 2001). The potential to circumvent controllers and naturally interact with objects provides great opportunities for complex surgical training and motor control rehabilitation (Buń et al, 2022). However, the current reported usability does not exceed that of traditional controls (Voigt-Antons et al, 2020).…”

Section: Assessmentmentioning

confidence: 99%

Designing immersive interfaces for clinical applications

Chenais,

Görgen

2024

Preprint

View full text Add to dashboard Cite

Digital immersive technologies have become increasingly prominent in clinical research and practice, encompassing medical communication and technical education, serious games for health, psychotherapy, and interfaces for neurorehabilitation. The worldwide effervescence of digital health and digital therapeutics has prompted the development and testing of numerous applications and interaction methods. Nevertheless, the lack of consistency in the approaches and the peculiarity of the constructed environments contribute to an increasing disparity between the eagerness for new immersive designs and the long-term clinical adoption of these technologies. Several challenges emerge from the collide of virtual environment designers and clinicians. This article seeks to examine the utilization and mechanics of medical immersive interfaces based on extended reality and highlight specific design challenges. The transfer of virtually acquired skills and clinical efficiency is frequently constrained by a combination of perceptual and attractiveness factors. We argue that a multidisciplinary approach to development and testing, along with a comprehensive acknowledgement of the shared mechanisms that underlie immersive training, are essential for the sustainable integration of extended reality into clinical settings. The present review discusses the application of a multilevel sensory framework to extended reality design, with the aim of developing brain centred immersive interfaces tailored for therapeutic and educational purposes. Such a framework must include broader design questions, such as the integration of digital technologies into psychosocial care models, clinical validation, and related ethical concerns. We propose that efforts to bridge the virtual gap should include mixed methodologies and neurodesign approaches, integrating user behavioural and physiological feedback into iterative design phases.

show abstract

Section: Assessmentmentioning

confidence: 99%

Designing immersive interfaces for clinical applications

Chenais,

Görgen

2024

Preprint

View full text Add to dashboard Cite

show abstract

“…The subsequent section outlines this area. However, advancements in haptic gloves [38], [104], hand-tracking systems [105]- [107], eye-tracking systems [108]- [110] and voice-controlled instructions (via speechto-text features) [111] used in XR applications would alleviate the need for the user to hold a controller physically. It allows users to naturally interface with the virtual environment as they would in the real world and to remove barriers to physically challenged people [112].…”

Section: C) Physical Movement Themementioning

confidence: 99%

Analysis of Caribbean XR Survey Creates an XR Development Strategy as a Path to the Regional Metaverse Evolution

Rameshwar

King

2023

Journal of Metaverse

View full text Add to dashboard Cite

XR provides benefits in innovation, competitiveness and sustainability that offset disruptions in and enhances physical reality. The Caribbean’s metaverse evolution started before the pandemic with the development of XR projects and creatives’ NFTs. The physical isolation during the Covid-19 pandemic accelerated the Caribbean’s interest in the metaverse and XR. In 2020, only 83 participants from Trinidad and Tobago entered the CARIRI AR/VR Challenge to demonstrate their XR ideas. There is a need to encourage and accelerate regional XR development. The purpose of this research is to explore Caribbean XR developers’ experiences to provide an understanding of the factors affecting their XR development. This paper addresses the question: What factors of influence will encourage the development of XR projects in the Caribbean to advance their metaverse development? Online questionnaires issued to Caribbean XR developers from July to December 2021 obtained responses from 77 participants throughout 13 regional countries. The primary data were statistically insignificant and skewed towards two countries (Jamaica and Trinidad & Tobago). Comparative and inferential analyses identified factors of influence, industry sectors, and design foci. The originality of this research is an XR development strategy that incorporates the I4.0, UX, and financial strategies. It establishes the XR project design foci (the user, the purpose and the location). The factors of influence minimum criteria and the industry sector(s) influence each design focus. An initial reference list of industry sectors is education (the preferred option), healthcare, tourism, culture, manufacturing for export, construction, entertainment, game development, agriculture, and environmental protection. The strategy’s value is in enabling content creators to design XR applications to meet consumers’ needs and increase the regional adoption of XR. The impact of the research on the Caribbean is to facilitate a path to the regional metaverse evolution. This research identified the need for a regional XR development policy.

show abstract

“…Currently, the best-selling HMD sensor is the Meta Quest 2 (Meta Platforms) because of its quality, affordability compared to the competition, and its use without cables, which offers freedom of movement to its users [ 15 ]. The main advantages of this device are: it is a wireless standalone device so it has an independence of a main CPU and external tracking system; the application in the 6 degrees of freedom; it has a good screen and in-self tracking; and the large amount of accessible content and applications [ 16 , 17 ]. Thanks to the use of their cameras, the device provides an inside-out tracking system for hand or controller recognition, making easier the naturally interaction in the virtual environment [ 16 , 17 ].…”

Section: Introductionmentioning

confidence: 99%

“…The main advantages of this device are: it is a wireless standalone device so it has an independence of a main CPU and external tracking system; the application in the 6 degrees of freedom; it has a good screen and in-self tracking; and the large amount of accessible content and applications [ 16 , 17 ]. Thanks to the use of their cameras, the device provides an inside-out tracking system for hand or controller recognition, making easier the naturally interaction in the virtual environment [ 16 , 17 ]. Other current devices can have better resources and excellent reliability but the high price of these systems makes the Meta Quest 2 an affordable solution to dispose of them in consultation with patients.…”

Section: Introductionmentioning

confidence: 99%

Head-Mounted Display for Clinical Evaluation of Neck Movement Validation with Meta Quest 2

Trinidad-Fernández

Bossavit

Fernández

et al. 2023

Sensors

View full text Add to dashboard Cite

Neck disorders have a significant impact on people because of their high incidence. The head-mounted display (HMD) systems, such as Meta Quest 2, grant access to immersive virtual reality (iRV) experiences. This study aims to validate the Meta Quest 2 HMD system as an alternative for screening neck movement in healthy people. The device provides data about the position and orientation of the head and, thus, the neck mobility around the three anatomical axes. The authors develop a VR application that solicits participants to perform six neck movements (rotation, flexion, and lateralization on both sides), which allows the collection of corresponding angles. An InertiaCube3 inertial measurement unit (IMU) is also attached to the HMD to compare the criterion to a standard. The mean absolute error (MAE), the percentage of error (%MAE), and the criterion validity and agreement are calculated. The study shows that the average absolute errors do not exceed 1° (average = 0.48 ± 0.09°). The rotational movement’s average %MAE is 1.61 ± 0.82%. The head orientations obtain a correlation between 0.70 and 0.96. The Bland–Altman study reveals good agreement between the HMD and IMU systems. Overall, the study shows that the angles provided by the Meta Quest 2 HMD system are valid to calculate the rotational angles of the neck in each of the three axes. The obtained results demonstrate an acceptable error percentage and a very minimal absolute error when measuring the degrees of neck rotation; therefore, the sensor can be used for screening neck disorders in healthy people.

show abstract

Hand Tracking in Extended Reality Educational Applications

Cited by 7 publications

References 25 publications

Designing immersive interfaces for clinical applications

Designing immersive interfaces for clinical applications

Analysis of Caribbean XR Survey Creates an XR Development Strategy as a Path to the Regional Metaverse Evolution

Head-Mounted Display for Clinical Evaluation of Neck Movement Validation with Meta Quest 2

Contact Info

Product

Resources

About