Teaching American Sign Language in Mixed Reality

Shao, Qijia; Sniffen, Amy; Blanchet, Julien; Hillis, Megan E.; Shi, Xinyu; Haris, Themistoklis K.; Liu, Jason; Lamberton, Jason; Malzkuhn, Melissa; Quandt, Lorna C.; Mahoney, James; Kraemer, David J. M.; Zhou, Xia; Balkcom, Devin

doi:10.1145/3432211

Cited by 27 publications

(6 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The full texts of 83 papers assessed for eligibility were carefully analyzed. Thirteen articles [ 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 ] were excluded due to the exclusion criteria (1), one contribution [ 29 ] due to the exclusion criteria (2), 17 scientific results [ 30 , 31 , 32 , 33 , 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 ] due to the exclusion criteria (3) and 5 [ 47 , 48 , 49 , 50 , 51 ] contributions due to the exclusion criteria (4). Finally, only 47 studies were included in the quantitative synthesis.…”

Section: Methodsmentioning

confidence: 99%

Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects

Palumbo

2022

Sensors

View full text Add to dashboard Cite

In the world reference context, although virtual reality, augmented reality and mixed reality have been emerging methodologies for several years, only today technological and scientific advances have made them suitable to revolutionize clinical care and medical contexts through the provision of enhanced functionalities and improved health services. This systematic review provides the state-of-the-art applications of the Microsoft® HoloLens 2 in a medical and healthcare context. Focusing on the potential that this technology has in providing digitally supported clinical care, also but not only in relation to the COVID-19 pandemic, studies that proved the applicability and feasibility of HoloLens 2 in a medical and healthcare scenario were considered. The review presents a thorough examination of the different studies conducted since 2019, focusing on HoloLens 2 medical sub-field applications, device functionalities provided to users, software/platform/framework used, as well as the study validation. The results provided in this paper could highlight the potential and limitations of the HoloLens 2-based innovative solutions and bring focus to emerging research topics, such as telemedicine, remote control and motor rehabilitation.

show abstract

Section: Methodsmentioning

confidence: 99%

Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects

Palumbo

2022

Sensors

View full text Add to dashboard Cite

show abstract

“…Several techniques and frameworks for dynamic hand gesture recognition are proposed by researchers [21][22][23][24][25][26][27]. Unlike existing solutions, the framework presented in this paper does not require data sets, network training, or expert knowledge to create new gestures.…”

Section: Dynamic Gesture Recognitionmentioning

confidence: 99%

AnyGesture: Arbitrary One-Handed Gestures for Augmented, Virtual, and Mixed Reality Applications

2022

View full text Add to dashboard Cite

Natural user interfaces based on hand gestures are becoming increasingly popular. The need for expensive hardware left a wide range of interaction possibilities that hand tracking enables largely unexplored. Recently, hand tracking has been built into inexpensive and widely available hardware, allowing more and more people access to this technology. This work provides researchers and users with a simple yet effective way to implement various one-handed gestures to enable deeper exploration of gesture-based interactions and interfaces. To this end, this work provides a framework for design, prototyping, testing, and implementation of one-handed gestures. The proposed framework was implemented with two main goals: First, it should be able to recognize any one-handed gesture. Secondly, the design and implementation of gestures should be as simple as performing the gesture and pressing a button to record it. The contribution of this paper is a simple yet unique way to record and recognize static and dynamic one-handed gestures. A static gesture can be captured with a template matching approach, while dynamic gestures use previously captured spatial information. The presented approach was evaluated in a user study with 33 participants and the implementable gestures received high accuracy and user acceptance.

show abstract

“…These technologies generally work to blend the digital and physical environments, providing users with novel and immersive ways to interact. We see XR increasingly being used in a range of contexts, including for entertainment [37], education [31,67], health [2], construction [84], retail [60,73], military [34] and manufacturing [54].…”

Section: Auditable Xrmentioning

confidence: 99%

Auditable Augmented/Mixed/Virtual Reality

Cloete

Norval

Singh

2021

Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

View full text Add to dashboard Cite

Virtual, Augmented and Mixed Reality (XR) technologies are becoming increasingly pervasive. However, the contextual nature of XR, and its tight coupling of the digital and physical environments, brings real propensity for loss and harm. This means that auditability---the ability to inspect how a system operates---will be crucial for dealing with incidents as they occur, by providing the information enabling rectification, repair and recourse. However, supporting audit in XR brings considerations, as the process of capturing audit data itself has implications and challenges, both for the application (e.g., overheads) and more broadly. This paper explores the practicalities of auditing XR systems, characterises the tensions between audit and other considerations, and argues the need for flexible tools enabling the management of such. In doing so, we introduce Droiditor, a configurable open-source Android toolkit that enables the runtime capture of audit-relevant data from mobile applications. We use Droiditor as a means to indicate some potential implications of audit data capture, demonstrate how greater configurability can assist in managing audit-related concerns, and discuss the potential considerations that result. Given the societal demands for more transparent and accountable systems, our broader aim is to draw attention to auditability, highlighting tangible ways forward and areas for future work.

show abstract

Teaching American Sign Language in Mixed Reality

Cited by 27 publications

References 28 publications

Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects

Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects

AnyGesture: Arbitrary One-Handed Gestures for Augmented, Virtual, and Mixed Reality Applications

Auditable Augmented/Mixed/Virtual Reality

Contact Info

Product

Resources

About