Real-time robust body part tracking for augmented reality interface

Jung, Jaeho; Cho, Kyusung; Yang, Hyun Seung

doi:10.1145/1670252.1670295

Cited by 9 publications

(4 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In addition to instructional video playback, the AR content includes graphical overlays (ie, lines) that track parts of the body (ie, arms). For simplicity, we achieved this effect via postproduction video editing (although others have implemented body tracking [48][49][50]).…”

Section: Physical Rehabilitationmentioning

confidence: 99%

Opportunities and Challenges for Augmented Reality in Family Caregiving: Qualitative Video Elicitation Study

Albright,

Ko,

Buvanesh

et al. 2024

JMIR Form Res

View full text Add to dashboard Cite

Background Although family caregivers play a critical role in care delivery, research has shown that they face significant physical, emotional, and informational challenges. One promising avenue to address some of caregivers’ unmet needs is via the design of digital technologies that support caregivers’ complex portfolio of responsibilities. Augmented reality (AR) applications, specifically, offer new affordances to aid caregivers as they perform care tasks in the home. Objective This study explored how AR might assist family caregivers with the delivery of home-based cancer care. The specific objectives were to shed light on challenges caregivers face where AR might help, investigate opportunities for AR to support caregivers, and understand the risks of AR exacerbating caregiver burdens. Methods We conducted a qualitative video elicitation study with clinicians and caregivers. We created 3 video elicitations that offer ways in which AR might support caregivers as they perform often high-stakes, unfamiliar, and anxiety-inducing tasks in postsurgical cancer care: wound care, drain care, and rehabilitative exercise. The elicitations show functional AR applications built using Unity Technologies software and Microsoft Hololens2. Using elicitations enabled us to avoid rediscovering known usability issues with current AR technologies, allowing us to focus on high-level, substantive feedback on potential future roles for AR in caregiving. Moreover, it enabled nonintrusive exploration of the inherently sensitive in-home cancer care context. Results We recruited 22 participants for our study: 15 clinicians (eg, oncologists and nurses) and 7 family caregivers. Our findings shed light on clinicians’ and caregivers’ perceptions of current information and communication challenges caregivers face as they perform important physical care tasks as part of cancer treatment plans. Most significant was the need to provide better and ongoing support for execution of caregiving tasks in situ, when and where the tasks need to be performed. Such support needs to be tailored to the specific needs of the patient, to the stress-impaired capacities of the caregiver, and to the time-constrained communication availability of clinicians. We uncover opportunities for AR technologies to potentially increase caregiver confidence and reduce anxiety by supporting the capture and review of images and videos and by improving communication with clinicians. However, our findings also suggest ways in which, if not deployed carefully, AR technologies might exacerbate caregivers’ already significant burdens. Conclusions These findings can inform both the design of future AR devices, software, and applications and the design of caregiver support interventions based on already available technology and processes. Our study suggests that AR technologies and the affordances they provide (eg, tailored support, enhanced monitoring and task accuracy, and improved communications) should be considered as a part of an integrated care journey involving multiple stakeholders, changing information needs, and different communication channels that blend in-person and internet-based synchronous and asynchronous care, illness, and recovery.

show abstract

Section: Physical Rehabilitationmentioning

confidence: 99%

Opportunities and Challenges for Augmented Reality in Family Caregiving: Qualitative Video Elicitation Study

Albright,

Ko,

Buvanesh

et al. 2024

JMIR Form Res

View full text Add to dashboard Cite

show abstract

“…[19,20] evaluate the usage of movement of the phone in combination with a traditional button interface. [23] gives an example for body part tracking (e.g. hands) to interact with an AR environment in a setting using external cameras and large screens.…”

Section: Context and Related Workmentioning

confidence: 99%

Gesture-based interaction via finger tracking for mobile augmented reality

Hürst

Wezel

2012

Multimed Tools Appl

169

View full text Add to dashboard Cite

The goal of this research is to explore new interaction metaphors for augmented reality on mobile phones, i.e. applications where users look at the live image of the device's video camera and 3D virtual objects enrich the scene that they see. Common interaction concepts for such applications are often limited to pure 2D pointing and clicking on the device's touch screen. Such an interaction with virtual objects is not only restrictive but also difficult, for example, due to the small form factor. In this article, we investigate the potential of finger tracking for gesture-based interaction. We present two experiments evaluating canonical operations such as translation, rotation, and scaling of virtual objects with respect to performance (time and accuracy) and engagement (subjective user feedback). Our results indicate a high entertainment value, but low accuracy if objects are manipulated in midair, suggesting great possibilities for leisure applications but limited usage for serious tasks.

show abstract

“…Recently, many methods have been proposed to construct systems based on collaborative augmented reality [6][7][8][9][10][11][12]. They all rely on relevant sensors which provide visual or haptic feedback for detection and tracking.…”

Section: Introductionmentioning

confidence: 99%

“…For 3D registration in AR, detection and tracking of marker has been studied since [6], which register the virtual objects to the fiducial markers. The visual features are extracted for 3D registration based on natural markers [7][8][9]. On account of simpleness of the racket's shape, the existing detection and tracking methods are not appropriate for our system.…”

Section: Introductionmentioning

confidence: 99%

Collaborative Augmented Reality Ping-Pong Via Markerless Real Rackets

Yan

Chen

2011

2011 International Conference on Virtual Reality and Visualization

View full text Add to dashboard Cite

This article proposes a method of constructing a ping-pong system via markerless real rackets in collaborative augmented reality. Except a pair of video cameras, without any other sensors or artificial markers, users can use real rackets to hit virtual ping-pong ball on a virtual table and interact with remote partners in augmented reality scene just as they were playing ping-pong in the same place. First, the real racket can be detected and tracked in real-time in the video captured by a single camera in each site. By 3D registration, the real racket can seamlessly interact with the virtual ping-pong ball and table. Then, a communication scheme is designed for the consistent perception between users in collaborative augmented reality ping-pong system. To achieve real-time interaction, the whole method is implemented in a parallel computing environment through multi-core processors. Experimental results demonstrate that our system can provide consistent perception and natural user interaction with low latency and high precision.

show abstract

Real-time robust body part tracking for augmented reality interface

Cited by 9 publications

References 8 publications

Opportunities and Challenges for Augmented Reality in Family Caregiving: Qualitative Video Elicitation Study

Opportunities and Challenges for Augmented Reality in Family Caregiving: Qualitative Video Elicitation Study

Gesture-based interaction via finger tracking for mobile augmented reality

Collaborative Augmented Reality Ping-Pong Via Markerless Real Rackets

Contact Info

Product

Resources

About