Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret

Abstract

We present the design, implementation, and user testing of a prototype augmented reality application to support military mechanics conducting routine maintenance tasks inside an armored vehicle turret. Our prototype uses a tracked head-worn display to augment a mechanic's natural view with text, labels, arrows, and animated sequences designed to facilitate task comprehension, location, and execution. A within-subject controlled user study examined professional military mechanics using our system to complete 18 common tasks under field conditions. These tasks included installing and removing fasteners and indicator lights, and connecting cables, all within the cramped interior of an armored personnel carrier turret. An augmented reality condition was tested against two baseline conditions: an untracked headworn display with text and graphics and a fixed flat panel display representing an improved version of the laptop-based documentation currently employed in practice. The augmented reality condition allowed mechanics to locate tasks more quickly than when using either baseline, and in some instances, resulted in less overall head movement. A qualitative survey showed mechanics found the augmented reality condition intuitive and satisfying for the tested sequence of tasks.

Augmented reality in the psychomotor phase of a procedural task

“…This text communicates the currently desired action, and any salient objects and physical locations involved with the action. We also implemented a localization approach similar to our earlier work [23,24]. A screen-fixed 2D arrow first orients the user in the general direction of the target task (within ±90 • azimuth) and is replaced by a 3D arrow extending from the near clipping plane to the target location.…”

“…We created an interactive 3D documentation system that employs previously proposed design principles for assembly instructions [22]. This baseline is similar in spirit to that used in our earlier prototype [23,24]. It incorporates many aspects of the documentation used in the AR condition (e.g., text, instructions, labels, and motion paths), but presents them to the user on a fixed display without using head tracking.…”

“…In earlier work [23,24], we developed an AR prototype to assist with maintenance activities inside an armored personnel turret, and found that AR assistance was beneficial in the informational phase, allowing mechanics to localize tasks more quickly than computerbased documentation on a stationary display. However, we were unable to show any advantage for AR in the psychomotor phase of our selected tasks, which involved simple actions such as flipping a switch or removing a bolt.…”

Augmented Reality in Forest Machine Cabin

“…There is evidence that AR can improve the performance of the user in traditional industrial tasks like assembly work (Tang et al, 2003) and maintenance (Henderson and Feiner, 2009). We believe that the technology could also improve productivity in the field of forestry.…”

The ARICE Framework: Augmented Reality in Computing Education

“…The system then performs feature detection to identify any elements with which it is able to interact. Such elements can be objects presented by the environment and identified through feature recognition [18] or artifacts introduced by the researchers [19] in the form of 2-dimensional barcodes, called Quick Response (QR) codes [20]. In the studies previously reported, we can identify interaction mechanisms based on direct manipulation, whether the feature recognition is based on objects present in the environment and recognized by the system or through the scanning of QR codes.…”