Flight test of a head-worn display as an equivalent-HUD for terminal operations

Shelton, Kevin J.; Arthur, Jarvis J.; Prinzel, Lawrence J.; Nicholas, Stephanie N.; Williams, Steven P.; Bailey, Randall E.

doi:10.1117/12.2177059

Cited by 3 publications

(3 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Flight testing by NASA showed that traffic diamonds shown in color on a HMD greatly reduced clutter. 31 Approach and taxi testing were done on a King Air aircraft in varying visual conditions. Participants reported they could intuitively disregard or focus on colored symbols when needed, decreasing clutter and increasing visual search time.…”

Section: Application-based Researchmentioning

confidence: 99%

Review of colored conformal symbology in head-worn displays

2017

View full text Add to dashboard Cite

The usage of conformal symbology in color head-worn displays (HWDs) opens up a range of new possibilities on modern flight decks. The capability of color augmentation seems especially useful for low flights in degraded visual environments. Helicopter flights in these conditions, including brownout by swirling dust or sand particles, can often lead to spatial disorientation (SD) and result in a significant amount of controlled flight into terrain (CFIT). While first generation color-capable conformal displays are deployed, practical guidelines for the use of color in these see-through interfaces are yet to be established. A literature survey is carried out to analyze available knowledge of color use in conformal displays and to identify established methodologies for human-factors experimentation in this domain. Firstly the key human factors involved in color HWDs are outlined, including hardware design aspects as well as perceptual and attentional aspects. Secondly research on color perception is mapped out, focusing on investigations of luminance contrast requirements, modeling of color space blending and development of color correction solutions. Thirdly application-based research of colored conformal symbology is reviewed, including several simulations and flight experiments. Analysis shows that established luminance contrast requirements need to be validated and that performance effects of colored HWD symbology need more objective measurements. Finally practical recommendations are made for further research. This literature study has thus established a theoretical framework for future experimental efforts in colored conformal symbology. The Institute of Flight Guidance of the German Aerospace Center (DLR) anticipates conducting experiments within this framework.

show abstract

Section: Application-based Researchmentioning

confidence: 99%

Review of colored conformal symbology in head-worn displays

2017

View full text Add to dashboard Cite

show abstract

“…In this way, the advantages compared to other display types or different symbologies can be examined. [33][34][35] In addition, there is the forecast that AR glasses will replace smartphones, according to which the smartphone manufacturers align their corporate strategy. 36 Then practically everyone would always have AR glasses like the HoloLens with them.…”

Section: Introductionmentioning

confidence: 99%

Flying a helicopter with the HoloLens as head-mounted display

Walko

Maibach

2021

Opt. Eng.

View full text Add to dashboard Cite

We describe the flight testing and the integration process of the Microsoft HoloLens 2 as head-mounted display (HMD) with DLR's research helicopter. In the previous work, the HoloLens was integrated into a helicopter simulator. Now, while migrating the HoloLens into a real helicopter, the main challenge was the head tracking of the HoloLens, because it is not designed to operate on moving vehicles. Therefore, the internal head tracking is operated in a limited rotation-only mode, and resulting drift errors are compensated for with an external tracker, several of which have been tested in advance. The fusion is done with a Kalman filter, which contains a non-linear weighting. Internal tracking errors of the HoloLens caused by vehicle accelerations are mitigated with a system identification approach. For calibration, the virtual world is manually aligned using the helicopter's noseboom. The external head tracker (EHT) is largely automatically calibrated using an optimization approach and therefore, works for all trackers and regardless of its mounting positions on vehicle and head. Most of the pretests were carried out in a car, which indicates the flexibility in terms of vehicle type. The flight tests have shown that the overall quality of this HMD solution is very good. The conformal holograms are almost jitter-free, there is no latency, and errors of lower frequencies are identical with the performance that the EHT can provide, which in combination greatly improves immersion. Profiting from almost all features of the HoloLens 2 is a major advantage, especially for rapid research and development. © The Authors. Published by SPIE under a Creative Commons Attribution 4.0 International License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

show abstract

“…44 Ideally, the test would be designed as a direct HUD versus HWD comparison, but since NASA's flight test vehicle (a BE-200 King Air) did not have a HUD installed, the purpose of the flight test was primarily to evaluate the use of HWDs during actual aircraft taxi and approach operations. Approach and taxi testing was performed in both visual and simulated instrument conditions.…”

Section: Flight Demonstrationmentioning

confidence: 99%

Review of head-worn displays for the Next Generation Air Transportation System

et al. 2017

View full text Add to dashboard Cite

Abstract. NASA Langley Research Center (LaRC) has conducted research in the area of helmet-mounted display (HMD)/head-worn display (HWD) over the past 30 years. Initially, NASA LaRC's research focused on military applications, but recently NASA has conducted a line of research in the area of HWD for commercial and business aircraft. This work revolved around numerous simulation experiments as well as flight tests to develop technology and data for industry and regulatory guidance. This paper summarizes the results of NASA's HMD/HWD research. Of note, the work tracks progress in wearable collimated optics, head tracking, latency reduction, and weight. The research lends credence to a small, sunglasses-type form factor of the HWD being acceptable to commercial pilots, and this goal is now becoming technologically feasible. The research further suggests that an HWD may serve as an "equivalent" head-up display (HUD) with safety, operational, and cost benefits. "HUD equivalence" appears to be the economic avenue by which HWDs can become mainstream on the commercial and business aircraft flight deck. If this happens, NASA's research suggests that additional operational benefits using the unique capabilities of the HWD can open up new operational paradigms.

show abstract

Flight test of a head-worn display as an equivalent-HUD for terminal operations

Cited by 3 publications

References 6 publications

Review of colored conformal symbology in head-worn displays

Review of colored conformal symbology in head-worn displays

Flying a helicopter with the HoloLens as head-mounted display

Review of head-worn displays for the Next Generation Air Transportation System

Contact Info

Product

Resources

About