Display of real-time 3D sensor data in a DVE system

Abstract

This paper describes the implementation of displaying real-time processed LiDAR 3D data in a DVE pilot assistance system. The goal is to display to the pilot a comprehensive image of the surrounding world without misleading or cluttering information. 3D data which can be attributed, i.e. classified, to terrain or predefined obstacle classes is depicted differently from data belonging to elevated objects which could not be classified. Display techniques may be different for head-down and head-up displays to avoid cluttering of the outside view in the latter case. While terrain is shown as shaded surfaces with grid structures or as grid structures alone, respectively, classified obstacles are typically displayed with obstacle symbols only. Data from objects elevated above ground are displayed as shaded 3D points in space. In addition the displayed 3D points are accumulated over a certain time frame allowing on the one hand side a cohesive structure being displayed and on the other hand displaying moving objects correctly. In addition color coding or texturing can be applied based on known terrain features like land use.

Virtual Cockpit Instruments—How Head-Worn Displays Can Enhance the Obstacle Awareness of Helicopter Pilots

“…Based on sensor and database information, the HWD shows a conformal terrain grid and contour lines to avoid controlled ight into terrain. Further, a conformal 3-D landing symbology provides necessary cues for low-visibility landings [21]. During a European DVE-M campaign, a joint team of researchers from DLR and Hensoldt demonstrated an HWD-based tunnel guidance system which was dynamically updated via a lidar sensor scanning the environment for obstacles [22].…”

Virtual reality headsets as external vision displays for helicopter operations: the potential of an exocentric viewpoint

“…After fusing data from the various sources, one typically has two choices for presenting this information to the pilot: via panel-mounted display (PMD) 3 or via see-through head-worn display (HWD), [4][5][6] also known as helmet-mounted display (HMD). Both existing display types have their advantages and can greatly improve flight safety.…”

Virtual Cockpit: an immersive head-worn display as human–machine interface for helicopter operations

“…1, the state-of-the-art solutions use either a panel-mounted display (PMD) or a see-through head-worn display (HWD), also known as augmented reality (AR) display. An example of the former is the integrated cueing environment (ICE) by the US military, 4,5 while the latter approach is adopted by, for example, Münsterer et al, [6][7][8] Schmerwitz et al, 9 and Viertler and Hajek. 10 Both methods have shown their benefits in many studies.…”