Challenges with displaying enhanced and synthetic vision video on a head-up display

Howells, Peter J.; Brown, Robert D.

doi:10.1117/12.720445

Cited by 3 publications

(3 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Today more and more aircrafts have a head-up display that is included in the flight deck display suite. Displaying video on the HUD is a hard challenge because this display has to operate in a wide range of lighting conditions while performing its primary function of displaying flight information (Howells, Brown, 2007).…”

Section: Head-up Projection Systemsmentioning

confidence: 99%

“…The location of the sensor is presented in Figure 1. Processing of the EVS frame for effective presentation on the HUD received a lot of scholar attention recently (Howells, Brown, 2007, Mohideen et al, 2013, Kramer et al, 2011. Still, to the best of our knowledge, there is no research regarding elimination of the parallax between the pilot's eyebox and the EVS sensor pose.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Synthetic Vision System Calibration for Conform Projection on the Pilot’s Head-Up Display

Danilov

Kozyrev

Grechanichenko

et al. 2020

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

Abstract. Situational awareness of the crew is critical for the safety of the air flight. Head-up display allows providing all required flight information in front of the pilot over the cockpit view visible through the cockpit’s front window. This device has been created for solving the problem of informational overload during piloting of an aircraft. While computer graphics such as scales and digital terrain model can be easily presented on the such display, errors in the Head-up display alignment for correct presenting of sensor data pose challenges. The main problem arises from the parallax between the pilot’s eyes and the position of the camera. This paper is focused on the development of an online calibration algorithm for conform projection of the 3D terrain and runway models on the pilot’s head-up display. The aim of our algorithm is to align the objects visible through the cockpit glass with their projections on the Head-up display. To improve the projection accuracy, we use an additional optical sensor installed on the aircraft. We combine classical photogrammetric techniques with modern deep learning approaches. Specifically, we use an object detection neural network model to find the runway area and align runway projection with its actual location. Secondly, we re-project the sensor’s image onto the 3D model of the terrain to eliminate errors caused by the parallax. We developed an environment simulator to evaluate our algorithm. Using the simulator we prepared a large training dataset. The dataset includes 2000 images of video sequences representing aircraft’s motion during takeoff, landing and taxi. The results of the evaluation are encouraging and demonstrate both qualitatively and quantitatively that the proposed algorithm is capable of precise alignment of the 3D models projected on a Head-up display.

show abstract

Section: Head-up Projection Systemsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Synthetic Vision System Calibration for Conform Projection on the Pilot’s Head-Up Display

Danilov

Kozyrev

Grechanichenko

et al. 2020

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

show abstract

“…The intermediate image is formed between the relay system and combiner, which is positioned in sight of the pilot in such a way-by reflection from the combiner-that a virtual image forms in the far field. Through the combiner, a pilot can simultaneously observe the outside scene, such as a runway, as well as information gathered from various types of sensors [8,[16][17][18].…”

Section: A Basic Principle Of Hudmentioning

confidence: 99%

Design and fabrication of a holographic head-up display with asymmetric field of view

et al. 2014

View full text Add to dashboard Cite

It is difficult to design and fabricate a head-up display (HUD) with a large asymmetric field of view (FOV) while maintaining a good image quality. In this paper, we design and develop such a holographic HUD system. To improve luminance and enhance the environmental adaptability of the HUD, we use a liquid crystal display with high brightness as well as a holographic reflection element. The vertical FOV is tilted to an angle of -7°, which is consistent with the actual view of the pilot. The decentration and tilt of the optical relay system effectively compensate for the distortion and off-axis aberration due to the asymmetric FOV and tilted, curved combiner. The transition plates used in the mechanical structure significantly decrease the difficulty in fabrication and alignment, and virtual prototyping greatly reduces the risk and shortens the development cycle. Experimental results demonstrate that this prototype achieves a total FOV of 30° (horizontal) ×24° (vertical), a resolution of 1280×1024, and a 5% distortion.

show abstract

Optical flow-based filtering for effective presentation of the enhanced vision on a HUD

Kniaz

2018

Optics, Photonics, and Digital Technologies for Imaging Applications V

View full text Add to dashboard Cite

Challenges with displaying enhanced and synthetic vision video on a head-up display

Cited by 3 publications

References 6 publications

Synthetic Vision System Calibration for Conform Projection on the Pilot’s Head-Up Display

Synthetic Vision System Calibration for Conform Projection on the Pilot’s Head-Up Display

Design and fabrication of a holographic head-up display with asymmetric field of view

Optical flow-based filtering for effective presentation of the enhanced vision on a HUD

Contact Info

Product

Resources

About