The Application of Mixed Reality and UAS Technology in Port Decision-Making Process Based on PASSport Project

Abstract

It is becoming increasingly important to provide a solution for managing the present mission and status of autonomous and semi-autonomous vehicles operating on site in large and complex port locations. More ports are implementing digital twin systems, which provide a complete 3D reconstruction of the port as well as real-time data on all objects and actions in progress. It is challenging to provide all relevant data in a way that improves situational awareness and decision-making, resulting in improved management and a faster, more effective response during an emergency. This is due to greater port areas and drones operating in the air, on the waterʹs surface, and underneath. To solve this issue, the PASSport initiative, a project financed by the European Space Agency (EUSPA), is developing an innovative solution based on Mixed Reality (MR) technology. The solution combines real-time geo-tagged and Earth Observation data to provide end users with enhanced 3D representation of the port area via a dedicated Head Mounted Display (HMD) that records user location and movement.