Development of an Augmented Reality Concept for Icebreaker Assistance and Convoy Operations

Abstract

A vessel convoy is a complex and high-risk operation completed during icebreaking operations in the Arctic. Icebreaker navigators need to continuously communicate with their crew while monitoring information such as speed, heading, and distance between vessels in the convoy. This paper presents an augmented reality user interface concept, which aims to support navigators by improving oversight and safety during convoy operations. The concept demonstrates how augmented reality can help to realize a situated user interface that adapts to user’s physical and operational contexts. The concept was developed through a human-centered design process and tested through a virtual reality simulator in a usability study involving seven mariners. The results suggest that augmented reality has the potential to improve the safety of convoy operations by integrating distributed information with heads-up access to operation-critical information. However, the user interface concept is still novel, and further work is needed to develop the concept and safely integrate augmented reality into maritime operations.

An Outlook on the Future Marine Traffic Management System for Autonomous Ships

“…Augmented reality is a fundamental tool for integrating information that the user already has in particularly complex or risky situations. The study described in [41] demonstrates the validity of supporting an augmented reality application for seven sailors involved in the activities of an icebreaker. For example, in [42] and [43], authors' investigate artificial intelligence algorithms to support the operator in preventing collisions using simulated data.…”

Virtual fieldwork on a ship’s bridge: virtual reality-reconstructed operation scenarios as contextual substitutes for fieldwork in design education

“…The VRROSs were developed in a recent research project exploring the use of AR technology in Arctic navigation (SEDNA), where the purpose of the scenarios was to produce a realistic 3D modeled context wherein we could design and test new AR concepts (Frydenberg et al 2021 ). We recreated three different scenarios containing icebreaker operations using a VR-enabled simulator.…”

An Approach for Measuring The Effects of Augmented Reality on Human Performance in Maritime Navigation

“…Several examples of the application of AR solutions in the maritime domain currently exist, with information incorporated for maritime navigation typically limited to basic navigation data, including heading, speed, compass, route waypoints and danger area identification (Laera et al, 2021; Takenaka et al, 2019). Specialized applications for maritime navigation AR have also been developed, including for ice navigation (Frydenberg et al, 2021; Okazaki et al, 2017), high-speed vessels (Hareide & Porathe, 2019), and recreational boaters and pleasure craft operations (Porathe & Ekskog, 2018). The majority of the focus of maritime navigation AR applications is on data and visualization that relate to general wayfinding and anti-collision.…”

“…This process is designed to capture relevant use cases and define areas where AR could add value to differing aspects of maritime operations. First, differing use cases are generated through SME inputs and stakeholder interests for potential solutions to known issues in specific operations, for example ice-breaking (Frydenberg et al, 2021) and Dynamic Positioning (Carho et al, 2022). From these initial data collections and scoping work fundamental knowledge is captured and organized relating to user and operational needs (Mallam et al, 2021).…”