Utilization of Augmented and Mixed Reality in Training Mining Machines

Abstract

Augmented reality (AR) and mixed reality (MR) are used in many disciplines, especially education, science, health, safety and engineering. It is based on the visualization and interaction of virtual graphic designs in the natural environment with its own hardware and software. In this study, the effect of augmented and mixed reality applications in the training of open-pit mining machines is examined. In the application called AR Book, a booklet containing machine visuals and technical information was created. In the project developed in the Unity real-time development engine, the database created in the Vuforia AR engine and 3D machine models matched with them were used. An image-target-based augmented reality application was implemented in this booklet using Android devices. In another application, a ground-plane-based application was developed for the mixed reality device MS Hololens 2. With the Hand Interactions feature, machines positioned in the natural environment can be controlled with drag, rotate and scale operations, enlarged to gigantic sizes and examined. The evaluations of the training group regarding the use of AR and MR applications together with traditional education were sought. They were also asked to make comparisons between the mobile device and Hololens 2. There have been highly positive results in integrating imaging technologies into education.