Application of UAVs in the mining industry and towards an integrated UAV-AI-MR technology for mine rehabilitation surveillance

Abstract

This paper discusses integrating Unmanned Aerial Vehicle (UAV) data, Artificial Intelligence (AI), and Mixed Reality (MR) as a hybrid system for monitoring mine site rehabilitation. UAV systems are reviewed and the application of MR and AI to mining is discussed. The most common UAVs are low-cost multi-rotor systems however, their capabilities may be limited for long-term autonomous operation. The application scope is broad but identifies many trial UAV applications and sensors that could be integrated with MR and AI to produce an autonomous system. A simplified model for autonomous UAV, AI, and MR integrated systems is suggested along with some core modules. Via collaborative, modular development, the integration of UAV data, AI, and MR may be possible. Such a system will provide a powerful tool for mine site rehabilitation and compliance sign-off via a visual tool that allows all stakeholders to comprehend processes and data and agree when final rehabilitation is achieved.

Comparative analysis of surface deformation monitoring in a mining area based on UAV‐lidar and UAV photogrammetry

“…They address questions such as which approach yields better results and whether improving the accuracy of one technique is achievable through another technical domain. Most researchers have achieved superior results in the combination of measurement techniques (Liu et al, 2023;Markiewicz et al, 2022;Stothard & Shirani Faradonbeh, 2023).…”

“…They address questions such as which approach yields better results and whether improving the accuracy of one technique is achievable through another technical domain. Most researchers have achieved superior results in the combination of measurement techniques (Liu et al., 2023; Markiewicz et al., 2022; Stothard & Shirani Faradonbeh, 2023). Additionally, some have enhanced the accuracy of low‐precision lidar through the utilisation of photogrammetric techniques (Li et al., 2019; Rzonca & Twardowski, 2022; Yuan et al., 2022), or conversely, improved photogrammetric accuracy through different lidar applications (Terpstra et al., 2018, 2019).…”

Mine Closure Surveillance and Feasibility of UAV–AI–MR Technology: A Review Study

“…However, it is essential to make several considerations to ensure the successful and safe use of this technology. One important consideration is complying with national drone use regulations, as failure to do so can lead to legal and safety implications [24]. Furthermore, the sensors used in drones must be carefully selected and calibrated to ensure accurate data collection.…”

“…When compared to satellite imaging, McKenna, et al [5] assert that UAV imagery is deficient in historical archive images. Stothard and Shirani Faradonbeh [24] highlighted the potential benefits of integrating autonomous UAV survey data, AI capability, and MR technology to create a comprehensive and practical tool for monitoring mine site rehabilitation projects. The study suggests that ensuring positive mine site sustainability outcomes and maintaining stakeholder engagement over the long term of mining projects is crucial.…”

“…The data collected using UAVs can be leveraged to create mixed reality (MR) models. MR combines physical and digital worlds to create a seamless, natural, intuitive 3D human, computer, and environmental interaction [24]. This emerging reality is made possible by progress in computer vision, graphic processing, display technologies, input systems, and cloud computing [25].…”