Distant augmented reality: Bringing a new dimension to user experience using drones

Ünal, Metehan; Bostancı, Erkan; Sertalp, Evren

doi:10.1016/j.daach.2020.e00140

Cited by 22 publications

(10 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…According to the UAV position and rotation, the virtual model is represented over the drone’s camera. In a later paper, Unal et al [ 39 ] coined the concept of distant AR with a work that intends to improve the presentation of cultural heritage through AR using drones. In the previously presented geolocation system, the authors included the imagery of a monocular camera to perform vision-based scene tracking, using a DJI Phantom 3 Professional drone.…”

Section: Research Backgroundmentioning

confidence: 99%

Web AR Solution for UAV Pilot Training and Usability Testing

Ribeiro

Ramos

Safadinho

et al. 2021

Sensors

View full text Add to dashboard Cite

Data and services are available anywhere at any time thanks to the Internet and mobile devices. Nowadays, there are new ways of representing data through trendy technologies such as augmented reality (AR), which extends our perception of reality through the addition of a virtual layer on top of real-time images. The great potential of unmanned aerial vehicles (UAVs) for carrying out routine and professional tasks has encouraged their use in the creation of several services, such as package delivery or industrial maintenance. Unfortunately, drone piloting is difficult to learn and requires specific training. Since regular training is performed with virtual simulations, we decided to propose a multiplatform cloud-hosted solution based in Web AR for drone training and usability testing. This solution defines a configurable trajectory through virtual elements represented over barcode markers placed on a real environment. The main goal is to provide an inclusive and accessible training solution which could be used by anyone who wants to learn how to pilot or test research related to UAV control. For this paper, we reviewed drones, AR, and human–drone interaction (HDI) to propose an architecture and implement a prototype, which was built using a Raspberry Pi 3, a camera, and barcode markers. The validation was conducted using several test scenarios. The results show that a real-time AR experience for drone pilot training and usability testing is achievable through web technologies. Some of the advantages of this approach, compared to traditional methods, are its high availability by using the web and other ubiquitous devices; the minimization of technophobia related to crashes; and the development of cost-effective alternatives to train pilots and make the testing phase easier for drone researchers and developers through trendy technologies.

show abstract

Section: Research Backgroundmentioning

confidence: 99%

Web AR Solution for UAV Pilot Training and Usability Testing

Ribeiro

Ramos

Safadinho

et al. 2021

Sensors

View full text Add to dashboard Cite

show abstract

“…The usability of RAR has been explored widely for remote assistance applications in the manufacturing industry for connecting end-users to remote experts for product maintenance [38] [42] [41] [54], and in the healthcare industry for remote surgical guidance, and teleportation [58] [39] [48]. Similarly, Unal et al, [57] demonstrated the use of RAR for delivering a lively experience of cultural heritage to tourists. In contrast, we utilize RAR to share and communicate scene information to team members.…”

Section: Augmented Reality For Collaborationmentioning

confidence: 99%

RescueAR: Augmented Reality Supported Collaboration for UAV Driven Emergency Response Systems

Agrawal¹,

Cleland‐Huang²

2021

Preprint

View full text Add to dashboard Cite

Fig. 1. RescueAR utilizes location-based augmented reality technology to facilitate the exchange of information among rescue team members during a UAV-driven emergency response. (a) Flying-AR : Allows remote monitoring teams to mark the injured person in the aerial video stream from a UAV. (b) FirstResponse-AR : Allows on-scene first response team members to visualize the location of the identified injured victim in (a) using AR glasses or mobile devices. (c) Mission-Control : Allows mission planning team to visualize the spatial summary of the mission including the location of UAVs, their aerial video stream, and points of interest identified via (a) Emergency response events are fast-paced, noisy, and they require teamwork to accomplish the mission. Furthermore, the increasing deployment of Unmanned Aerial Vehicles (UAVs) alongside emergency responders, demands a new form of partnership between humans and UAVs. Traditional radio-based information exchange between humans during an emergency response suffers from a lack of visualization and often results in miscommunication. This paper presents a novel collaboration platform: RescueAR, which utilizes the paradigm of Location-based Augmented Reality to geotag, share, and visualize information. RescueAR aims to support the two-way communication between humans and UAVs, facilitate collaboration across diverse responders, and visualize scene information relevant to the rescue team's role. According to our feasibility study, user study, followed by a focus group session with police officers, RescueAR can support rescue teams in developing the spatial cognition of the scene, facilitate the exchange of geolocation information, and complement existing communication tools during the UAV-supported emergency response. CCS Concepts: • Human-centered computing → Collaborative and social computing.

show abstract

“…The development and implementation of digital tools in energy companies and staff training are investigated in [3,7,8,9,10,11,12,13,14,15,16,17,18,19]. Peculiarities of the functioning of potentially dangerous objects are described in [2,20,21,22,23,24,25,26,27].…”

Section: Introductionmentioning

confidence: 99%

Immersive technology for training and professional development of nuclear power plants personnel

Popov¹,

Іatsyshyn²,

Ковач³

et al. 2021

View full text Add to dashboard Cite

Training and professional development of nuclear power plant personnel are essential components of the atomic energy industry’s successful performance. The rapid growth of virtual reality (VR) and augmented reality (AR) technologies allowed to expand their scope and caused the need for various studies and experiments in terms of their application and effectiveness. Therefore, this publication studies the peculiarities of the application of VR and AR technologies for the training and professional development of personnel of nuclear power plants. The research and experiments on various aspects of VR and AR applications for specialists’ training in multiple fields have recently started. The analysis of international experience regarding the technologies application has shown that powerful companies and large companies have long used VR and AR in the industries they function. The paper analyzes the examples and trends of the application of VR technologies for nuclear power plants. It is determined that VR and AR’s economic efficiency for atomic power plants is achieved by eliminating design errors before starting the construction phase; reducing the cost and time expenditures for staff travel and staff training; increasing industrial safety, and increasing management efficiency. VR and AR technologies for nuclear power plants are successfully used in the following areas: modeling various atomic energy processes; construction of nuclear power plants; staff training and development; operation, repair, and maintenance of nuclear power plant equipment; presentation of activities and equipment. Peculiarities of application of VR and AR technologies for training of future specialists and advanced training of nuclear power plant personnel are analyzed. Staff training and professional development using VR and AR technologies take place in close to real-world conditions that are safe for participants and equipment. Applying VR and AR at nuclear power plants can increase efficiency: to work out the order of actions in the emergency mode; to optimize the temporary cost of urgent repairs; to test of dismantling/installation of elements of the equipment; to identify weaknesses in the work of individual pieces of equipment and the working complex as a whole. The trends in the application of VR and AR technologies for the popularization of professions in nuclear energy among children and youth are outlined. Due to VR and AR technologies, the issues of “nuclear energy safety” have gained new importance both for the personnel of nuclear power plants and for the training of future specialists in the energy sector. Using VR and AR to acquaint children and young people with atomic energy in a playful way, it becomes possible to inform about the peculiarities of the nuclear industry’s functioning and increase industry professions’ prestige.

show abstract

Distant augmented reality: Bringing a new dimension to user experience using drones

Cited by 22 publications

References 17 publications

Web AR Solution for UAV Pilot Training and Usability Testing

Web AR Solution for UAV Pilot Training and Usability Testing

RescueAR: Augmented Reality Supported Collaboration for UAV Driven Emergency Response Systems

Immersive technology for training and professional development of nuclear power plants personnel

Contact Info

Product

Resources

About