Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning

Abstract

To maintain the reliability, availability, and sustainability of electricity supply, electricity companies regularly perform visual inspections on their transmission and distribution networks. These inspections have been typically carried out using foot patrol and/or helicopter-assisted methods to plan for necessary repair or replacement works before any major damage, which may cause power outage. This solution is quite slow, expensive, and potentially dangerous. In recent years, numerous researches have been conducted to automate the visual inspections by using automated helicopters, flying robots, and/or climbing robots. However, due to the high accuracy requirements of the task and its unique challenges, automatic vision-based inspection has not been widely adopted. In this paper, with the aim of providing a good starting point for researchers who are interested in developing a fully automatic autonomous vision-based power line inspection system, we conduct an extensive literature review. First, we examine existing power line inspection methods with special attention paid to highlight their advantages and disadvantages. Next, we summarize well-suited tasks and review potential data sources for automatic vision-based inspection. Then, we survey existing automatic vision-based power line inspection systems. Based on that, we propose a new automatic autonomous vision-based power line inspection concept that uses Unmanned Aerial Vehicle (UAV) inspection as the main inspection method, optical images as the primary data source, and deep learning as the backbone of data analysis and inspection. Then, we present an overview of possibilities and challenges of deep vision (deep learning for computer vision) approaches for both UAV navigation and UAV inspection and discuss possible solutions to the challenges. Finally, we conclude the paper with an outlook for the future of this field and propose potential next steps for implementing the concept.

Two-Layer Routing for High-Voltage Powerline Inspection by Cooperated Ground Vehicle and Drone

“…To ensure the accuracy of drone inspection, some algorithms are proposed. Primarily, as drone inspection is based on the images captured by the airborne camera, various classification and recognition algorithms are designed [26][27][28][29][30]. Martinez et al [26] combined classic computer vision and machine learning for autonomous aerial powerline inspection and localization.…”

Image Representation Method Based on Relative Layer Entropy for Insulator Recognition

“…Ensuring the reliability and stability of transmission lines and power substations is an important part of smart grid inspection [2]. Temperature is an important indicator of insulator conditions [3]. The infrared imaging technology can detect problems with the insulation equipment under high voltage, high current and high temperature conditions.…”

Method of operating a GIS‐based autopilot drone to inspect ultrahigh voltage power lines and its field tests

“…For this reason, it would be very difficult to monitor the power lines with the manual remote control of drones. Attempts to overcome this limitation have included some research on vision-based line inspection (Han et al, 2018;Martinez, Sampedro, Chauhan, Collumeau, & Campoy, 2018;Nguyen, Jenssen, & Roverso, 2018;Ribeiro, Duarte, Ramos, & Mora-Camino, 2018). However, most of these works have focused on image-based diagnosis using deep learning, and vision-based drone control methods are not sufficiently mature to be used directly in industrial sites.…”