Automated exterior inspection of an aircraft with a pan-tilt-zoom camera mounted on a mobile robot

Abstract

This paper deals with an automated preflight aircraft inspection using a pan-tilt-zoom camera mounted on a mobile robot moving autonomously around the aircraft. The general topic is image processing framework for detection and exterior inspection of different types of items, such as closed or unlatched door, mechanical defect on the engine, the integrity of the empennage, or damage caused by impacts or cracks. The detection step allows to focus on the regions of interest and point the camera toward the item to be checked. It is based on the detection of regular shapes, such as rounded corner rectangles, circles, and ellipses. The inspection task relies on clues, such as uniformity of isolated image regions, convexity of segmented shapes, and periodicity of the image intensity signal. The approach is applied to the inspection of four items of Airbus A320: oxygen bay handle, air-inlet vent, static ports, and fan blades. The results are promising and demonstrate the feasibility of an automated exterior inspection.

Toward virtual design and optimization of a structural test monitored by a multi-view system

“…As soon as the specimen shape is complex, or when symmetry is broken down by an instability (be it due to geometry or to the deformation mechanism itself), displacements have to be characterized in 3D. An exhaustive characterization requires that any surface element where displacements are to be measured should be observed by at least two cameras (or two viewpoints if the imaging system is moving [47]). Moreover, as grazing incidence gives a very poor determination, one may restrict the considered cameras observing a surface element only by those whose angle with the surface normal is less than a prescribed level.…”

Classification using a three-dimensional sensor in a structured industrial environment

“…6,7 AVI in industry is also a topic of our earlier publications, which propose various solutions for existing problems in the field. [8][9][10][11] There is another direction from which the problem of AVI can be tackled. Machine learning techniques are currently gaining an influx of attention in the computer vision community, providing more generalization for some of the tasks.…”

Moving Obstacles Detection and Camera Pointing for Mobile Robot Applications

“…Obstacle recognition and avoidance are also used in navigation mode [7]. The robot can inspect visually some items of the aircraft such as probes, static ports, trapdoors, latches and scan some fuselage parts [9,14]. It has a tasks checklist to follow.…”