Automatic Online Calibration of Cameras and Lasers

Abstract

Abstract-The combined use of 3D scanning lasers with 2D cameras has become increasingly popular in mobile robotics, as the sparse depth measurements of the former augment the dense color information of the latter. Sensor fusion requires precise 6-DOF transforms between the sensors, but hand-measuring these values is tedious and inaccurate. In addition, autonomous robots can be rendered inoperable if their sensors' calibrations change over time. Yet previously published camera-laser calibration algorithms are offline only, requiring significant amounts of data and/or specific calibration targets; they are thus unable to correct calibration errors that occur during live operation.In this paper, we introduce two new real-time techniques that enable camera-laser calibration online, automatically, and in arbitrary environments. The first is a probabilistic monitoring algorithm that can detect a sudden miscalibration in a fraction of a second. The second is a continuous calibration optimizer that adjusts transform offsets in real time, tracking gradual sensor drift as it occurs.Although the calibration objective function is not globally convex and cannot be optimized in real time, in practice it is always locally convex around the global optimum, and almost everywhere else. Thus, the local shape of the objective function at the current parameters can be used to determine whether the sensors are calibrated, and allows the parameters to be adjusted gradually so as to maintain the global optimum.In several online experiments on thousands of frames in real markerless scenes, our method automatically detects miscalibrations within one second of the error exceeding .25 deg or 10cm, with an accuracy of 100%. In addition, rotational sensor drift can be tracked in real-time with a mean error of just .10 deg. Together, these techniques allow significantly greater flexibility and adaptability of robots in unknown and potentially harsh environments.

Accurate laser scanner to camera calibration with application to range sensor evaluation

“…This approach requires multiple views in order to obtain a smooth cost function that can be optimized robustly. Levinson and Thrun proposed a framework that monitors the accuracy of a calibrated camera-laser scanner setup while being in use [22]. If a miss-calibration is observed, the extrinsic parameters are corrected by finding the transformation which maximizes the overlap between edges in the image and in the point cloud.…”

Self calibration of multiple LIDARs and cameras on autonomous vehicles

“…Over the past several years, a number of proposed solutions for the calibration between a camera and a laser were introduced, including some automatic on-line calibration solutions as presented in [3]. In [4] a method to estimate the motion of a camera-laser fusion system was developed that projects the laser points onto the images.…”

Active Online Calibration of Multiple Sensors for Autonomous Surface Vessels

“…One approach is to manually use a checkerboard camera calibration target and detect it simultaneously with both camera and laser [9]. Other approaches calibrate from outdoor scenes and nd suitable features for calibration [18,12], but use a 3D laser.…”