Hand-Eye Calibration

Abstract

Whenever a sensor is mounted on a robot hand, it is important to know the relationship between the sensor and the hand. The problem of determining this relationship is referred to as the hand-eye calibration problem. Hand-eye calibration is impor tant in at least two types of tasks: (1) map sensor centered measurements into the robot workspace frame and (2) tasks allowing the robot to precisely move the sensor. In the past some solutions were proposed, particularly in the case of the sensor being a television camera. With almost no exception, all existing solutions attempt to solve a homogeneous matrix equation of the form AX = X B. This article has the following main contributions. First we show that there are two possible formulations of the hand-eye calibration problem. One formu lation is the classic one just mentioned. A second formulation takes the form of the following homogeneous matrix equation: MY = M'YB. The advantage of the latter formulation is that the extrinsic and intrinsic parameters of the camera need not be made explicit. Indeed, this formulation directly uses the 3 x4 perspective matrices (M andM' ) associated with two positions of the camera with respect to the calibration frame. Moreover, this formulation together with the classic one covers a wider range of camera-based sensors to be calibrated with respect to the robot hand: single scan-line cameras, stereo heads, range finders, etc. Second, we develop a common mathematical framework to solve for the hand-eye calibration problem using either of the two formulations. We represent rotation by a unit quaternion and present two methods: (1) a closed-form solution for solving for rotation using unit quaternions and then solving for translation and (2) a nonlinear technique for simultane ously solving for rotation and translation. Third, we perform a stability analysis both for our two methods and for the lin ear method developed by Tsai and Lenz (1989). This analysis allows the comparison of the three methods. In light of this comparison, the nonlinear optimization method, which solves for rotation and translation simultaneously, seems to be the most robust one with respect to noise and measurement errors.

Convergence Analysis of an Iterative Targeting Method for Keyhole Robotic Surgery

“…The robot and the tracking system reference frame were calibrated [14] and the X transformation estimated (X � ).…”

A Graph Based Bundle Adjustment for Ins-Camera Calibration

“…A direct solution can be computed by firstly optimizing the rotational part and solving the equations for the translation afterwards (Tsai and Lenz, 1989). In contrast, it was shown that the nonlinear optimization for rotation and translation at the same time leads to more robust results in case of noise and measurement errors (Horaud and Dornaika, 1995). The motion of the robot arm is typically obtained from encoders, whereas nearly all approaches determine the camera movement by observing a calibration pattern.…”

Planar Motion and Hand-eye Calibration using Inter-image Homographies from a Planar Scene

“…Tsai and Lenz showed that with known 3D feature points, known motion of the robot arm, and known transformations A and B, the unknown relative orientation X can be determined from the equation AX = XB (Tsai and Lenz, 1989). The problem was later reformulated using quaternions to parametrise rotations and 3 × 4 camera matrices instead of classical transformation matrices (Horaud and Dornaika, 1995).…”