Real-time stereo object tracking system by using block matching algorithm and optical binary phase extraction joint transform correlator

Journal of Information Display

2004

In this paper, a new stereo 3D moving-target tracking system using the MSE (mean square error) and BPEJTC (binary phase extraction joint transform correlator) algorithms is proposed. A moving target is extracted from the sequential input stereo image by applying a region-based MSE algorithm following which, the location coordinates of a moving target in each frame are obtained through correlation between the extracted target image and the input stereo image by using the BPEJTC algorithm. Through several experiments performed with 20 frames of the stereo image pair with 640 480 pixels, we confirmed that the proposed system is capable of tracking a moving target at a relatively low error ratio of 1.29 % on average at real time.

Section: Convergence Control By Pan/tilt System Embeddedon Stereo Cameramentioning

confidence: 99%

“…] is performed using the BPEJTC system after which the relative distance between the two objects can be calculated from the location where the correlation peak occurs, which is consequently used to control the pan/tilt system embedded-on the right camera for tracking a moving target [5].…”

Section: Convergence Control By Pan/tilt System Embeddedon Stereo Cameramentioning

confidence: 99%

Implementation of 3D moving target‐tracking system based on MSE and BPEJTC algorithms

Ko¹,

Lee

Journal of Information Display

2004

“…In this paper, the tracking object is perceived and extracted through the SAD algorithm, in which the region-based window mask is used [5]. …”

Section: Convergence Control By Using Pan/tilt Systemmentioning

confidence: 99%

“…Then, the relative distance between two objects can be calculated and this value is used to control the pan/tilt of the right camera. [5] )…”

Section: Extract Of the Target's Position At Right Imagesmentioning

confidence: 99%

<title>Convergence control of a moving object using hierarchical algorithms in a stereo vision system</title>

Lee

2002

SPIE Proceedings

Self Cite

In this paper, a new stereo tracking system using the hierarchical opto-digital algorithms is proposed and implemented. In the proposed method, a moving target object is initially extracted from the input image by removing the background noises by applying the region-based SAD algorithm to the sequential left image. And then, the location coordinates of the moving target for each of the sequential input frames are extracted through performing the optical BPEJTC between the reference image of the extracted target object and the stereo input image. These extracted coordinate values are finally used for controlling the convergence angle and the pan/tilt embedded to the conventional stereo target tracking system. From some experimental results with the 20 frames of the stereo input image pairs, the proposed system is found to be able to effectively extract the area where the target object is located from the stereo input image regardless of the background noises. With the location values of the tracking object obtained from the execution of the optical BPEJTC, the convergence angle and the pan/tilt of the stereo cameras are found to be successfully controlled. Therefore, in this paper, a feasibility test for implementing the stereo tele-working system or the stereo robot vision system using the proposed algorithm is suggested.

“…T. Joshi et al [3] also addressed the problem of estimating structure and motion of a smooth curved object from its silhouettes observed over time by a trinocular stereo rig under perspective projection in 1999. More recently, M. Han and T. Kanade [4] described a reconstruction method of multiple motion scenes from uncalibrated views and Lee et al [5,6] suggested an opto-digital stereo object tracking system using block matching algorithm and optical correlator.…”

Section: Introductionmentioning

confidence: 99%

Implementation of disparity information‐based 3D object tracking

Ko¹,

Jung

Journal of Information Display

2005

In this paper, a new 3D object tracking system using the disparity motion vector (DMV) is presented. In the proposed method, the time-sequential disparity maps are extracted from the sequence of the stereo input image pairs and these disparity maps are used to sequentially estimate the DMV defined as a disparity difference between two consecutive disparity maps Similarly to motion vectors in the conventional video signals, the DMV provides us with motion information of a moving target by showing a relatively large change in the disparity values in the target areas. Accordingly, this DMV helps detect the target area and its location coordinates. Based on these location data of a moving target, the pan/tilt embedded in the stereo camera system can be controlled and consequently achieve real-time stereo tracking of a moving target. From the results of experiments with 9 frames of the stereo image pairs having 256×256 pixels, it is shown that the proposed DMV-based stereo object tracking system can track the moving target with a relatively low error ratio of about 3.05 % on average.