Stereo Vision-Based 3D Positioning and Tracking

Abstract

The evolution of technologies for the capture of human movement has been motivated by a number of potential applications across a wide variety of fields. However, capturing human motion in 3D is difficult in an outdoor environment when it is performed without controlled surroundings. In this paper, a stereo camera rig with an ultra-wide baseline distance and conventional cameras with fish-eye lenses is proposed. Its cameras provide a wide field of view (FOV) which increases the coverage area and also enables the baseline distance to be increased to cover the common area required for both cameras' views to perform as a stereo camera. We propose a passive marker-based approach to track the motion of the object. In this method, an adaptive thresholding method is applied to extract each small pink polyester marker from the video frames. As the cameras have fish-eye lenses, it is difficult to estimate the depth information using a pinhole camera model. We use a unique method to restore the 3D positions by developing a relationship between the pixel dimensions and distances in an image and real world coordinates. In this paper, occlusion detection is considered because, in the marker-based capturing of articulated human kinematics, the occlusion of a marker is one of the major challenges. The detection algorithm differentiates among types of occlusions and predicts any missing marker position where necessary. As this design is intended to be mounted on a moving carrier, such as a drone or car, a method for compensating the camera's ego-motion is proposed. The proposed 3D positioning and tracking system is tested in different situations to validate its applicability as a stereo camera rig as well as its performance for motion capture. The performance of the proposed system is compared with that of a standard motion capture system called Vicon and is shown to have the same order of accuracy while incurring less cost. INDEX TERMS Motion capture, 3D positioning, stereo vision, motion tracking, high precision.

Active noise control for centrifugal and axial fans

“…This depth information allows for the creation of a 3D representation of the scene. Stereo3D is critical to enabling autonomous capabilities in a wide range of fields including robotics [24,41], autonomous vehicles [27,4], and 3D modeling [34,45,29].…”

General Moving Object Localization from a Single Flying Camera

“…Detecting and localizing moving objects in a stereo vision system is also not a problem. Islam et al [24] proposed a stereo camera rig with an ultra-wide baseline distance and conventional cameras with fish-eye lenses. They used a unique method to restore the 3D positions by developing a relationship between the pixel dimensions and distances in an image and real-world coordinates.…”

Automatic Recognition for Fat Reduction Motion Image Landmark Using Computer Vision

“…Automatic recognition of image landmarks is an important image processing technology in the elds of photogrammetry, optical measurement, and digital image processing [1,2]. With the continuous development of video technology, the requirements for the recognition accuracy of image landmark are more strict in the process of image processing [3]. In order to improve the automatic recognition e ect of landmarks in image processing [4], many experts at home and abroad have proposed landmarks recognition methods.…”