3D Face Tracking Using Stereo Cameras: A Review

Abstract

This review considers previous research, regarding the background and applications of 3D facetracking systems with a focus on stereo camera-based systems. Stereo cameras are less expensive than laser ranging systems, and they are widely available on devices such as smart phones. This review aims to spur further development and applications of face tracking in this domain. Many studies on face tracking have used concepts such as the Kanade-Lucas-Tomasi method, particle filters, tracking-learning-detecting, probability hypothesis density, mean shift/cam shift, and others. As imaging constraints are relaxed, facial tracking becomes more challenging. This review presents an exposition of the most common challenges in face tracking, such as occlusion and clutter, pose variations, changes in facial resolution, illumination variations, and facial deformation. Five forms of pose estimation are discussed: appearance template methods, detector arrays, flexible models, geometric methods, and tracking methods. Applications of the listed 3D face tracking systems are also discussed, including face modelling, film editing, access control, security, and surveillance.

Digital Tools for Co-working Space Batununggal Using Digital-Ads, AR-Based Socmed Content, and Enterprise Resource Planning

“…Actual-time projection of 3D and 2D virtual items into the real world is the essence of Augmented Reality (AR) (Alqahtani et al, 2020). Additional Reality or Augmented Reality (AR) is a technology that mixes virtual two-and three-dimensional items with real time projections onto a three-dimensional sphere (Akhunova, 2021).…”

Robust, Resilient Enhanced CAMSHIFT Model: Advancing Face Detection and Tracking Stability in Challenging Environments

“…The authors Alqahtani et al [16] reported a review paper entitled "3D face tracking using stereo cameras: A review". Applications of 3D face-tracking systems with a focus on stereo camera-based systems was postulated.…”

RGB-D Tracking and Optimal Perception of Deformable Objects

“…[11] tracks deformable objects with point clouds and the use of probabilistic methods, it also manages to simulate the object's behaviour in real time using a previous model of the object. Other 3D deformable object trackers accomplish efficiency specialising in specific target objects like faces [12], hands [13] or full bodies [14]. Non-rigid SLAM systems like [15] (RGB-D) and [16] (monocular) manage to solve camera location and nonrigid environment characterisation, nonetheless, they do not tackle the segmentation problem.…”