Epipolar constraint of single-camera mirror binocular stereo vision systems

Abstract

Abstract. Virtual binocular sensors, composed of a camera and catoptric mirrors, have become popular among machine vision researchers, owing to their high flexibility and compactness. Usually, the tested target is projected onto a camera at different reflection times, and feature matching is performed using one image. To establish the geometric principles of the feature-matching process of a mirror binocular stereo vision system, we proposed a single-camera model with the epipolar constraint for matching the mirrored features. The constraint between the image coordinates of the real target and its mirror reflection is determined, which can be used to eliminate nonmatching points in the feature-matching process of a mirror binocular system. To validate the epipolar constraint model and to evaluate its performance in practical applications, we performed realistic matching experiments and analysis using a mirror binocular stereo vision system. Our results demonstrate the feasibility of the proposed model, suggesting a method for considerable improvement of efficacy of the process for matching mirrored features.

Smart Yoga Instructor for Guiding and Correcting Yoga Postures in Real Time

“…As a result, pose estimation can be significantly improved by deep learning approaches. [ 9 10 ] Epipolar Pose, Open Pose, Posenet, and Mediapipe are a few of the popular pose estimation techniques. From a 2D snapshot of a human stance, the Epipolar Pose creates a 3D structure.…”

Effect of Catadioptric Component Postposition on Lens Focal Length and Imaging Surface in a Mirror Binocular System

“…Yu L and Pan B et al [12] designed a stereo camera system with a single camera combined with a four-plane mirror to capture a pair of object images with fast speed and high robustness. Zhou F et al [13] designed a mirror binocular system consisting of a single camera and a quadrangular pyramid-shaped plane mirror group to establish a single camera multi-mirror polar constraint model. DooHyun Lee and InSo Kweon et al [14] proposed a new stereo camera system using double prisms, in which a triangular prism is placed in front of the lens to construct a simple stereo system.…”