Self-Calibration-Based Approach to Critical Motion Sequences of Rolling-Shutter Structure from Motion

Ito, Eisuke; Okatani, Takayuki

doi:10.1109/cvpr.2017.480

Cited by 23 publications

(16 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the case of rolling shutter cameras, the pointer bends in the images because of different exposure synchronization within an image frame (see Figure 16). The use of such cameras would require a rolling shutter correction (e.g., Grundmann et al, 2012;Ito and Okatani, 2016). However, even with such a correction, it is expected that the accuracy is not equal to global shutter cameras.…”

Section: Discussionmentioning

confidence: 99%

Wired and Wireless Camera Triggering With Arduino

Kauhanen

Rönnholm

2017

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

ABSTRACT:Synchronous triggering is an important task that allows simultaneous data capture from multiple cameras. Accurate synchronization enables 3D measurements of moving objects or from a moving platform. In this paper, we describe one wired and four wireless variations of Arduino-based low-cost remote trigger systems designed to provide a synchronous trigger signal for industrial cameras. Our wireless systems utilize 315MHz or 434MHz frequencies with noise filtering capacitors. In order to validate the synchronization accuracy, we developed a prototype of a rotating trigger detection system (named RoTriDeS). This system is suitable to detect the triggering accuracy of global shutter cameras. As a result, the wired system indicated an 8.91 μs mean triggering time difference between two cameras. Corresponding mean values for the four wireless triggering systems varied between 7.92 and 9.42 μs. Presented values include both camera-based and trigger-based desynchronization. Arduino-based triggering systems appeared to be feasible, and they have the potential to be extended to more complicated triggering systems.

show abstract

Section: Discussionmentioning

confidence: 99%

Wired and Wireless Camera Triggering With Arduino

Kauhanen

Rönnholm

2017

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

show abstract

“…( 6) can be ignored. This simplification method is also used in [2], [17], [32], [33]. This approximation can be justified in that we force the translational speed vectors d 1 and d 2 to be constant in the world coordinate system, which is physically coherent with the constant velocity kinematic model.…”

Section: Simplified Rs Homography Matrixmentioning

confidence: 99%

Rolling Shutter Homography and its Applications

Lao

Ait-Aider²

2021

IEEE Trans. Pattern Anal. Mach. Intell.

View full text Add to dashboard Cite

In this article we study the adaptation of the concept of homography to Rolling Shutter (RS) images. This extension has never been clearly adressed despite the many roles played by the homography matrix in multi-view geometry. We first show that a direct point-to-point relationship on a RS pair can be expressed as a set of 3 to 8 atomic 3x3 matrices depending on the kinematic model used for the instantaneous-motion during image acquisition. We call this group of matrices the RS Homography. We then propose linear solvers for the computation of these matrices using point correspondences. Finally, we derive linear and closed form solutions for two famous problems in computer vision in the case of RS images: image stitching and plane-based relative pose computation. Extensive experiments with both synthetic and real data from public benchmarks show that the proposed methods outperform state-of-art techniques.

show abstract

“…Therefore, the images captured by moving RS cameras are subject to distortions such as wobble and skew, which defeat the classical GS geometric model that is usually assumed in 3D computer vision. In the past decade, many methods have been designed to fit RS camera problems, such as absolute pose (AP) (Ait-Aider et al 2006, 2007Ait-Aider and Berry 2009;Saurer et al 2015), 3D reconstruction from stereo rigs (Ait-Aider and Berry 2009;Saurer et al 2016Saurer et al , 2013, bundle adjustment for Structure-from-Motion (SfM) (Hedborg et al 2011(Hedborg et al , 2012, relative pose estimation (Dai et al 2016), dense matching (Kim et al 2016;Saurer et al 2016) and degeneracy understanding (Albl et al 2016b;Ito and Okatani 2017). In this paper, we bring a new approach to AP and SfM, two classical and fundamental problems in 3D vision, for the case of RS images.…”

Section: Contextmentioning

confidence: 99%

“…The RSSfM problem has been studied recently (Hedborg et al 2012;Albl et al 2016b;Ito and Okatani 2017;Zhuang et al 2017;Im et al 2018). RSSfM takes multiview point correspondences and aims at reconstructing their 3D structure, camera poses and motion.…”

Section: Contextmentioning

confidence: 99%

See 1 more Smart Citation

Solving Rolling Shutter 3D Vision Problems using Analogies with Non-rigidity

2020

View full text Add to dashboard Cite

We propose an original approach to absolute pose (AP) and Structure-from-Motion (SfM) which handles Rolling Shutter (RS) effects. Unlike most existing methods which either augment global shutter (GS) projection with velocity parameters or impose continuous time and motion through pose interpolation, we use local differential constraints. These are established by drawing analogies with non-rigid 3D vision techniques, namely Shape-from-Template (SfT) and Non-Rigid SfM (NRSfM).The proposed idea is to interpret the images of a rigid surface acquired by a moving RS camera as those of a virtually deformed surface taken by a GS camera. These virtually deformed surfaces are first recovered by relaxing the RS constraint using SfT or NRSfM. Then we upgrade the virtually deformed surface to the actual rigid structure and compute the camera pose and ego-motion by reintroducing the RS constraint. This uses a new 3D-3D registration procedure that minimizes a cost function based on the Euclidean 3D point distance. This is more stable and physically meaningful than the reprojection error or the algebraic distance used in previous work. Experimental results obtained with synthetic and real data show that the proposed methods outper-

show abstract

Self-Calibration-Based Approach to Critical Motion Sequences of Rolling-Shutter Structure from Motion

Cited by 23 publications

References 28 publications

Wired and Wireless Camera Triggering With Arduino

Wired and Wireless Camera Triggering With Arduino

Rolling Shutter Homography and its Applications

Solving Rolling Shutter 3D Vision Problems using Analogies with Non-rigidity

Contact Info

Product

Resources

About