An adaptive seam line panoramic video stitching algorithm

Wu, Yihan; Liu, Lidong; Niu, Tong; Zou, Yuying; Yang, Zehua

doi:10.1109/iccc55456.2022.9880662

Cited by 2 publications

(1 citation statement)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is well known that photogrammetry orthorectification technology (Wang, 1990; Zhou & Liu, 2022) is commonly used to convert aerial images under central projection with local non‐linear geometric distortion into undistorted orthophotos under parallel projection with unified spatial coordinates. On this basis, overlapped aerial images can be smoothly blended into a big mosaic using seam‐line technique (Chon et al, 2010; Wu et al, 2022). However, there are some major challenges when directly using orthorectification technology to mosaic fisheye videos of DFVSS.…”

Section: Introductionmentioning

confidence: 99%

Real‐time mosaic of multiple fisheye surveillance videos based on geo‐registration and rectification

Gao

2023

The Photogrammetric Record

View full text Add to dashboard Cite

A distributed fisheye video surveillance system (DFVSS) can monitor a wide area without blind spots, but it is often affected by the viewpoint discontinuity and space inconsistency of multiple videos in the area. This paper proposes a novel real‐time fisheye video mosaic algorithm for wide‐area surveillance. First, by extending the line photogrammetry theory under central projection to spherical projection, a fisheye video geo‐registration model is established and estimated using orthogonal parallel lines on the ground, so that all videos of DFVSS are in the unified reference system to eliminate the space inconsistency between them. Second, by combining the photogrammetry orthorectification technique with thin‐plate spline transformation, a fisheye video rectification model is established to eliminate serious distortion in geo‐registered fisheye videos and align them accurately. Third, the viewport‐dependent video selection strategy and video look‐up table computation technique are adopted to create a high‐resolution panorama from input fisheye videos in real time. A parking lot of about 0.4 km2 monitored by eight fisheye cameras was selected as the test area. The experimental result shows the line re‐projection error in fisheye videos is about 0.5 pixels, and the overall efficiency, including panorama creation and mapping to the ground as texture, is not <30 fps. It indicates that the proposed algorithm can achieve a good balance between the limitation of video transmission bandwidth and the smooth observation requirement of computer equipment for the panorama, which is of great value for the construction and application of DFVSS.

show abstract

Section: Introductionmentioning

confidence: 99%