Minimization of Parallax Artifacts in Video Stitching for Moving Foregrounds

Kakli, Muhammad Umer; Cho, Yongju; Seo, Jeongil

doi:10.1109/access.2018.2871685

Cited by 7 publications

(4 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The experimental setup uses a VR framework [40] with four main components that are based on traditional panorama stitching and rendering techniques [41][42][43][44][45][46][47][48][49]. The first component is the camera rig, the second component is the camera calibration module, the third component is the real-time stitching module and the fourth one consists of VR content consumption devices.…”

Section: Vr Frameworkmentioning

confidence: 99%

A study on presence quality and cybersickness in 2D, smartphone, and VR

2022

KSII TIIS

View full text Add to dashboard Cite

Recent improvements in technology have increased the consumption of virtual reality (VR) contents on immersive displays. The VR experience depends on the type of displays as well as the quality of VR contents. However, research on the impacts of VR content quality on VR experience and comparisons among different types of immersive display devices are lacking. In this study, VR contents created with our VR framework, are provided to participants on conventional two-dimensional (2D) immersive displays and VR headset. The geometric alignment of VR contents is improved with the addition of two calibration modes (i.e. preprocessing and straightening). The subjective feelings of presence and cybersickness experienced by participants while consuming VR contents created by our framework and commercial solutions are recorded in the form of questionnaires. The results of this study indicate that the improvements in VR quality lead to a better presence and less cybersickness in both conventional 2D displays and VR headset. Furthermore, the level of presence and cybersickness increases in VR headsets as compared to conventional 2D displays. Finally, the VR content quality improvements lead to a better VR experience for our VR framework as compared to commercial solutions.

show abstract

Section: Vr Frameworkmentioning

confidence: 99%

A study on presence quality and cybersickness in 2D, smartphone, and VR

2022

KSII TIIS

View full text Add to dashboard Cite

show abstract

“…At present, there are few studies on ghost elimination. Kakli et al [27] noted that the presence of moving objects in a stitched image would cause blurring or ghosts, and proposed the minimization of parallax artifacts in video stitching for moving foregrounds. Davis et al [28] proposed a stitching method for scenes with moving objects: first, the stitched image is divided into disjointed regions, and the pixels of each region are sampled from a single source image; then, the intensity difference images of the two images are calculated and the Dijkstra algorithm is used to find the seam.…”

Section: Ghost Eliminationmentioning

confidence: 99%

Ghost Elimination via Multi-Component Collaboration for Unmanned Aerial Vehicle Remote Sensing Image Stitching

2021

View full text Add to dashboard Cite

Ghosts are a common phenomenon widely present in unmanned aerial vehicle (UAV) remote sensing image stitching that seriously affect the naturalness of stitching results. In order to effectively remove ghosts and produce visually natural stitching results, we propose a novel image stitching method that can identify and eliminate ghosts through multi-component collaboration without object distortion, segmentation or repetition. Specifically, our main contributions are as follows: first, we propose a ghost identification component to locate a potential ghost in the stitching area; and detect significantly moving objects in the two stitched images. In particular, due to the characteristics of UAV shooting, the objects in UAV remote sensing images are small and the image quality is poor. We propose a mesh-based image difference comparison method to identify ghosts; and use an object tracking algorithm to accurately correspond to each ghost pair. Second, we design an image information source selection strategy to generate the ghost replacement region, which can replace the located ghost and avoid object distortion, segmentation and repetition. Third, we find that the process of ghost elimination can produce natural mosaic images by eliminating the ghost caused by initial blending with selected image information source. We validate the proposed method on VIVID data set and compare our method with Homo, ELA, SPW and APAP using the peak signal to noise ratio (PSNR) evaluation indicator.

show abstract

“…The semi-automatic stitching process was replaced by a fully automated algorithm [8], [9], [10] with the use of scale invariant features [8], [11]. Improvements in reliability of a fully automated stitching system paved way for very large-scale multi-camera, multidisplay panoramic stitching [12] and rendering systems [13], [14], [15], [16], [17], [18]. Further advancements in software and hardware resulted in production of portable devices such as smart phones and handheld cameras which can create very high-quality panoramic images in real-time [19].…”

Section: Related Workmentioning

confidence: 99%

A High-Quality VR Calibration and Real-Time Stitching Framework Using Preprocessed Features

et al. 2020

Self Cite

View full text Add to dashboard Cite

Virtual Reality (VR) contents comprise 360°×180° seamless panoramic videos, stitched from multiple overlapping video streams. A recent increase in demand of VR content has resulted in the supply of commercially available solutions which, though cheap, lack scalability and quality. In this paper, we propose an end-to-end VR system for stitching full spherical contents. The VR system is composed of camera rig calibration and stitching modules. The calibration module performs geometric alignment of camera rig. The stitching module transforms texture from camera or video stream into VR stream using lookup tables (LUTs) and blend masks (BMs). In this work, our main contribution is improvement of stitching quality. First, we propose a feature preprocessing method that filters out inconsistent, error-prone features. Secondly, we propose a geometric alignment method that outperforms state-of-the-art VR stitching solutions. We tested our system on diverse image sets and obtained state-of-the-art geometric alignment. Moreover, we achieved real-time stitching of camera and video streams up to 120 fps at 4K resolution. After stitching, we encode VR content for IP multicasting.

show abstract

Minimization of Parallax Artifacts in Video Stitching for Moving Foregrounds

Cited by 7 publications

References 39 publications

A study on presence quality and cybersickness in 2D, smartphone, and VR

A study on presence quality and cybersickness in 2D, smartphone, and VR

Ghost Elimination via Multi-Component Collaboration for Unmanned Aerial Vehicle Remote Sensing Image Stitching

A High-Quality VR Calibration and Real-Time Stitching Framework Using Preprocessed Features

Contact Info

Product

Resources

About