A Universal Optical Flow Based Real-Time Low-Latency Omnidirectional Stereo Video System

Tang, Minhao; Wen, Jiangtao; Gu, Jia-Wen; Junker, Philip; Guo, Bichuan; Jhao, Guansyun; Zhu, Ziyu; Han, Yuxing

doi:10.1109/tmm.2018.2867266

Cited by 17 publications

(9 citation statements)

References 42 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The collected results of motion-to-photon latencies suggest that the current generation of wireless networks is not suitable for low latency applications over a greater distance [47]. Likewise, achieving low latency is problematic for complicated setups involving external cameras or additional video processing steps [136]. Furthermore, most of the 360 • video processing systems reviewed in this survey report also motion-to-photon latency which underlines the importance of latency to VR systems.…”

Section: Discussionmentioning

confidence: 99%

“…Table 4 shows that fast encoder implementations typically sacriice the rate-distortion performance. Notable exceptions are [61,136] which managed to improve it.…”

Section: Discussionmentioning

confidence: 99%

“…Tang et al [136] proposed an omnidirectional stereoscopic video (ODSV) system achieving 2.2 s motion-tophoton latency and 0.5 s encoding latency. The relatively high system latency is caused by the complicated nature of the ODSV optical low calculations.…”

Section: Implementations Reporting Latencymentioning

confidence: 99%

See 2 more Smart Citations

Image and Video Coding Techniques for Ultra-low Latency

et al. 2022

View full text Add to dashboard Cite

The next generation of wireless networks fosters the adoption of latency-critical applications such as XR, connected industry, or autonomous driving. This survey gathers implementation aspects of different image and video coding schemes and discusses their tradeoffs. Standardized video coding technologies such as HEVC or VVC provide a high compression ratio, but their enormous complexity sets the scene for alternative approaches like still image, mezzanine, or texture compression in scenarios with tight resource or latency constraints. Regardless of the coding scheme, we found inter-device memory transfers and the lack of sub-frame coding as limitations of current full-system and software-programmable implementations.

show abstract

Section: Discussionmentioning

confidence: 99%

“…Table 4 shows that fast encoder implementations typically sacriice the rate-distortion performance. Notable exceptions are [61,136] which managed to improve it.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Image and Video Coding Techniques for Ultra-low Latency

et al. 2022

View full text Add to dashboard Cite

show abstract

“…This interactive property enables users to feel like being in a virtual world. It gives rise to various new challenges at the same time, such as video/image production [1], [2], [3], transmission [4], [5], compression [6], [7], [8], and quality assessments [9], [10], [11]. Those new challenges are dissimilar to the cases in 2D traditional media since users can actively select the content they would like to watch with HMDs, while they are only allowed to passively receive the given content in 2D traditional video.…”

Section: Introductionmentioning

confidence: 99%

A Multi-FoV Viewport-Based Visual Saliency Model Using Adaptive Weighting Losses for 360$^\circ$ Images

Chao

Zhang

Hamidouche

et al. 2021

IEEE Trans. Multimedia

View full text Add to dashboard Cite

• media allows observers to explore the scene in all directions. The consequence is that the human visual attention is guided by not only the perceived area in the viewport but also the overall content in 360 •. In this paper, we propose a method to estimate the 360 • saliency map which extracts salient features from the entire 360 • image in each viewport in three different Field of Views (FoVs). Our model is first pretrained with a largescale 2D image dataset to enable the interpretation of semantic contents, then fine-tuned with a relative small 360 • image dataset. A novel weighting loss function attached with stretch weighted maps is introduced to adaptively weight the losses of three evaluation metrics and attenuate the impact of stretched regions in equirectangular projection during training process. Experimental results demonstrate that our model achieves better performance with the integration of three FoVs and its diverse viewport images. Results also show that the adaptive weighting losses and stretch weighted maps effectively enhance the evaluation scores compared to the fixed weighting losses solutions. Comparing to other state of the art models, our method surpasses them on three different datasets and ranks the top using 5 performance evaluation metrics on the Salient360! benchmark set.

show abstract

“…Its two-point statistics would also reflect structural information about the real RVE without any ambiguity processing. Panoramic image stitching technology (PIST), widely applied in many fields, [19][20][21][22][23] can combine a group of images with a certain overlap into a panoramic image with an enlarged field of view, and thus can provide a feasible solution of the idea above. As early as 1980, this method was used to construct large aerial and satellite photographs from collections of images.…”

mentioning

confidence: 99%

Symbolic Regression and Two‐Point Statistics Assisted Structure‐Property Linkage Based on Irregular‐Representative Volume Element

Chen

Zhao

et al. 2022

Advcd Theory and Sims

View full text Add to dashboard Cite

Quantifying the microstructure of materials is of significance in material development, especially for building the relationship between structure and property. To establish a remarkable structure‐property (SP) linkage, a novel concept referred to as irregular‐representative volume element (IRVE) based on panoramic image stitching technology (PIST) is proposed and a data‐driven scheme integrating irregular domain‐oriented two‐point statistics, principal component analysis (PCA), and symbolic regression based on genetic programming (GPSR) is constructed. Combining with advanced image processing and genetic programming technologies, this scheme improves the microstructure quantization framework. This scheme can not only be applied in different complex conditions for extracting the information of a material microstructure, but can also to embody details of microstructure from the perspective of large scale. IRVE is demonstrated to have both strong statistical representativeness and sufficient physical interpretation, which makes the scheme robust and reliable. Performing the scheme on an example of ferrite heat‐resistant steels, it shows a powerful ability in building an equational SP linkage with high precision (R = 0.91, RMSE = 13.17), the generalization ability of the linkage is also validated by an unseen steel (relative percentage error is 2.66%). The scheme has bright application prospects in predicting mechanical property and accelerating alloy design.

show abstract

A Universal Optical Flow Based Real-Time Low-Latency Omnidirectional Stereo Video System

Cited by 17 publications

References 42 publications

Image and Video Coding Techniques for Ultra-low Latency

Image and Video Coding Techniques for Ultra-low Latency

A Multi-FoV Viewport-Based Visual Saliency Model Using Adaptive Weighting Losses for 360$^\circ$ Images

Symbolic Regression and Two‐Point Statistics Assisted Structure‐Property Linkage Based on Irregular‐Representative Volume Element

Contact Info

Product

Resources

About