A Masking Model for Motion Sharpening Phenomenon in Video Sequences

Fujibayashi, Akira; Boon, Choong Seng

doi:10.1093/ietfec/e91-a.6.1408

Cited by 6 publications

(4 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We have constructed a quantitative model based on this Quasi-MS for deriving the level of blurriness of selected frames without sacrificing the subjective quality of the whole sequence. This model has been confirmed to be applicable to natural video with a large motion [8] [9].…”

Section: Introductionmentioning

confidence: 94%

See 1 more Smart Citation

Application of motion sharpening effect in video coding

Fujibayashi¹,

Boon²

2008

2008 15th IEEE International Conference on Image Processing

View full text Add to dashboard Cite

This paper presents a method that exploits an optical illusion due to the motion of video sequences for improving the coding efficiency of sequences with large motion. The employed optical illusion is a special case of the motion sharpening, which we call "quasi-motion sharpening". Under this effect, comparable subjective quality is perceived when comparing an original video against the processed same video where some images between two frames are being blurred. A quantitative model based on this phenomenon has been constructed for deriving the level of blurriness of selected frames without sacrificing the subjective quality of the whole sequence.Subjective experiments on decoded video of H.264 show that, using our model for pre-processing video sequences with fast motion, we can improved the coding efficiency by 9.3~14.0% while maintaining the subjective quality.

show abstract

Section: Introductionmentioning

confidence: 94%

“…Assessment of equation (1) reveals that the model is highly correlated with experimental data with R-square value >0.93. The details for constructing the model can be found in [9].…”

Section: Quasi-motion Sharpening -The Modelmentioning

confidence: 99%

Application of motion sharpening effect in video coding

Fujibayashi¹,

Boon²

2008

2008 15th IEEE International Conference on Image Processing

View full text Add to dashboard Cite

show abstract

“…Hence, temporal redundancy and perceptual limitations are a crucial component for such encoding algorithms. For example, it is possible to exploit the reduced accuracy of the human visual system to pre‐filter in‐between frames to reduce the required bandwidth [FB08].…”

Section: Applicationsmentioning

confidence: 99%

Temporal Coherence Methods in Real‐Time Rendering

Scherzer¹,

Yang²,

Mattausch³

et al. 2012

Computer Graphics Forum

View full text Add to dashboard Cite

Nowadays, there is a strong trend towards rendering to higher‐resolution displays and at high frame rates. This development aims at delivering more detail and better accuracy, but it also comes at a significant cost. Although graphics cards continue to evolve with an ever‐increasing amount of computational power, the speed gain is easily counteracted by increasingly complex and sophisticated shading computations. For real‐time applications, the direct consequence is that image resolution and temporal resolution are often the first candidates to bow to the performance constraints (e.g. although full HD is possible, PS3 and XBox often render at lower resolutions). In order to achieve high‐quality rendering at a lower cost, one can exploit temporal coherence (TC). The underlying observation is that a higher resolution and frame rate do not necessarily imply a much higher workload, but a larger amount of redundancy and a higher potential for amortizing rendering over several frames. In this survey, we investigate methods that make use of this principle and provide practical and theoretical advice on how to exploit TC for performance optimization. These methods not only allow incorporating more computationally intensive shading effects into many existing applications, but also offer exciting opportunities for extending high‐end graphics applications to lower‐spec consumer‐level hardware. To this end, we first introduce the notion and main concepts of TC, including an overview of historical methods. We then describe a general approach, image‐space reprojection, with several implementation algorithms that facilitate reusing shading information across adjacent frames. We also discuss data‐reuse quality and performance related to reprojection techniques. Finally, in the second half of this survey, we demonstrate various applications that exploit TC in real‐time rendering.

show abstract

“…The viewers could not see any difference in the video sharpness even if two thirds of the images had been blurred, but they complained about flickering for low refresh rates. This idea has successfully been exploited in video compression and transmission applications [FB08], where selected frames have been filtered off‐line to reduce the required bandwidth. In this work, we exploit these effect to propose an efficient image warping technique that enables flicker‐free high‐refresh‐rate rendering.…”

Section: Temporal Perception Of Blur and Sharpnessmentioning

confidence: 99%

Perceptually‐motivated Real‐time Temporal Upsampling of 3D Content for High‐refresh‐rate Displays

Didyk

Eisemann

Ritschel

et al. 2010

Computer Graphics Forum

View full text Add to dashboard Cite

High-refresh-rate displays (e. g., 120 Hz) have recently become available on the consumer market and quickly gain on popularity. One of their aims is to reduce the perceived blur created by moving objects that are tracked by the human eye. However, an improvement is only achieved if the video stream is produced at the same high refresh rate (i. e. 120 Hz). Some devices, such as LCD TVs, solve this problem by converting low-refresh-rate content (i. e. 50 Hz PAL) into a higher temporal resolution (i. e. 200 Hz) based on two-dimensional optical flow. In our approach, we will show how rendered three-dimensional images produced by recent graphics hardware can be up-sampled more efficiently resulting in higher quality at the same time. Our algorithm relies on several perceptual findings and preserves the naturalness of the original sequence. A psychophysical study validates our approach and illustrates that temporally up-sampled video streams are preferred over the standard low-rate input by the majority of users. We show that our solution improves task performance on high-refresh-rate displays.

show abstract

A Masking Model for Motion Sharpening Phenomenon in Video Sequences

Cited by 6 publications

References 10 publications

Application of motion sharpening effect in video coding

Application of motion sharpening effect in video coding

Temporal Coherence Methods in Real‐Time Rendering

Perceptually‐motivated Real‐time Temporal Upsampling of 3D Content for High‐refresh‐rate Displays

Contact Info

Product

Resources

About