Comparing apples and oranges: assessment of the relative video quality in the presence of different types of distortions

Reiter, Ulrich; Korhonen, Jari; You, Junyong

doi:10.1186/1687-5281-2011-8

Cited by 8 publications

(6 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“… Recency in instantaneous judgments [14]- [18]  Forgiveness effect [19]- [20]  Transmission errors [21]- [24]  Visual attention [25] II. EXPERIMENT DESIGN This experiment used VGA resolution video (640x480) at 30fps.…”

mentioning

confidence: 99%

The Influence of Subjects and Environment on Audiovisual Subjective Tests: An International Study

Pinson¹,

Janowski

Pépion

et al. 2012

IEEE J. Sel. Top. Signal Process.

View full text Add to dashboard Cite

International audienceTraditionally, audio quality and video quality are evaluated separately in subjective tests. Best practices within the quality assessment community were developed before many modern mobile audiovisual devices and services came into use, such as internet video, smart phones, tablets and connected televisions. These devices and services raise unique questions that require jointly evaluating both the audio and the video within a subjective test. However, audiovisual subjective testing is a relatively under-explored field. In this paper, we address the question of determining the most suitable way to conduct audiovisual subjective testing on a wide range of audiovisual quality. Six laboratories from four countries conducted a systematic study of audiovisual subjective testing. The stimuli and scale were held constant across experiments and labs; only the environment of the subjective test was varied. Some subjective tests were conducted in controlled environments and some in public environments (a cafeteria, patio or hallway). The audiovisual stimuli spanned a wide range of quality. Results show that these audiovisual subjective tests were highly repeatable from one laboratory and environment to the next. The number of subjects was the most important factor. Based on this experiment, 24 or more subjects are recommended for Absolute Category Rating (ACR) tests. In public environments, 35 subjects were required to obtain the same Student.s t-test sensitivity. The second most important variable was individual differences between subjects. Other environmental factors had minimal impact, such as language, country, lighting, background noise, wall color, and monitor calibration. Analyses indicate that Mean Opinion Scores (MOS) are relative rather than absolute. Our analyses show that the results of experiments done in pristine, laboratory environments are highly representative of those devices in actual use, in a typical user environment

show abstract

mentioning

confidence: 99%

The Influence of Subjects and Environment on Audiovisual Subjective Tests: An International Study

Pinson¹,

Janowski

Pépion

et al. 2012

IEEE J. Sel. Top. Signal Process.

View full text Add to dashboard Cite

show abstract

“…All the well-known objective Full-Reference (FR) video quality metrics, such as Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Metric (SSIM) [32], Video Quality Metric (VQM) [33] and MOVIE [34] have been extensively tested with video sequences including also packet loss artifacts [30], [35]- [38]. There is evidence that many objective FR metrics are not capable to predict the perceptual impact of compression and channel artifacts equally well [35]- [37]; however, the best metrics usually achieve acceptable results in scenarios where different artifacts are present [35], [38].…”

Section: Objective Assessment Of Packet Loss Artifactsmentioning

confidence: 99%

Study of the Subjective Visibility of Packet Loss Artifacts in Decoded Video Sequences

Korhonen

2018

IEEE Trans. on Broadcast.

Self Cite

View full text Add to dashboard Cite

Packet loss is a significant cause of visual impairments in video broadcasting over packet-switched networks. There are several subjective and objective video quality assessment methods focused on the overall perception of video quality. However, less attention has been paid on the visibility of packet loss artifacts appearing in spatially and temporally limited regions of a video sequence. In this paper, we present the results of a subjective study, using a methodology where a video sequence is displayed on a touchscreen and the users tap it in the positions where they observe artifacts. We also analyze the objective features derived from those artifacts, and propose different models for combining those features into an objective metric for assessing the noticeability of the artifacts. The practical results show that the proposed metric predicts visibility of packet loss impairments with a reasonable accuracy. The proposed method can be applied for developing packetization and error recovery schemes to minimize the subjectively experienced distortion in error-prone networked video systems.

show abstract

“…And two kinds of typical applications of SIEA are also illustrated. They are instructive to the future design of intelligent imaging terminal [28].…”

Section: Introductionmentioning

confidence: 99%

Subjective Imaging Effect Assessment for Intelligent Imaging Terminal Design: a Method for Engineering Site

2020

KSII TIIS

View full text Add to dashboard Cite

A kind of Subjective Imaging Effect Assessment (SIEA) method and its applications on intelligent imaging terminal design in engineering site are presented. First, some visual assessment indices are used to characterize the imaging effect: the image brightness, the image brightness uniformity, the color image contrast, the image edge blur, the image color difference, the image saturation, the image noise, and the integrated imaging effect index. A linear weighted function is employed to carry out the SIEA computation and the Analytic Hierarchy Process (AHP) technique is used to estimate its weights. Second, a SIEA software is developed. It can play images after the settings of assessment index or assessment reaction time, etc. Third, two cases are used to illustrate the application effects of proposed method: the image enhancement system design for surveillance camera and the imaging environment perception system design for intelligent lighting terminal. A Prior Sequential Stimulus (PSS) experiment is proposed to improve the evaluation stability of SIEA method. Many experiment results have shown the proposed method can realize a stable system design or parameters setting for the intelligent imaging terminal in engineering site.

show abstract

Comparing apples and oranges: assessment of the relative video quality in the presence of different types of distortions

Cited by 8 publications

References 21 publications

The Influence of Subjects and Environment on Audiovisual Subjective Tests: An International Study

The Influence of Subjects and Environment on Audiovisual Subjective Tests: An International Study

Study of the Subjective Visibility of Packet Loss Artifacts in Decoded Video Sequences

Subjective Imaging Effect Assessment for Intelligent Imaging Terminal Design: a Method for Engineering Site

Contact Info

Product

Resources

About