AccAnn: A New Subjective Assessment Methodology for Measuring Acceptability and Annoyance of Quality of Experience

Li, Jing; Krasula, Lukáš; Baveye, Yoann; Li, Zhi; Callet, Patrick Le

doi:10.1109/tmm.2019.2903722

Cited by 18 publications

(4 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The fusion process employs a ν-Support Vector machine (ν-SVM) regressor [Cortes and Vapnik (1995)]. VMAF has been evaluated on various video quality databases, and shows improved correlation with subjective scores [Li et al (2016); Zhang et al (2018); Li et al (2019)]. In this work, VMAF has also been employed to determine optimum resolution for each test rate point and sequence, following the procedure described in Section 3.2.…”

Section: Resultsmentioning

confidence: 99%

BVI-CC: A Dataset for Research on Video Compression and Quality Assessment

Katsenou

Zhang

Afonso

et al. 2022

Front. Signal Process.

View full text Add to dashboard Cite

The video technology scenery has been very vivid over the past years, with novel video coding technologies introduced that promise improved compression performance over state-of-the-art technologies. Despite the fact that a lot of video datasets are available, representative content of the wide parameter space along with subjective evaluations of variations of encoded content from an unpartial end is required. In response to this requirement, this paper features a dataset, the BVI-CC. Three video codecs were deployed to create the variations of the encoded sequences: High Efficiency Video Coding Test Model (HM), AOMedia Video 1 (AV1), and Versatile Video Coding Test Model (VTM). Nine source video sequences were carefully selected to offer both diversity and representativeness in the spatio-temporal domain. Different spatial resolution versions of the sequences were created and encoded by all three codecs at pre-defined target bit rates. The compression efficiency of the codecs was evaluated with commonly used objective quality metrics, and the subjective quality of their reconstructed content was also evaluated through psychophysical experiments. Additionally, an adaptive bit rate (convex hull rate-distortion optimization across spatial resolutions) test case was assessed using both objective and subjective evaluations. Finally, the computational complexities of the tested codecs were examined. All data have been made publicly available as part of the dataset, which can be used for coding performance evaluation and video quality metric development.

show abstract

Section: Resultsmentioning

confidence: 99%

BVI-CC: A Dataset for Research on Video Compression and Quality Assessment

Katsenou

Zhang

Afonso

et al. 2022

Front. Signal Process.

View full text Add to dashboard Cite

show abstract

“…First, note that work has shown that the concept of "acceptability" contains different levels, and a quality level that is acceptable may not necessarily be enjoyable [30], [31]. This led to the study of the transition between what is acceptable quality and what is not.…”

Section: Towards Measuring Engagementmentioning

confidence: 99%

“…Previous studies [32]- [34] have shown that acceptability could be estimated on the basis of technical parameters such as bitrate, frame rate, and resolution with non-linear regression. This model was further extended [30], [35], and it was shown that acceptability could also be related to high-level quality estimation on the basis of NTIA VQM [23] or VMAF [9]. However, quality is not the only parameter that needs to be considered when considering acceptability.…”

Section: Towards Measuring Engagementmentioning

confidence: 99%

Quitting Ratio-Based Bitrate Ladder Selection Mechanism for Adaptive Bitrate Video Streaming

Lebreton

Yamagishi

2023

IEEE Trans. Multimedia

View full text Add to dashboard Cite

To improve users' experience and decrease their likelihood of quitting watching videos, this paper addresses the question of how to encode the videos used in adaptive bitrate (ABR) video streaming. When addressing ABR video streaming, a lot of effort has been put into developing ABR control schemes. However, ways to appropriately encode videos also need to be defined. Unlike previous approaches that focus on coding quality, this paper considers the user quitting ratio. The user quitting ratio is the percentage of users still watching videos at a given time and enables us to address the consequences of quality and stimulus duration on the decision of a user to quit. Considering the value of the user quitting ratio, this paper describes a method that uses content analysis, as well as a network's historical throughput data, to define how video should be encoded to decrease the likelihood of users quitting watching. Unlike previous approaches, the method is independent of the ABR control scheme used by the video player, and the selected ladders perform equivalently across different players with different behaviors. Results of experiments based on real-world network traces demonstrate the usefulness of the proposed method.

show abstract

“…Subjective quality assessment 1) Perception experiment A fully-controlled perception experiment was conducted to obtain a benchmark (i.e., ground truth) for the quality of underwater image enhancement. The experiment followed the guidelines described in [33], [34]. A single-stimulus method was used, in which human subjects were asked to score the overall quality for each stimulus in the absence of any reference.…”

Section: B Database Of Underwater Image Enhancementmentioning

confidence: 99%

Underwater Image Quality Assessment: Subjective and Objective Methods

Guo

Liu

et al. 2022

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Underwater image enhancement plays a critical role in marine industry. Various algorithms are applied to enhance underwater images, but their performance in terms of perceptual quality has been little studied. In this paper, we investigate five popular enhancement algorithms and their output image quality. To this end, we have created a benchmark, including images enhanced by different algorithms and ground truth image quality obtained by human perception experiments. We statistically analyse the impact of various enhancement algorithms on the perceived quality of underwater images. Also, the visual quality provided by these algorithms is evaluated objectively, aiming to inform the development of objective metrics for automatic assessment of the quality for underwater image enhancement. The image quality benchmark and its objective metric are made publicly available.

show abstract

AccAnn: A New Subjective Assessment Methodology for Measuring Acceptability and Annoyance of Quality of Experience

Cited by 18 publications

References 32 publications

BVI-CC: A Dataset for Research on Video Compression and Quality Assessment

BVI-CC: A Dataset for Research on Video Compression and Quality Assessment

Quitting Ratio-Based Bitrate Ladder Selection Mechanism for Adaptive Bitrate Video Streaming

Underwater Image Quality Assessment: Subjective and Objective Methods

Contact Info

Product

Resources

About