Video quality of experience in the presence of accessibility and retainability failures

Li, Weiwei; Rehman, Hamood-Ur; Kaya, Diba; Chignell, Mark; Leon-Garcia, Alberto; Zucherman, Leon; Jiang, Jane

doi:10.1109/qshine.2014.6928651

Cited by 14 publications

(5 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Furthermore, several researchers have found that when using short video clips, the evaluation of the QoE does not often match the reallife quality perception, i.e., in real life, it is necessary to increase the duration of the test sequences [18,19]. Hence, the video content used in this research was a 1-h documentary film about the solar system.…”

Section: Properties Of Test Stimulimentioning

confidence: 99%

Impact of packet loss on the perceived quality of UDP-based multimedia streaming: a study of user quality of experience in real-life environments

Mrvelj

Matulin

2016

Multimedia Systems

View full text Add to dashboard Cite

Section: Properties Of Test Stimulimentioning

confidence: 99%

Impact of packet loss on the perceived quality of UDP-based multimedia streaming: a study of user quality of experience in real-life environments

Mrvelj

Matulin

2016

Multimedia Systems

View full text Add to dashboard Cite

“…In such shorter tests, it is easier to retain the subjects' focus on the task at hand. The experiment was performed using longer test sequences; thereby, we have acknowledged the findings presented in [15][16][17]; the authors in that study demonstrate how QoE evaluation requires an increase in the duration of the test sequences, because user perception cannot be entirely shaped when using shorter video clips. The original video used in the experiment was encoded with Advanced Video Coding (H.264/AVC) and Advanced Audio Coding (AAC).…”

Section: The Experiments Setup and Creation Of Test Sequencesmentioning

confidence: 93%

“…• the primary objective was to collect the rating data and use it to develop the QoE assessment model that would be able to produce more lifelike QoE assessments; thus, the data had to be collected from uncontrolled experiments (in a home environment); • longer test sequences had to be used in the test, because short video clips are not adequate for user QoE evaluation (as reported in [15][16][17]); • the test sequences had to be distributed to the subjects for rating in a manner that bypasses downloading or streaming of the video (due to its size); • the accuracy of the model depends on the fuzzification and defuzzification processes, i.e., obliquely on the size of the data set used for the model development; that is, a sufficient number of test sequences of different properties had to be generated and evaluated by a sufficient number of test subjects; • it was unfeasible to conduct the interviews with such a large number of test subjects (602); thus, the subjects' opinions were collected using hard copy questionnaires.…”

Section: Critical Overview Of the Methodologymentioning

confidence: 99%

“…The results were used to develop a nonlinear model that is able to describe user QoE relative to the audio/video distortions. Although the test is conducted in uncontrolled environments, the test sequence used in the study lasted only 51 s. Note that we have previously underlined that QoE evaluation requires using longer test sequences (based on the findings presented in [15][16][17]). …”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Modelling user quality of experience from objective and subjective data sets using fuzzy logic

Matulin

Mrvelj

2018

Multimedia Systems

View full text Add to dashboard Cite

One of the paramount research questions in the scientific community today is how to remotely assess user quality of experience (QoE) for a specific service. To this end, various user QoE assessment models have been developed; however, they are mostly based on the data gathered from controlled environment experimentation. The aim of this research was to model user QoE for the User Datagram Protocol-based video streaming service from the results of uncontrolled subjective tests. Specifically, using fuzzy logic, we have correlated the values of three objective network parameters (the packet loss rate and the number and duration of packet loss occurrences in one streaming session) with test subjects' subjective perception about perceived quality distortions. The dependencies between different values of the parameters and the subjects' perception of video quality were used to develop a no reference objective video quality assessment model for assessing user QoE. The key distinguishing feature of the developed model lays in the process of subjective evaluation, which was conducted with a panel of 602 test subjects who evaluated the quality of 1-h video in home environments. For this purpose, 72 different test sequences were prepared for rating. We showed that a strong positive linear relationship exists between the assessed QoE of the model and the Mean Opinion Scores of the subjects (a Pearson correlation coefficient equal to 0.8841).

show abstract

“…With the combination of subjective and objective analysis, many metrics have been proposed for QoE assessment of UDPbased video streaming, such as the Peak Signal-to-Noise-Ratio (PSNR) and Structural Similarity Index Measurement (SSIM) [4]. These assessment methods mainly rely on video artifacts such as such as slice error, blocking, ghosting and freeze frame.…”

Section: Related Workmentioning

confidence: 99%

An objective multi-layer QoE Evaluation for TCP video streaming

Liu

Yang

et al. 2015

2015 IFIP/IEEE International Symposium on Integrated Network Management (IM)

View full text Add to dashboard Cite

It's a challenge to effectively assess Quality of Experience (QoE) for TCP video streaming with network performance parameters, to resolve this problem, an objective hierarchical Evaluation for Transmission Control Protocol (TCP) video streaming is proposed under video playback scenarios. QoE assessment for TCP video streaming is resolved into two sub-steps. In the first place, in consideration of video playback performance parameters affecting QoE, the authors demonstrate three novel application-layer metrics. Further, impact of network status on video playback performance is investigated and the authors propose high level network-layer parameters. Then the correlation between the network-layer parameters and application-layer metrics is characterized through analysis and inference. In the secondly place, subjective tests are conducted to evaluate QoE from application-layer metrics. Ultimately, the authors validate analysis and model by simulations and experiments in real networks. The experimental study shows that the proposed method performs well in assessing QoE of TCP video streaming.

show abstract

Video quality of experience in the presence of accessibility and retainability failures

Cited by 14 publications

References 5 publications

Impact of packet loss on the perceived quality of UDP-based multimedia streaming: a study of user quality of experience in real-life environments

Impact of packet loss on the perceived quality of UDP-based multimedia streaming: a study of user quality of experience in real-life environments

Modelling user quality of experience from objective and subjective data sets using fuzzy logic

An objective multi-layer QoE Evaluation for TCP video streaming

Contact Info

Product

Resources

About