The Extended-OPQ Method for User-Centered Quality of Experience Evaluation: A Study for Mobile 3D Video Broadcasting over DVB-H

Abstract

The Open Profiling of Quality (OPQ) is a mixed methods approach combining a conventional quantitative psychoperceptual evaluation and qualitative descriptive quality evaluation based on naïve participants' individual vocabulary. The method targets evaluation of heterogeneous and multimodal stimulus material. The current OPQ data collection procedure provides a rich pool of data, but full benefit of it has neither been taken in the analysis to build up completeness in understanding the phenomenon under the study nor has the procedure in the analysis been probed with alternative methods. The goal of this paper is to extend the original OPQ method with advanced research methods that have become popular in related research and the component model to be able to generalize individual attributes into a terminology of Quality of Experience. We conduct an extensive subjective quality evaluation study for 3D video on mobile device with heterogeneous stimuli. We vary factors on content, media (coding, concealments, and slice modes), and transmission levels (channel loss rate). The results showed that advanced procedures in the analysis cannot only complement each other but also draw deeper understanding on Quality of Experience.

Comparison of two mixed methods approaches for multimodal quality evaluations: Open Profiling of Quality and Conventional Profiling

“…Sensory data was analyzed using R with FactoMineR package. A Multiple Factor Analysis (MFA) and a joint Hierarchical MFA (HMFA) were calculated from the OPQ and the CP data sets [18]. Within a MFA the data sets of all participants are analyzed and superimposed to reduce the dimensions of the resulting perceptual space.…”

3D Future Internet Media

“…To mitigate this effect, an adaptive algorithm should be implemented in asymmetric encoders such that views' quality cross-switching occur at scene cuts, where a perceptual masking effect of the HVS occurs. The GOP can also be used as a reference for cross-switching, as the frames inside a GOP have high correlation [43]. Even so the GOP size should not be small to avoid flickering effects.…”

User-centered EEG-based multimedia quality assessment

“…By making use of various advanced statistical procedures for data analysis, OPQ was shown to provide a deeper understanding of user's QoE with 3D multimedia content by identifying important underlying factors related to content, viewing experience, as well as visual, audio and audiovisual quality (e.g., motion, clarity, colour, brightness, ease of viewing, eye strain, etc.) [15].…”