Audio and video channel impact on perceived audio-visual quality in different interactive contexts

Belmudez, Benjamin; Moeller, Sebastian; Lewcio, Blazej; Raake, Alexander; Mehmood, Amir

doi:10.1109/mmsp.2009.5293330

Cited by 22 publications

(10 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The challenge lies in correctly identifying and understanding the key elements dominating the vast space of context and user factors. QoE studies have already revealed differences between tasks [4] and user preferences [5], social context [6], personality [7] and more [1].…”

Section: Introductionmentioning

confidence: 99%

“…A screenshot of the system used in the experiment is shown in Figure 1. The impact of encoding and loss rate on quality had been studied only in two-party scenarios [11][12] [4]. We presented how the manipulated system factors (encoding bitrate and packet loss of the video streams) influenced the QoE in terms of perceived video, audio quality and overall quality.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Towards context-aware interactive Quality of Experience evaluation for audiovisual multiparty conferencing

Schmitt¹,

Redi²,

Garcia³

2016

5th ISCA/DEGA Workshop on Perceptual Quality of Systems (PQS 2016)

View full text Add to dashboard Cite

In modern video conferencing services, just as in common video delivery, most of the resource optimization is taken care of in the codec layer. Modern codecs like H.264 use detailed perceptual models to optimize the data reduction in way that it is least noticed by us. Already early evaluations of telecommunication systems could establish that there are different thresholds for a good quality depending on the situation. It is further known that subjective quality perceptions vary from user to user. But the space of user and context factors is still largely unexplored. To gain insight in which parameters are key in differentiating quality perception, we need to explore the interaction in different situations while keeping a tight control over the system parameters. In this paper we explore how clustering participants by their interaction or rating behavior can reveal subgroups that show significantly different perception of the QoE delivered by the same videoconferencing system. While for a cluster of users we find video quality to influence other QoE dimensions such as audio, for another cluster this is not the case. We explore whether this effect is due to conversational dynamics (contextual factor) or individual preferences (user factor) and discuss what this would mean for the design of future video-conferencing systems, that want to dynamically adapt to situation and participants.

show abstract

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Towards context-aware interactive Quality of Experience evaluation for audiovisual multiparty conferencing

Schmitt¹,

Redi²,

Garcia³

2016

5th ISCA/DEGA Workshop on Perceptual Quality of Systems (PQS 2016)

View full text Add to dashboard Cite

show abstract

“…We choose this task as it is representative for the common situation [18] in which users show objects to communications partners. The task is often employed in audiovisual communication test [19]- [21] and was adapted by us for a multi-party situation. We recruited always groups of participants which were familiar with each other, i.e.…”

mentioning

confidence: 99%

Towards Individual QoE for Multiparty Videoconferencing

Schmitt

Redi

Bulterman

et al. 2018

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Abstract-Video-conferencing is becoming an essential part in everyday life. The visual channel allows for interactions which were not possible over audio-only communication systems such as the telephone. However, being a de-facto over-the-top service, the quality of the delivered video-conferencing experience is subject to variations, dependent on network conditions. Video-conferencing systems adapt to network conditions by changing for example encoding bitrate of the video. For this adaptation not to hamper the benefits related to the presence of a video channel in the communication, it needs to be optimized according to a measure of the Quality of Experience (QoE) as perceived by the user. The latter is highly dependent on the ongoing interaction and individual preferences, which have hardly been investigated so far. In this paper, we focus on the impact video quality has on conversations that revolve around objects that are presented over the video channel. To this end we conducted an empirical study where groups of 4 people collaboratively build a Lego® model over a video-conferencing system. We examine the requirements for such a task by showing when the interaction, measured by visual and auditory cues, changes depending on the encoding bitrate and loss. We then explore the impact that prior experience with the technology and affective state have on QoE of participants. We use these factors to construct predictive models which double the accuracy compared to a model based on the system factors alone. We conclude with a discussion of how these factors could be applied in real world scenarios.Index Terms-Multi-Party video conferencing, Quality of Experience, Over-the-top, subjective quality, quality metrics, user study

show abstract

“…It has been hypothesized that the visual modality can be dominant for spatial task and the audio modality for temporal ones due to their respective resolution accuracy [22]. A task dependency was found when investigating the relative importance between audio and visual information with respect to the interaction scenario (human-human or human-machine interaction) and to the degree of interactivity [23,24].…”

Section: Audiovisual Quality Perceptionmentioning

confidence: 99%

Audiovisual quality integration for interactive communications

Belmudez

Möller

2013

J AUDIO SPEECH MUSIC PROC.

Self Cite

View full text Add to dashboard Cite

This paper investigates multi-modal aspects of audiovisual quality assessment for interactive communication services. It shows how perceived auditory and visual qualities integrate to an overall audiovisual quality perception in different experimental contexts. Two audiovisual experiments are presented and provide experimental data for the present analysis. First, two experimental contexts are compared, i.e., passive 'viewing and listening' and interactive, with regard to their impact on the audiovisual qualities as subjectively perceived by the user. Second, the effects of cross-modal interactions on the assessment of the audio and video qualities are measured for those experimental contexts. The results are compared to the ones found in the literature revealing both similarities and differences in terms of magnitude and also in which cases they occur. Third, the impact of the conversational scenario on the assessment of the auditory and visual qualities is investigated. Finally, results from the literature related to audiovisual integration are gathered by the type of application. A general integration function is proposed for each category, and the performances of these 'application-oriented' models demonstrate a direct gain in prediction.

show abstract

Audio and video channel impact on perceived audio-visual quality in different interactive contexts

Cited by 22 publications

References 5 publications

Towards context-aware interactive Quality of Experience evaluation for audiovisual multiparty conferencing

Towards context-aware interactive Quality of Experience evaluation for audiovisual multiparty conferencing

Towards Individual QoE for Multiparty Videoconferencing

Audiovisual quality integration for interactive communications

Contact Info

Product

Resources

About