Study of Subjective and Objective Quality Assessment of Audio-Visual Signals

Min, Xiongkuo; Zhai, Guangtao; Zhou, Jiantao; Farias, Mylène C. Q.; Bovik, Alan C.

doi:10.1109/tip.2020.2988148

Cited by 198 publications

(56 citation statements)

References 42 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Furthermore, although in many cases, the test sequences in subjective quality experiments are watched by the participants without audio, subjective studies have shown that it can influence the perceived quality, and that the degradations affecting (jointly or separately) the audio and video signals impact the user QoE [60], [65], [66]. Thus, objective metrics have been developed trying to model the overall audiovisual quality [65]- [67].…”

Section: Assessment Of Audiovisual Quality With 360°videosmentioning

confidence: 99%

Subjective Evaluation of Visual Quality and Simulator Sickness of Short 360$^\circ$ Videos: ITU-T Rec. P.919

Gutiérrez¹,

Pérez

Orduna

et al. 2022

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Recently an impressive development in immersive technologies, such as Augmented Reality (AR), Virtual Reality (VR) and 360°video, has been witnessed. However, methods for quality assessment have not been keeping up. This paper studies quality assessment of 360°video from the cross-lab tests (involving ten laboratories and more than 300 participants) carried out by the Immersive Media Group (IMG) of the Video Quality Experts Group (VQEG). These tests were addressed to assess and validate subjective evaluation methodologies for 360°video. Audiovisual quality, simulator sickness symptoms, and exploration behavior were evaluated with short (from 10 seconds to 30 seconds) 360°sequences. The following factors' influences were also analyzed: assessment methodology, sequence Manuscript received

show abstract

Section: Assessment Of Audiovisual Quality With 360°videosmentioning

confidence: 99%

Subjective Evaluation of Visual Quality and Simulator Sickness of Short 360$^\circ$ Videos: ITU-T Rec. P.919

Gutiérrez¹,

Pérez

Orduna

et al. 2022

IEEE Trans. Multimedia

View full text Add to dashboard Cite

show abstract

“…Experimental results on audio-visual attention databases show that the introduced models incorporating audio cues have significant superiority over state-of-the-art image and video saliency models which utilize a single visual modality. The results of this research institute on audio-visual cross-modal analysis provide ideas for our experiment [21].…”

Section: B Research Statusmentioning

confidence: 98%

Research on the Correlation Between the Timbre Attributes of Musical Sound and Visual Color

et al. 2021

View full text Add to dashboard Cite

This article investigated the timbre of musical sound and visual color; comprehensively used experimental psychology, audio information processing and other experimental methods and technical means; and conducted research on the relationship between timbre attributes and visual color. First, we designed and implemented a subjective perception experiment based on audiovisual cross-modal timbrecolor correlation. Through the statistical analysis of the experimental data, we obtained a complete timbrecolor cross-modal correlation dataset. Second, through the visual processing and correlation analysis of the timbre-color correlation data, it is proven that there is a certain correlation between the timbre dimension and the color dimension. On this basis, we used three algorithms to construct a timbre-color correlation model, namely, multiple linear regression, BP neural network and SVR, and we verified the accuracy of the three models. The timbre-color correlation dataset constructed in this paper can provide basic data support for audiovisual cross-modal research. The timbre-color correlation model constructed in this paper can provide a theoretical basis for cross-modal audiovisual applications. In addition, the timbre-color crossmodality research method in this paper can provide new research ideas for audio-visual cross-modality research.

show abstract

“…Similarly, Pinson et al [19] performed a study where ten different laboratories ran perceptual experiments, which consisted of presenting sequences with compressed audio and video components, considering different environments and devices. More recently, a study presented by Min et al [18] conducted an audio-visual perceptual experiment introducing distortions caused by audio and video compression and video compression combined with video scaling. Despite their setup differences, all these three studies agreed on the influence of audio on the perceived audio-visual quality.…”

Section: Previous Work On Perceptual Quality Assessmentmentioning

confidence: 99%

“…Quality perception of audio-visual signals has been studied thought several perceptual experiments [17][18][19][20][21]. Early experiments have identified the visual component as the dominant influence in the overall audio-visual quality; yet, it has been argued that this influence does not apply to all types of audio-visual applications.…”

Section: Introductionmentioning

confidence: 99%

“…Among the few studies that have explored the overall audio-visual quality of sequences with distortions in both audio and video components, we can cite the works of Pinson [19], Becerra [25]. More recently, the study presented by Min et al [18] who conducted experiments in which the content had compression distortions in both audio and video components. Although their results confirmed the dominance of the video component on the overall quality, the audio component had a considerable impact on quality for some types of media content.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Perceptual Quality of Audio-Visual Content with Common Video and Audio Degradations

2021

Self Cite

View full text Add to dashboard Cite

Audio-visual quality assessment remains as a complex research field. A great effort is being made to understand how visual and auditory domains are integrated and processed by humans. In this work, we analyzed and compared the results of three psychophisical experiments that collected quality and content scores given by a pool of subjects. The experiments include diverse content audio-visual material, e.g., Sports, TV Commercials, Interviews, Music, Documentaries and Cartoons, impaired with several visual (bitrate compression, packet-loss, and frame-freezing) and auditory (background noise, echo, clip, chop) distortions. Each experiment explores a particular domain. In Experiment 1, the video component was degraded with visual artifacts, meanwhile, the audio component did not suffer any type of degradation. In Experiment 2, the audio component was degraded while the video component remained untouched. Finally, in Experiment 3 both audio and video components were degraded. As expected, results confirmed a dominance of the visual component in the overall audio-visual quality. However, a detailed analysis showed that, for certain types of audio distortions, the audio component played a more important role in the construction of the overall perceived quality.

show abstract

Study of Subjective and Objective Quality Assessment of Audio-Visual Signals

Cited by 198 publications

References 42 publications

Subjective Evaluation of Visual Quality and Simulator Sickness of Short 360$^\circ$ Videos: ITU-T Rec. P.919

Subjective Evaluation of Visual Quality and Simulator Sickness of Short 360$^\circ$ Videos: ITU-T Rec. P.919

Research on the Correlation Between the Timbre Attributes of Musical Sound and Visual Color

Perceptual Quality of Audio-Visual Content with Common Video and Audio Degradations

Contact Info

Product

Resources

About