Subjective assessment of HDTV content: comparison of quality across HDTV formats

Abstract

This paper reports on a series of experiments designed to examine the subjective quality of HDTV encoded video at a distance of 4H from a 46 inch widescreen LCD TV. A common set of video sequences varying in spatial and temporal complexity were encoded at different H.264 encoding profiles. Each video source used in the tests was available in 720p at 50 fps (720p/50) and in 1080i at 25 fps (1080i/25) HDTV formats. Each clip was then encoded in CBR mode using H.264 at bit rates ranging from 1 up to 20Mbit/s with all the other encoding parameters identical. This approach enabled direct comparison across bit rates and formats most relevant to HDTV broadcast services. Two subjective tests were performed, one per HDTV format. The single-stimulus subjective test method with the ACR rating scale was employed, with the clips played in random order. A total of 15 non-expert subjects participated in each test, a different subject sample was used for each test, making 30 participants in total. Using a mean opinion score performance benchmark of 4 corresponding to the rating "Good" on the five-point ACR scale, it was found that for 720p/50 content on average a bit rate of 5Mbit/s was need to meet the performance benchmark. For demanding 720p/50 content a bit rate of 8Mbit/s was needed to achieve a MOS of 4, whereas a bit rate of 2Mbit/s was adequate for easy-to-encode 720p/50 content. For 1080i/25 content, an average bit rate of 8Mbit/s was needed to attain an average MOS of 4. For difficult 1080i/25 content a bit rate of 11Mbit/s was necessary, this bit rate dropped to 3Mbit/s for less demanding 1080i/25 content.

Subjective quality assessment of error concealment strategies for 3DTV in the presence of asymmetric transmission errors

“…Several publications discuss the influence of transmission distortions on the quality of experience in the 2D case [3,4,5]. In the 3D case, a transmission distortion in one view or in both views is perceived differently.…”

Comparison of HDTV formats in a consumer environment

“…6 and Loncaric et.al. 7 showed that for the same bitrates, 720p50 delivers a better perceived quality compared to 1080i50.…”

Subjective evaluation and statistical analysis for improved frame-loss error concealment of 3D videos

“…Subjective analysis [1] showed that same packet loss can have significantly different impact on a user's perceived quality for 3D than 2D video. The relationship between bit rate and perceptual quality of HDTV contents was investigated in [4] and illustrated that users are more affected and annoyed by long and widely spread packet losses than bursts occurred for transmission errors. This paper proposes an efficient error concealment strategy and appropriate subjective testing scenario for transmitted 3D Videos.…”