Objective listening quality assessment of speech communication systems introducing continuously varying delay (time-warping): A time alignment issue

Malfait, Ludovic; Gray, Peter J.; Reed, Martin J.

doi:10.1109/icassp.2008.4518584

Cited by 4 publications

(4 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The article recommends that PESQ should not be used to estimate the MOS score for a CODEC that uses residual modification and waveform interpolation like the EVRC. Additional research [15] approves that the PESQ timealignment failed to align continuous variable delay (timewarped) in the processed signal.…”

Section: Pesq Evaluationmentioning

confidence: 92%

See 1 more Smart Citation

Enhanced PESQ algorithm for objective assessment of speech quality at a continuous varying delay

Shiran

Shallom

2009

2009 International Workshop on Quality of Multimedia Experience

View full text Add to dashboard Cite

ITU-T P.862 -"Perceptual Evaluation of Speech Quality (PESQ)" is well known as an intrusive objective speech quality assessment method. Some reports have found that the PESQ time alignment mechanism fails to estimate delay where signals with high packet loss rate and dynamic time processing are present. A new time-alignment algorithm to improve the PESQ accuracy for time-scale modified voice transmission is suggested here. In the propose model, the time alignment of reference and degraded speech is estimated using Dynamic Time-Warping (DTW) in contrast to correlation and splitting methods used in the standard PESQ. Comparative results versus subjective Mean Opinion Score (MOS) show improvement in cases where dynamic time processing of signals is present.

show abstract

Section: Pesq Evaluationmentioning

confidence: 92%

“…Today, PESQ is widely accepted in the telecom industry as a state-of-the-art algorithm for quality assessment of speech. Yet, some reports indicate inaccuracies to MOS on some applications [10], [13], [14], [15]. In this paper, the reason for inaccuracies of PESQ will be presented.…”

Section: Introductionmentioning

confidence: 95%

Enhanced PESQ algorithm for objective assessment of speech quality at a continuous varying delay

Shiran

Shallom

2009

2009 International Workshop on Quality of Multimedia Experience

View full text Add to dashboard Cite

show abstract

“…Among them, Perceptual Evaluation of Speech Quality (PESQ) [30,31], designed by ITU-T P.862 [32], utilized for narrowband speech with minor impairments, should be mentioned [33]. Another method, i.e., ITU-T P.563 [34], allows for dealing with narrowband speech quality.…”

Section: State-of-the-art Of the Speech Intelligibility Assessment Me...mentioning

confidence: 99%

A Novel Method for Intelligibility Assessment of Nonlinearly Processed Speech in Spaces Characterized by Long Reverberation Times

Kurowski

Kotus

Odya

et al. 2022

Sensors

View full text Add to dashboard Cite

Objective assessment of speech intelligibility is a complex task that requires taking into account a number of factors such as different perception of each speech sub-bands by the human hearing sense or different physical properties of each frequency band of a speech signal. Currently, the state-of-the-art method used for assessing the quality of speech transmission is the speech transmission index (STI). It is a standardized way of objectively measuring the quality of, e.g., an acoustical adaptation of conference rooms or public address systems. The wide use of this measure and implementation of this method on numerous measurement devices make STI a popular choice when the speech-related quality of rooms has to be estimated. However, the STI measure has a significant drawback which excludes it from some particular use cases. For instance, if one would like to enhance speech intelligibility by employing a nonlinear digital processing algorithm, the STI method is not suitable to measure the impact of such an algorithm, as it requires that the measurement signal should not be altered in a nonlinear way. Consequently, if a nonlinear speech enhancing algorithm has to be tested, the STI—a standard way of estimating speech transmission cannot be used. In this work, we would like to propose a method based on the STI method but modified in such a way that it makes it possible to employ it for the estimation of the performance of the nonlinear speech intelligibility enhancement method. The proposed approach is based upon a broadband comparison of cumulated energy of the transmitted envelope modulation and the received modulation, so we called it broadband STI (bSTI). Its credibility with regard to signals altered by the environment or nonlinear speech changed by a DSP algorithm is checked by performing a comparative analysis of ten selected impulse responses for which a baseline value of STI was known.

show abstract

“…Focusing on the frame-by-frame time alignment stage of PESQ, [15] noted that subjective scores may be poorly correlated as a result of errors in the objective quality scores caused by a few misaligned frames. Whereas, [16] discovered that PESQ time alignment failed to align continuous variable delays particularly with speech signals that have high packet loss rate and for which dynamic time processing is exhibited due to its piecewise constant delay estimation.…”

Section: Review Of Pesq's Limitationsmentioning

confidence: 99%

An Improved Logistic Function for Mapping Raw Scores of Perceptual Evaluation of Speech Quality (PESQ)

Olatubosun

Olabisi

2018

JERR

View full text Add to dashboard Cite

Voice service being the major offering of telecommunication networks, its level of Quality of Service (QoS) largely determines the performance of these networks. This work evaluated the state-of-the-art Perceptual Evaluation of Speech Quality (PESQ) objective model for perceptual estimation of the quality of transmitted speech signals. Perceptual estimation of the quality of speech is predominantly done by subjective techniques and the results presented as Mean Opinion Scores (MOS), which has a scale from 1 for poor quality to 5 for excellent quality. Despite constraints of the subjective approach to perceptual speech quality estimation, its scores serves as the basis for correlating quality scores from objective techniques for speech quality estimation. Original or reference speeches were recorded using professional studio equipment and software, and guided by provisions of ITU-T P.830. The speeches were transmitted over three mobile wireless networks. A speech database consisting of 64 original (32 male and 32 female) and 192 transmitted speeches was developed. Reference speeches and their corresponding transmitted (network-degraded) speeches were tested on the PESQ model to estimate their quality scores. The raw PESQ quality scores are within the scale range of -0.5 and 4.5. They were mapped to the MOS scale for linear comparison of the scales. Study of PESQ model showed several shortcomings, some of which have been improved upon by previous researchers. Evaluating PESQ mapping function (in ITU-T Rec P.862.1) showed the need for better coverage of the MOS scale. Analysis of solution for the logistic growth function was done and parameters were optimised which resulted in the development of a new robust logistic mapping function. The raw PESQ quality scores were mapped using the developed mapping function as well as two known standard mapping functions, namely: ITU-T P.862.1 and Morfitt and Cotanis mapping functions. The mapped scores known as PESQ MOS-listening quality objective (PESQ MOS-LQO) obtained with the three functions were tested using ANOVA at a significant figure of . The developed logistic mapping function offered a quality score coverage of 98.6% of the MOS scale. This was evaluated against the two known standard mapping functions and the developed function offered improvement of 11.8 and 4.9% over and above their 86.8 and 93.7% coverage of the MOS scale respectively. At the significance level of , an F-value of 60.6042, a critical-F of 3.04, and a p-value of 4.61721E-21 were obtained. With p < 0.05, the Null Hypothesis was rejected, and the critical-F value being less than the F-statistic value confirmed the rejection. Therefore, the data distribution of at least one of the functions has a different mean and belongs to a separate population of performance.

show abstract

Objective listening quality assessment of speech communication systems introducing continuously varying delay (time-warping): A time alignment issue

Cited by 4 publications

References 1 publication

Enhanced PESQ algorithm for objective assessment of speech quality at a continuous varying delay

Enhanced PESQ algorithm for objective assessment of speech quality at a continuous varying delay

A Novel Method for Intelligibility Assessment of Nonlinearly Processed Speech in Spaces Characterized by Long Reverberation Times

An Improved Logistic Function for Mapping Raw Scores of Perceptual Evaluation of Speech Quality (PESQ)

Contact Info

Product

Resources

About