A study of artificial speech quality assessors of VoIP calls subject to limited bursty packet losses

Abstract

A revolutionary feature of emerging media services over the Internet is their ability to account for human perception during service delivery processes, which surely increases their popularity and incomes. In such a situation, it is necessary to understand the users' perception, what should obviously be done using standardized subjective experiences. However, it is also important to develop artificial quality assessors that enable to automatically quantify the perceived quality. This efficiently helps performing optimal network and service management at the core and edges of the delivery systems. In our article, we explore the behavior rating of new emerging artificial speech quality assessors of VoIP calls subject to moderately bursty packet loss processes. The examined Speech Quality Assessment (SQA) algorithms are able to estimate speech quality of live VoIP calls at runtime using control information extracted from header content of received packets. They are especially designed to be sensitive to packet loss burstiness. The performance evaluation study is performed using a dedicated set-up software-based SQA framework. It offers a specialized packet killer and includes the implementation of four SQA algorithms. A speech quality database, which covers a wide range of bursty packet loss conditions, has been created and then thoroughly analyzed. Our main findings are the following: (1) all examined automatic bursty-loss aware speech quality assessors achieve a satisfactory correlation under upper (> 20%) and lower (< 10%) ranges of packet loss processes; (2) they exhibit a clear weakness to assess speech quality under a moderated packet loss process; (3) the accuracy of sequence-by-sequence basis of examined SQA algorithms should be addressed in detail for further precision.

TCD-VoIP, a research database of degraded speech for assessing quality in VoIP applications

“…Mitigation strategies such as Packet Loss Concealment (PLC) [22] can be used to smooth the effects of these missing samples. A number of studies have examined the effect of packet loss on speech quality [23], [24], [15], [25], [26]. However, since most are concerned with packet loss in the VoIP network, this is usually simulated by encoding the speech using a lossy VoIP codec and causing packet loss by running the stream through a virtual network.…”

Practical Field Overview Voice Quality of RTP Packet Size Analyze on Codec G729 Annexb = no in Low Bandwidth Area of Bangladesh

“…The negative effect of missing packets is more disturbing especially when packets are removed in bursts, i.e., multiple media units are consecutively dropped from the original media stream. This means that the probability of missing a given packet is much higher when the previous ones have been dropped [8].…”

“…The negative effect of missing packets is more disturbing especially when packets are removed in bursts, i.e., multiple media units are consecutively dropped from the original media stream. This means that the probability of missing a given packet is much higher when the previous ones have been dropped [8].Packet loss is a major source of speech impairment in voice over IP (VoIP) applications. Such a loss could be caused by discarding packets in the IP networks due to congestion or by dropping packets at the gateway/terminal due to late arrival.…”

The Effect of Voice over IP Transmission Degradations on MAP-EM-GMM Speaker Verification Performance

“…There is a number of reports on automatic speaker verification systems under voice over IP conditions (Besacier et al, 2004;Jelassi, Rubino, 2011), but there are no available reports describing experiments with different codecs in connection with various packet loss rate and different packet loss concealment methods. Some experiments on the automatic speaker identification system for forensic purposes under packet switching conditions have been recently carried out by this author (Maciejko, 2014).…”