Speaker localization and tracking in the presence of sound interference by exploiting speech harmonicity

Wu, Kai; Goh, Shu Ting; Khong, Andy W. H.

doi:10.1109/icassp.2013.6637670

Cited by 12 publications

(7 citation statements)

References 26 publications

(58 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this paper, however, a non-linear particle filter [7] is employed as post-filtering. The particle filter has been widely applied in sound source localization under noisy environments [8–11], reverberant environments [12–14], noisy and reverberant environments [15–17], and multiple source conditions [18–22]. Those methods employ the conventional spatial features.…”

Section: Introductionmentioning

confidence: 99%

Robust Sensing of Approaching Vehicles Relying on Acoustic Cues

Mizumachi

Kaminuma

Ando

2014

Sensors

View full text Add to dashboard Cite

The latest developments in automobile design have allowed them to be equipped with various sensing devices. Multiple sensors such as cameras and radar systems can be simultaneously used for active safety systems in order to overcome blind spots of individual sensors. This paper proposes a novel sensing technique for catching up and tracking an approaching vehicle relying on an acoustic cue. First, it is necessary to extract a robust spatial feature from noisy acoustical observations. In this paper, the spatio-temporal gradient method is employed for the feature extraction. Then, the spatial feature is filtered out through sequential state estimation. A particle filter is employed to cope with a highly non-linear problem. Feasibility of the proposed method has been confirmed with real acoustical observations, which are obtained by microphones outside a cruising vehicle.

show abstract

Section: Introductionmentioning

confidence: 99%

Robust Sensing of Approaching Vehicles Relying on Acoustic Cues

Mizumachi

Kaminuma

Ando

2014

Sensors

View full text Add to dashboard Cite

show abstract

“…The performance may be degraded when these interferers are present. In this section, a speech source tracking method that is robust to interferers is introduced [38]. The proposed method incorporates a well-known speech feature in the frequency domain known as harmonicity.…”

Section: Proposed Robust Speech Source Trackingmentioning

confidence: 99%

Sound Source Localization and Tracking

Khong

2015

Human–Computer Interaction Series

Self Cite

View full text Add to dashboard Cite

Sound source localization and tracking plays an important role in a teleconferencing system and social robot applications. Given the location of a sound, the social robot can be endowed with the capability of sound event awareness, which results in enhanced interaction with human beings. This chapter presents the problem of sound source localization and tracking, highlights their challenges, and reviews several existing techniques. In addition, a speech source tracking algorithm is proposed in order to achieve robust speaker tracking in the presence of sound interferers. Simulation is conducted and shows the effectiveness of the proposed method in a typical room environment.

show abstract

“…Finally, the information was used together in conjunction to take the final decision. Several issues like multi-target tracking [10,11], robustness to reverberation [12], ground noise and interfering sources [13] and time-varying and intermittent sources [14] have been researched, making audio tracking a developed research field.…”

Section: Literature Reviewmentioning

confidence: 99%

Visual Object Tracking by Fusion of Audio Imaging in Template Matching Framework

Singh¹,

Khosla²,

Kapoor³

2019

IJIGSP

View full text Add to dashboard Cite

Audio imaging can play a fundamental role in computer vision, in particular in automated surveillance, boosting the accuracy of current systems based on standard optical cameras. We present here a method for object tracking application that fuses visual image with an audio image in the template-matching framework. Firstly, an improved template matching based tracking is presented that takes care of the chaotic movements in the template-matching algorithm. Then a fusion scheme is presented that makes use of deviations in the correlation scores pattern obtained across the individual frame in each imaging domain. The method is compared with various state of art trackers that perform track estimation using only visible imagery. Results highlight a significant improvement in the object tracking by the assistance of audio imaging using the proposed method under severe challenging vision conditions such as occlusions, object shape deformations, the presence of clutters and camouflage, etc.

show abstract

Speaker localization and tracking in the presence of sound interference by exploiting speech harmonicity

Cited by 12 publications

References 26 publications

Robust Sensing of Approaching Vehicles Relying on Acoustic Cues

Robust Sensing of Approaching Vehicles Relying on Acoustic Cues

Sound Source Localization and Tracking

Visual Object Tracking by Fusion of Audio Imaging in Template Matching Framework

Contact Info

Product

Resources

About