Fast second screen TV synchronization combining audio fingerprint technique and generalized cross correlation

Duong, Ngoc Q. K.; Howson, Christopher; Legallais, Yvon

doi:10.1109/icce-berlin.2012.6336458

Cited by 22 publications

(24 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Shazam's music identification system. Recently, they have also been exploited for other applications such as identifying repeated sound events in personal recordings [6], clustering and synchronizing multi-camera video [4], synchronizing media components streamed over different networks for second screen TV applications [7], or retrieving large scale video for copy detection [8]. Another state-ofthe-art approach for synchronizing two related contents is Dynamic Time Warping (DTW).…”

Section: Related Workmentioning

confidence: 99%

Movie synchronization by audio landmark matching

Duong

Thudor

2013

2013 IEEE International Conference on Acoustics, Speech and Signal Processing

Self Cite

View full text Add to dashboard Cite

International audienceThis paper addresses movie synchronization, i.e. synchronizing multiple versions of the same movie, with an objective of automatically transferring metadata available on a reference version to other ones. We first exploit audio tracks associated with two different versions and adapt an existing audio fingerprinting technique to find all temporal matching positions between them. We then propose additional steps to refine the match and eliminate outliers. The proposed approach can efficiently handle situations where temporal scene edits occur like scene addition, removal, and even the challenging scene reordering case. Experimental results over synthetic editorial data show the effectiveness of the proposed approach with respect to the state-of-the-art dynamic time warping (DTW) based solution

show abstract

Section: Related Workmentioning

confidence: 99%

Movie synchronization by audio landmark matching

Duong

Thudor

2013

2013 IEEE International Conference on Acoustics, Speech and Signal Processing

Self Cite

View full text Add to dashboard Cite

show abstract

“…The audio landmarks are usually used for coarsely synchronizing two audio recordings [5][6][7]. However, the extracted landmark features contain some valuable information about the TDOA information of the sound sources.…”

Section: Audio Landmark and Single-source Tdoamentioning

confidence: 99%

“…Traditional microphone-array techniques, such as beamforming and sound source localization, which rely on the knowledge of microphone positions and assume samplesynchronized audio channels, cannot be applied directly [2,3]. The synchronization problem between multiple audio channels has been addressed using generalized cross-correlation [2,4,5] and audio fingerprinting [5][6][7][8].…”

Section: Introductionmentioning

confidence: 99%

“…However, due to high computational cost, GCC is more suitThis work was supported by the U.K. Engineering and Physical Sciences Research Council (EPSRC) under Grant EP/K007491/1. able for audio channels that are already coarsely synchronized [4,5]. Another synchronization approach is based on audio fingerprinting, which has been originally applied to music information retrieval [6], and clustering and synchronizing multi-camera videos [7,8].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Fine landmark-based synchronization of ad-hoc microphone arrays

Hon

Wang

Reiss

et al. 2015

2015 23rd European Signal Processing Conference (EUSIPCO)

View full text Add to dashboard Cite

We use audio fingerprinting to solve the synchronization problem between multiple recordings from an ad-hoc array consisting of randomly placed wireless microphones or handheld smartphones. Synchronization is crucial when employing conventional microphone array techniques such as beamforming and source localization. We propose a fine audio landmark fingerprinting method that detects the time difference of arrivals (TDOAs) of multiple sources in the acoustic environment. By estimating the maximum and minimum TDOAs, the proposed method can accurately calculate the unknown time offset between a pair of microphone recordings. Experimental results demonstrate that the proposed method significantly improves the synchronization accuracy of conventional audio fingerprinting methods and achieves comparable performance to the generalized cross-correlation method.

show abstract

“…More over, there are many studies on query-by-example music re trieval [2,3,4,5,6]. However, few have dealt with retrieval technology that can handle broadcast content other than mu sic [7,8], although IntoNow 3 and Shazam 4 have deployed such a service. This is because fingerprints based on the spe cial characteristics of music are useless, and because it is dif ficult to design an effective fingerprint.…”

Section: Introductionmentioning

confidence: 97%

Audio fingerprinting robust against reverberation and noise based on quantification of sinusoidality

Shibuya

Abe

Nishiguchi

2013

2013 IEEE International Conference on Multimedia and Expo (ICME)

View full text Add to dashboard Cite

The implementation of second-screen service requires a tech nology for quick, accurate content identification. This enables the service to trace the channel of a broadcast program that a user is watching or listening to. One approach is to record an audio signal from the user's mobile device, and match it with one in a reference database. However, reverberation and exogenous noise distort a recorded audio signal, making ac curate identification more difficult. This paper presents a new fingerprinting method for content identification that is robust against reverberation and noise. It employs pseudo-sinusoidal components, which are components that can be regarded as sinusoidal over a short period of time. The method gener ates a fingerprint that represents the distribution of pseudo sinusoidal components in the time-frequency domain. Exper imental results show that the method can match a 5-s-long in put signal against 792 hours of reference signals in 1.29 s on a single PC, and can identify the correct program with a recall of over 92% and a precision of 100% in a realistic setting.

show abstract

Fast second screen TV synchronization combining audio fingerprint technique and generalized cross correlation

Cited by 22 publications

References 7 publications

Movie synchronization by audio landmark matching

Movie synchronization by audio landmark matching

Fine landmark-based synchronization of ad-hoc microphone arrays

Audio fingerprinting robust against reverberation and noise based on quantification of sinusoidality

Contact Info

Product

Resources

About