DMCA
Further Applications of Sector-Based Detection and Short-Term Clustering (2006)
| Citations: | 2 - 2 self |
BibTeX
@MISC{Lathoud06furtherapplications,
author = {Guillaume Lathoud},
title = {Further Applications of Sector-Based Detection and Short-Term Clustering},
year = {2006}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
This paper presents an effective implementation of detection-localization of multiple speech sources with microphone arrays. In particular, the Scaled Conjugate Gradient descent is used for fast and precise localization, within a pre-detected volume of space, and a close to realtime implementation is provided. An unsupervised approach to speech/non-speech discrimination is also proposed. The integrated system is then successfully applied to segmentation of spontaneous multi-party speech, as found in meetings. Based on this system, the unsupervised speaker clustering task is then investigated, using distant microphones only. This task is challenging due to the poor quality of the signal and the fast-changing speaker turns encountered in spontaneous speech. An extension of the BIC criterion to multiple modalities is proposed, allowing to combine the strengths of speaker location information – useful in the short term – and acoustic speaker information, i.e. MFCCs – useful in the longer term. A dramatic improvement in speaker clustering results is obtained by the combined approach, as compared with the acoustic-alone approach, and results are close to those obtained with close-talking microphones. Finally, an initial investigation on automatic audio-visual calibration is exposed.
Keyphrases
sector-based detection short-term clustering precise localization scaled conjugate gradient descent spontaneous multi-party speech multiple speech source distant microphone acoustic speaker information pre-detected volume initial investigation fast-changing speaker combined approach short term speaker location information speaker clustering result integrated system automatic audio-visual calibration dramatic improvement unsupervised approach spontaneous speech unsupervised speaker close-talking microphone bic criterion poor quality microphone array non-speech discrimination effective implementation acoustic-alone approach
