DMCA
Modeling Individual and Group Actions in Meetings: a Two-Layer HMM Framework (2004)
Cached
Download Links
| Venue: | In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Workshop on Event Mining in Video (CVPREVENT), Washington DC |
| Citations: | 57 - 14 self |
BibTeX
@INPROCEEDINGS{Zhang04modelingindividual,
author = {Dong Zhang and Daniel Gatica-perez and Samy Bengio and Iain McCowan and Guillaume Lathoud},
title = {Modeling Individual and Group Actions in Meetings: a Two-Layer HMM Framework},
booktitle = {In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Workshop on Event Mining in Video (CVPREVENT), Washington DC},
year = {2004}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
We address the problem of recognizing sequences of human interaction patterns in meetings, with the goal of structuring them in semantic terms. The investigated patterns are inherently group-based (defined by the individual activities of meeting participants, and their interplay), and multimodal (as captured by cameras and microphones). By defining a proper set of individual actions, group actions can be modeled as a two-layer process, one that models basic individual activities from low-level audio-visual features, and another one that models the interactions. We propose a two-layer Hidden Markov Model (HMM) framework that implements such concept in a principled manner, and that has advantages over previous works. First, by decomposing the problem hierarchically, learning is performed on lowdimensional observation spaces, which results in simpler models. Second, our framework is easier to interpret, as both individual and group actions have a clear meaning, and thus easier to improve. Third, different HMM models can be used in each layer, to better reflect the nature of each subproblem. Our framework is general and extensible, and we illustrate it with a set of eight group actions, using a public five-hour meeting corpus. Experiments and comparison with a single-layer HMM baseline system show its validity.
Keyphrases
group action two-layer hmm framework individual activity human interaction pattern lowdimensional observation space previous work individual action proper set low-level audio-visual feature implement concept clear meaning different hmm model principled manner two-layer process investigated pattern public five-hour meeting corpus semantic term two-layer hidden markov model simpler model single-layer hmm baseline system meeting participant
