Automatic Analysis of Multimodal Group Actions in Meetings

Automatic Analysis of Multimodal Group Actions in Meetings (2003)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Iain McCowan , Daniel Garcia-Perez , Samy Bengio , Guillaume Lathoud , Mark Barnard , Dong Zhang

Citations:

120 - 29 self

BibTeX

@MISC{McCowan03automaticanalysis,
    author = {Iain McCowan and Daniel Garcia-Perez and Samy Bengio and Guillaume Lathoud and Mark Barnard and Dong Zhang},
    title = {Automatic Analysis of Multimodal Group Actions in Meetings},
    year = {2003}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

This paper investigates the recognition of group actions in meetings. A framework is employed in which group actions result from the interactions of the individual participants. The group actions are modelled using different HMM-based approaches, where the observations are provided by a set of audio-visual features monitoring the actions of individuals. Experiments demonstrate the importance of taking interactions into account in modelling the group actions. It is also shown that the visual modality contains useful information, even for predominantly audio-based events, motivating a multimodal approach to meeting analysis.

Citations

8049	Maximum likelihood from incomplete data via the EM algorithm - Dempster, Laird, et al. - 1977
1484	B.: Fundamentals of Speech Recognition - Rabiner, Juang - 1993
1160	Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm - Viterbi - 1967
900	Adaptive background mixture models for real-time tracking - Stauffer, Grimson - 1999
367	Coupled hidden markov models for complex action recognition - Brand, Oliver, et al. - 1997
365	Rehg, Statistical Color Models with Application to Skin Detection Int - Jones, M - 2002
353	A bayesian computer vision system for modeling human interactions - Oliver, Rosario, et al.
345	Groups, interaction and performance - McGrath - 1984
280	Visual recognition of american sign language using hidden markov models - Starner, Pentland - 1995
163	Audio-visual speech modeling for continuous speech recognition - Dupont, Luettin - 2000
142	The kidsroom: A perceptually-based interactive and immersive story environment - Bobick, Intille, et al. - 1999
130	Interaction process analysis: A method for the study of small groups - Bales - 1967
108	Torch: a modular machine learning software library - Collobert, Bengio, et al. - 2002
105	Structure analysis of soccer video with hidden markov models - Xie, Chang, et al.
98	Layered representations for learning and inferring office activity from multiple sensory channels - Oliver, Garg, et al.
95	Distributed Meetings: A Meeting Capture and Broadcasting System - Cutler, Rui, et al. - 2002
80	Multi-agent event recognition - Hongeng, Nevatia - 2001
79	Robust Localization in Reverberant Rooms - DiBiase, Silverman, et al.
77	A hidden Markov model framework for video segmentation using audio and image features - Boreczky, Wilcox - 1998
63	Multi-stream adaptive evidence combination for noise robust ASR - Morris, Hagen, et al. - 2001
63	Audio-visual automatic speech recognition: An overview - Potamianos, Neti, et al. - 2004
63	The IDIAP smart meeting room - Moore - 2002
61	Coupled Hidden Markov Models for Modeling Interacting - Brand - 1997
60	Advances in automatic meeting record creation and access - Waibel, Bett, et al. - 2001
59	Content-based video indexing of TV broadcast news using Hidden Markov models - Eickeler, Muller - 1999
59	Modeling human interaction in meetings - McCowan, Bengio, et al. - 2003
58	Combining multiple estimators of speaking rate - Morgan, Fosler-Lussier - 1998
52	The Meeting Project at ICSI - Morgan, Baron, et al. - 2001
51	Modeling Individual and Group Actions in Meetings: a Two-Layer HMM Framework - Zhang, Gatica-Perez, et al.
49	The sift algorithm for fundamental frequency estimation - Markel - 1972
46	Detection of Agreement vs. Disagreement in Meetings: Training with Unlabeled Data - Hillard, Ostendorf, et al. - 2003
44	A high-accuracy, low-latency technique for talker localization in reverberant environments using microphone arrays - Dibiase - 2000
43	Automated posture analysis for detecting learner’s interest level - Mota, Picard - 2003
40	SYMLOG: A system for the multiple level observation of groups - BALES, COHEN - 1979
40	The acquisition and use of interaction behaviour models - Johnson, Galata, et al. - 1998
39	Spotting hot spots in meetings: Human judgments and prosodic cues - Wrede, Shriberg - 2003
38	Action reaction learning: Automatic visual analysis and synthesis of interactive behaviour - Jebara, Pentland - 1999
37	An asynchronous hidden Markov model for audio-visual speech recognition - Bengio
36	Dyamic Bayesian Networks for Meeting Structuring - Dielmann, Renals
34	Group discussion as interactive dialogue or as serial monologue: The influence of group size - Fay, Garrod, et al. - 2000
34	Action recognition in meeting scenarios using global motion features - Zobl, Wallhoff, et al. - 2003
33	Coordinating turn-taking with gaze - Novick, Hansen, et al. - 1996
33	Emotion recognition by speech signals - Kwon, Chan, et al. - 2003
29	The relationship between dialogue acts and hot spots in meetings - Wrede, Shriberg - 2003
27	Speaking turns in small group interaction: A contextsensitive event sequence model - Parker - 1988
27	Microphone array speech recognition: Experiments on overlapping speech in meetings - Moore, McCowan - 2003
24	The Role of Audible and Visible BackChannel Responses in Interpersonal Communication - Krauss, Garlock - 1977
23	Audio information access from meeting rooms - Renals, Ellis - 2003
23	J.M.: A mixed-state iparticle filter for multi-camera speaker tracking - Gatica-Perez, Lathoud, et al.
20	A simulation of small group discussion - Padilha, Carletta - 2002