Automatic Analysis of Multimodal Group Actions in Meetings

Automatic Analysis of Multimodal Group Actions in Meetings (2003)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Iain McCowan , Daniel Garcia-Perez , Samy Bengio , Guillaume Lathoud , Mark Barnard , Dong Zhang

Citations:

90 - 26 self

BibTeX

@MISC{McCowan03automaticanalysis,
    author = {Iain McCowan and Daniel Garcia-Perez and Samy Bengio and Guillaume Lathoud and Mark Barnard and Dong Zhang},
    title = {Automatic Analysis of Multimodal Group Actions in Meetings},
    year = {2003}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

This paper investigates the recognition of group actions in meetings. A framework is employed in which group actions result from the interactions of the individual participants. The group actions are modelled using different HMM-based approaches, where the observations are provided by a set of audio-visual features monitoring the actions of individuals. Experiments demonstrate the importance of taking interactions into account in modelling the group actions. It is also shown that the visual modality contains useful information, even for predominantly audio-based events, motivating a multimodal approach to meeting analysis.

Citations

6231	Maximum likelihood from incomplete data via the EM algorithm - Dempster, Laird - 1977
1180	Fundamentals of speech recognition - Rabiner - 1993
874	Error bounds for convolutional codes and an asymptotically optimum decoding algorithm - Viterbi - 1967
634	Adaptive background mixture models for real-time tracking - Stauffer, Grimson - 1999
286	Groups: Interaction and performance - McGrath - 1984
282	Rehg, "Statistical color models with application to skin detection - Jones, M - 1999
282	Coupled Hidden Markov Models for Complex Action Recognition - Brand, Oliver, et al. - 1997
260	A Bayesian Computer Vision System for Modeling Human Interactions - Oliver, Rosario, et al.
240	Visual recognition of American sign language using hidden Markov models - Starner - 1995
123	The Kidsroom: A PerceptuallyBased Interactive and Immersive Story Environment - Intille, Baird, et al. - 1996
115	Audio-visual speech modelling for continuous speech recognition - Dupont, Luettin
94	Interaction Process Analysis: a Method for the Study of Small Groups - Bales - 1950
92	2002. Torch: a modular machine learning software library - Collobert, Bengio, et al.
83	Structure analysis of soccer video with hidden markov models - Xie, Chang, et al. - 2002
74	Distributed Meetings: A Meeting Capture and Broadcasting System - Cutler, Rui, et al. - 2002
71	Layered representations for learning and inferring office activity from multiple sensory channels - Oliver, Horvitz, et al. - 2002
63	Robust localization in reverberant rooms - DiBiase, Silverman, et al. - 2001
62	Multi-agent event recognition - Hongeng, Nevatia - 2001
59	A hidden Markov model framework for video segmentation using audio and image features - Boreczky, Wilcox - 1997
52	Coupled hidden markov models for modeling interacting processes,” MIT Media Laboratory Vision & Modeling - Brand - 1996
52	Advances in automatic meeting record creation and access - Waibel, Bett, et al. - 2001
47	and E.Fosler-Lussier, “Combining multiple estimators of speaking rate - Morgan - 1998
46	Content-based video indexing of tv broadcast news using hidden markov models - Eickeler, Muller - 1999
45	Multi-stream adaptive evidence combination for noise robust ASR. Speech Communication - Morris, Hagen, et al. - 2001
42	The idiap smart meeting room - Moore - 2002
41	Audio-visual automatic speech recognition: An overview - Potamianos, Neti, et al. - 2004
39	Modeling human interactions in meetings - McCowan, Bengio, et al. - 2003
38	A System for the Multiple Level Observation of Groups - Bales, Cohen, et al. - 1979
38	Automated Posture Analysis for Detecting Learner’s Interest Level - Mota, Picard - 2003
37	The meeting project at icsi - Morgan, Baron, et al. - 2003
35	The SIFT algorithm for fundamental frequency estimation - Markel - 1972
34	Action Reaction Learning: Automatic Visual Analysis and - Jebara, Pentland - 1999
34	Modeling individual and group actions in meetings: a two-layer hmm framework - Zhang, Gatica-Perez, et al. - 2006
34	The acquisition and use of interaction behaviour models - Johnson, Galata, et al. - 1998
31	Detection of agreement vs. disagreement in meetings: Training with unlabeled data - Hillard, Ostendorf, et al. - 2003
30	Spotting hotspots in meetings: Human judgments and prosodic cues - Wrede, Shriberg - 2003
29	A High-Accuracy, Low-Latency Technique for Talker Localization in Reverberant Environments Using Microphone Arrays - DiBiase - 2000
28	An asynchronous hidden Markov model for audio-visual speech recognition - Bengio
28	The relationship between dialogue acts and hot spots in meetings, in - Wrede, Shriberg - 2003
27	Group discussion as interactive dialogue or as serial monologue - Fay, Garrod, et al. - 2000
26	Coordinating turn-taking with gaze - Novick, Hansen, et al. - 1996
26	Dynamic bayesian networks for meeting structuring - Dielmann, Renals - 2004
23	A Mixed-State I-Particle Filter for Multi-Camera Speaker Tracking - Gatica-Perez, Lathoud, et al. - 2003
21	The role of audible and visible back-channel responses in interpersonal communication - Krauss, Garlock, et al. - 1977
21	Emotion recognition by speech signals - Kwon, Chan, et al. - 2003
20	Audio information access from meeting rooms - Renals, Ellis - 2003
20	Speaking Turns in Small Group Interaction: A Context-Sensitive Event Sequence Model - Parker - 1988
20	Microphone array speech recognition: Experiments on overlapping speech in meetings - Moore, Mccowan - 2003
18	A simulation of small group discussion - Padilha, Carletta - 2002
16	Rough’n’ready: a meeting recorder and browser - Kubala - 1999