Automatic Analysis of Multimodal Group Actions in Meetings

Automatic Analysis of Multimodal Group Actions in Meetings (2003)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Iain McCowan , Daniel Garcia-Perez , Samy Bengio , Guillaume Lathoud , Mark Barnard , Dong Zhang

Citations:

119 - 28 self

BibTeX

@MISC{McCowan03automaticanalysis,
    author = {Iain McCowan and Daniel Garcia-Perez and Samy Bengio and Guillaume Lathoud and Mark Barnard and Dong Zhang},
    title = {Automatic Analysis of Multimodal Group Actions in Meetings},
    year = {2003}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

This paper investigates the recognition of group actions in meetings. A framework is employed in which group actions result from the interactions of the individual participants. The group actions are modelled using different HMM-based approaches, where the observations are provided by a set of audio-visual features monitoring the actions of individuals. Experiments demonstrate the importance of taking interactions into account in modelling the group actions. It is also shown that the visual modality contains useful information, even for predominantly audio-based events, motivating a multimodal approach to meeting analysis.

Citations

7485	Maximum likelihood from incomplete data via the EM algorithm - Dempster, Laird, et al. - 1977
1357	Fundamentals of Speech Recognition - Rabiner, Juang - 1993
1075	Error bounds for convolutional codes and an asymptotically optimal algorithm - Viterbi - 1967
786	Adaptive background mixture models for real-time tracking - Stauffer, Grimson - 1999
346	Coupled Hidden Markov Models for Complex Action Recognition - Brand, Oliver, et al. - 1997
331	Statistical color models with application to skin detection - Jones, Rehg
319	A Bayesian computer vision system for modeling human interactions - Oliver, Rosario, et al. - 2000
319	Groups: Interaction and performance - McGrath - 1984
268	Visual recognition of american sign language using hidden markov models - Starner, Pentl - 1995
142	Audio-visual speech modelling for continuous speech recognition - Dupont, Luettin - 2000
135	The KidsRoom: a perceptually-based interactive and immersive story environment - Bobick, Intille, et al. - 1999
117	Interaction Process Analysis: a Method for the Study of Small Groups - Bales - 1950
103	Torch: a modular machine learning software library - Collobert, Bengio, et al. - 2002
96	Structure analysis of soccer video with hidden Markov models - Xie, Chang, et al. - 2002
91	Layered representations for learning and inferring office activity from multiple sensory channels. Computer Vision and Image Understanding - Oliver, Garg, et al. - 2004
90	Distributed Meetings: A meeting capture and broadcasting system - Cutler, Rui, et al. - 2002
75	Multi-Agent Event Recognition - Hongeng, Nevatia - 2001
72	A Hidden Markov Model Framework for Video Segmentation Using Audio and Image Features - Boreczky, Wilcox - 1998
72	Robust localization in reverberant rooms - DiBiase, Silverman, et al. - 2001
63	The Idiap Smart Meeting Room - Moore - 2002
60	Advances in automatic meeting record creation and access - Waibel, Bett, et al. - 2001
58	Couple hidden Markov models for modeling interacting processes - Brand - 1997
58	Modeling human interactions in meetings - McCowan, Bengio, et al. - 2003
57	Multi-stream adaptive evidence combination for noise robust ASR. Speech Communication - Morris, Hagen, et al. - 2001
56	Audio-visual automatic speech recognition: an overview - Potamianos, Neti, et al. - 2004
55	Content-Based Video Indexing of TV Broadcast News Using - Eickeler, Muller - 1999
54	Combining Multiple Estimators of Speaking Rate - Morgan, Fosler-Lussier - 1998
52	The Meeting Project at ICSI - Morgan, Baron, et al. - 2001
49	Modeling individual and group actions in meetings: a two-Layer HMM framework - Zhang, Gatica-Perez, et al. - 2004
43	A high-accuracy, low-latency technique for talker localization in reverberant environments using microphone arrays - DiBiase - 2000
43	The SIFT algorithm for fundamental frequency estimation - Markel - 1972
42	Automated posture analysis for detecting learner’s interest level - Mota, Picard - 2003
42	Detection of agreement vs. disagreement in meetings: training with unlabeled data - Hillard, Ostendorf, et al. - 2003
40	SYMLOG: A system for the multiple level observation of groups - BALES, COHEN - 1979
40	The acquisition and use of interaction behaviour models - Johnson, Galata, et al. - 1998
36	Action reaction learning: automatic visual analysis and synthesis of interactive behaviour - Jebara, Pentland - 1999
35	An asynchronous Hidden Markov Model for audio-visual speech recognition - Bengio - 2002
35	Dynamic Bayesian networks for meeting structuring - Dielmann, Renals
35	Spotting hotspots in meetings: Human judgments and prosodic cues - Wrede, Shriberg - 2003
32	Group discussion as interactive dialogue or serial monologue: The influence of group size - Fay, Garrod, et al. - 2000
32	Action Recognition in Meeting Scenarios Using Global Motion Features - Zobl, Wallhoff, et al. - 2003
31	Coordinating turn-taking with gaze - Novick, Hansen, et al. - 1996
29	The relationship between dialogue acts and hot spots in meetings - Wrede, Shriberg - 2003
28	Emotion Recognition by Speech Signals - Kwon, Chan, et al. - 2003
27	Microphone array speech recognition: Experiments on overlapping speech in meetings - Moore, McCowan - 2003
24	Speaking turns in small group interaction: A contextsensitive event sequence model - Parker - 1988
24	The role of audible and visible back-channel responses in interpersonal communication - Krauss, Garlock, et al. - 1977
23	Audio information access from meeting rooms - Renals, Ellis - 2003
23	J.M.: A mixed-state iparticle filter for multi-camera speaker tracking - Gatica-Perez, Lathoud, et al.
20	A simulation of small group discussion - Padilha, Carletta - 2002