Automatic Analysis of Multimodal Group Actions in Meetings

Automatic Analysis of Multimodal Group Actions in Meetings (2003)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Iain McCowan , Daniel Garcia-Perez , Samy Bengio , Guillaume Lathoud , Mark Barnard , Dong Zhang

Citations:

118 - 28 self

BibTeX

@MISC{McCowan03automaticanalysis,
    author = {Iain McCowan and Daniel Garcia-Perez and Samy Bengio and Guillaume Lathoud and Mark Barnard and Dong Zhang},
    title = {Automatic Analysis of Multimodal Group Actions in Meetings},
    year = {2003}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

This paper investigates the recognition of group actions in meetings. A framework is employed in which group actions result from the interactions of the individual participants. The group actions are modelled using different HMM-based approaches, where the observations are provided by a set of audio-visual features monitoring the actions of individuals. Experiments demonstrate the importance of taking interactions into account in modelling the group actions. It is also shown that the visual modality contains useful information, even for predominantly audio-based events, motivating a multimodal approach to meeting analysis.

Citations

7510	Maximum likelihood from incomplete data via the em algorithm - Dempster, Laird, et al. - 1976
1358	Fundamentals of Speech Recognition - Rabiner, Juang - 1993
1077	Error bounds for convolutional codes and an asymptotically optimum decoding algorithm - Viterbi - 1967
794	Adaptive background mixture models for real-time tracking - Stauffer, Grimson - 1999
347	Coupled hidden Markov models for complex action recognition - Brand, Oliver, et al. - 1997
332	Statistical color models with application to skin detection - Jones, Rehg - 2002
321	A Bayesian computer vision system for modelling human interactions - Oliver, Rosario, et al. - 2000
320	Groups: Interaction and Performance - McGrath - 1984
269	Visual recognition of american sign language using hidden markov models - Starner, Pentland - 1995
142	Audio-visual speech modeling for continuous speech recognition - Dupont, Luettin - 2000
136	KidsRoom: a perceptually-based interactive and immersive story environment, MIT Media Laboratory perceptual Computing Section - Bobick, Intille, et al. - 1996
116	Interaction Process Analysis: A Method for the Study of Small Groups - Bales - 1950
104	Torch: A modular machine learning software library - Collobert, Bengio, et al.
96	Structure analysis of soccer video with hidden Markov models - Xie, Chang, et al. - 2002
91	Layered representations for learning and inferring office activity from multiple sensory channels - Oliver, Garg, et al. - 2004
90	Distributed Meetings: A meeting capture and broadcasting system - Cutler, Rui, et al. - 2002
75	Multi-Agent Event Recognition - Hongeng, Nevatia - 2001
73	A hidden Markov model framework for video segmentation using audio and image features - Boreczky, Wilcox - 1998
72	Robust localization in reverberant rooms - DiBiase, Silverman, et al. - 2001
63	The Idiap Smart Meeting Room - Moore - 2002
60	Advances in automatic meeting record creation and access - Waibel, Bett, et al. - 2001
58	Audio-visual automatic speech recognition: An overview - Potamianos, Neti, et al.
58	Couple hidden Markov models for modeling interacting processes - Brand - 1997
57	Multi-stream adaptive evidence combination for noise robust ASR. Speech Communication - Morris, Hagen, et al. - 2001
57	Modeling human interaction in meetings - McCowan, Bengio, et al. - 2003
55	Content-Based Video Indexing of TV Broadcast News Using - Eickeler, Muller - 1999
54	Combining multiple estimators of speaking rate - Morgan, Fosler-Lussier - 1998
52	The Meeting Project at ICSI - Morgan, Baron, et al. - 2001
49	Modeling individual and group actions in meetings: a two-Layer HMM framework - Zhang, Gatica-Perez, et al. - 2004
43	A high-accuracy, low-latency technique for talker localization in reverberant environments using microphone arrays - DiBiase - 2000
43	The SIFT algorithm for fundamental frequency estimation - Markel - 1972
42	Detection of agreement vs. disagreement in meetings: training with unlabeled data - Hillard, Ostendorf, et al. - 2003
41	Automated posture analysis for detecting learners interest level - Mota, Picard - 2003
40	SYMLOG: A system for the multiple level observation of groups - BALES, COHEN - 1979
40	The acquisition and use of interaction behaviour models - Johnson, Galata, et al. - 1998
36	Action reaction learning: automatic visual analysis and synthesis of interactive behaviour - Jebara, Pentland - 1999
35	An asynchronous Hidden Markov Model for audio-visual speech recognition - Bengio - 2002
35	Dynamic Bayesian networks for meeting structuring - Dielmann, Renals
35	Spotting hotspots in meetings: Human judgments and prosodic cues - Wrede, Shriberg - 2003
32	Group discussion as interactive dialogue or serial monologue: The influence of group size - Fay, Garrod, et al. - 2000
32	Action Recognition in Meeting Scenarios Using Global Motion Features - Zobl, Wallhoff, et al. - 2003
31	Coordinating turn-taking with gaze - Novick, Hansen, et al. - 1996
29	The relationship between dialogue acts and hot spots in meetings - Wrede, Shriberg - 2003
28	Emotion Recognition by Speech Signals - Kwon, Chan, et al. - 2003
27	Microphone array speech recognition: Experiments on overlapping speech in meetings - Moore, McCowan - 2003
24	Speaking turns in small group interaction: A contextsensitive event sequence model - Parker - 1988
24	The role of audible and visible back-channel responses in interpersonal communication - Krauss, Garlock, et al. - 1977
23	Audio information access from meeting rooms - Renals, Ellis - 2003
23	J.M.: A mixed-state iparticle filter for multi-camera speaker tracking - Gatica-Perez, Lathoud, et al.
20	A simulation of small group discussion - Padilha, Carletta - 2002