Multimodal human computer interaction: A survey

Multimodal human computer interaction: A survey (2005)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Alejandro Jaimes , Nicu Sebe

Citations:

38 - 2 self

BibTeX

@INPROCEEDINGS{Jaimes05multimodalhuman,
    author = {Alejandro Jaimes and Nicu Sebe},
    title = {Multimodal human computer interaction: A survey},
    booktitle = {},
    year = {2005},
    pages = {15--21},
    publisher = {}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

In this paper we review the major approaches to Multimodal Human Computer Interaction, giving an overview of the field from a computer vision perspective. In particular, we focus on body, gesture, gaze, and affective interaction (facial expression recognition and emotion in audio). We discuss user and task modeling, and multimodal fusion, highlighting challenges, open issues, and emerging applications for Multimodal Human Computer Interaction (MMHCI) research.

Citations

1274	The Design of Everyday Things - Norman - 1998
1180	Fundamentals of speech recognition - Rabiner - 1993
1012	Affective Computing - Picard - 2000
570	Face recognition: A literature survey - Zhao, Chellappa, et al. - 2003
529	Some Computer Science Issues in Ubiquitous Computing - Weiser - 1993
456	The visual analysis of human movement: A survey, Computer Vision and Image Understanding (CVIU - Gavrila
437	Detecting faces in images: a survey - Yang, Kriegman, et al.
402	The Psychology of Human-Computer Interaction. Lawrence Erlbaum - Card, Moran, et al. - 1983
343	Computer Interaction - Dix, Finlay, et al. - 1993
319	put-that-there”: Voice and gesture at the graphics interface - Bolt - 1980
316	Bricks: laying the foundations for graspable user interfaces - Fitzmaurice, Ishii, et al.
304	The recognition of human movement using temporal templates - Bobick, Davis
303	Hand and Mind: What Gestures Reveal about Thought - McNeill - 1996
303	A survey of computer vision-based human motion capture - Moeslund, Granum - 2001
301	The Logic of Typed Feature Structures - Carpenter - 1992
276	Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review - Pavlovic, Sharma, et al.
224	The open agent architecture: a framework for building distributed software systems - Martin, Cheyer, et al. - 1999
222	analysis, interpretation, and recognition of facial expressions - Essa, Pentland - 1997
215	Rules of Play: Game Design Fundamentals - Salen, Zimmerman - 2003
213	QuickSet: Multimodal interaction for distributed applications - Cohen, Johnston, et al. - 1997
211	Tracking and recognizing rigid and non-rigid facial motion using local parametric models of image motion - Black, Yacoob - 1995
207	Automatic analysis of facial expressions: the state of the art - Pantic, Rothkrantz - 2000
149	J: Toward Machine Emotional Intelligence: Analysis of Affective Physiological State - RW, Vyzas, et al.
136	Ten myths of multimodal interaction - Oviatt - 1999
135	Information Fusion in Biometrics - Ross, Jain
123	A survey on visual surveillance of object motion and behaviors - Hu, Tan, et al. - 2004
120	Face Detection: A Survey - Hjelmas - 2001
116	Recognizing human facial expressions from long image sequences using optical flow - Yacoob, Davis - 1996
109	T: Recent Developments in Human Motion Analysis - Wang, Hu, et al.
105	K : "The Use of Eye Movements in HumanComputer Interaction Techniques: What You Look At is What You Get - Jacob - 1991
104	Automatic facial expression analysis: a survey - Fasel, Luettin - 2003
104	Mutual Disambiguation of Recognition Errors in a Multimodal Architecture - Oviatt - 1999
102	Designing the User Interface for Multimodal Speech and Gesture Applications: State-of-the-Art - Oviatt
101	The emotion probe: Studies of motivation and attention - Lang - 1995
99	Recognition of facial expression from optical flow - Mase, Pentland - 1991
98	Toward an affect-sensitive multimodal human-computer interaction - Pantic, Rothkrantz
97	Frameworks for Representing Knowledge in the Psychology of Computer Vision - Minsky - 1975
94	Leonardo's Laptop — Human Needs and the New Computing Technologies - Shneiderman - 2002
93	Toward the simulation of emotion in synthetic speech: A review of the literature on human vocal emotion - Murray, Arnott - 1993
91	eigenlips” for robust speech recognition - Bregler, Konig - 1994
91	Noncommand user interfaces - Nielsen - 1993
90	Automatic analysis of multimodal group actions in meetings - McCowan, Gatica-Perez, et al.
83	Direct manipulation for comprehensible, predictable and controllable user interfaces - Shneiderman - 1997
78	Facial expression recognition from video sequences: temporal and static modeling - Cohen, Sebe, et al. - 2003
73	A unified approach to coding and interpretting faces - Lanitis, Taylor, et al. - 1995
72	Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis - Ambady, Rosenthal - 1992
71	A survey of socially interactive robots,” Robotics and autonomous systems - Fong, Nourbakhsh, et al. - 2003
66	Multimodal interfaces that process what comes naturally - Oviatt, Cohen
65	Socially aware computation and communication - Pentland - 2005
64	On the integration of auditory and visual parameters in an HMM-based ASR,” in Speechreading by Humans and Machines - Adjoudani, Benoît - 1996