This paper reviews "socially interactive robots": robots for which social human-robot interaction is important. We begin by discussing the context for socially interactive robots, emphasizing the relationship to other research fields and the di#erent forms of "social robots". We then present a taxonomy of design methods and system components used to build socially interactive robots. Finally, we describe the impact of these these robots on humans and discuss open issues. An expanded version of this paper, which contains a survey and taxonomy of current applications, is available as a technical report[61].

We want to build robots capable of rich social interactions with humans, including natural communication and cooperation. This work explores how imitation as a social learning and teaching process may be applied to building socially intelligent robots, and summarizes our progress toward building a robot capable of learning how to imitate facial expressions from simple imitative games played with a human, using biologically inspired mechanisms. Our approach is heavily influenced by the ways human infants learn to communicate with their caregivers and understand the actions of others in intentional terms. Among the key ideas that we draw from work on the development of human social intelligence, the most crucial is the hypothesis that in human infants, imitative interactions, starting with facial mimicry, are a significant stepping-stone in developing appropriate social behavior, learning to predict other’s actions, and ultimately, understanding the intensions of others. 1

We present an approach to teach incrementally human gestures to a humanoid robot. The learning process consists of first projecting the movement data in a latent space and encoding the resulting signals in a Gaussian Mixture Model (GMM). We compare the performance of two incremental training procedures against a batch training procedure. Qualitative and quantitative evaluations are performed on data acquired from motion sensors attached to a human demonstrator and data acquired by kinesthetically demonstrating the task to the robot. We present experiments to show that these different modalities can be used to teach incrementally basketball officials ’ signals to a HOAP-3 humanoid robot. 1.

as a derivative of the Czech robota (forced labor). Limited to work too tedious or dangerous for humans, today’s robots weld parts on assembly lines, inspect nuclear plants, and explore other planets. Generally, robots are still far from achieving their fictional counterparts’ intelligence and flexibility. Humanoid robotics labs worldwide are working on creating robots that are one step closer to science fiction’s androids. Building a humanlike robot is a formidable engineering task requiring a combination of mechanical, electrical, and software engineering; computer architecture; and real-time control. In 1993, we began a project aimed at constructing a humanoid robot for use in exploring theories of human intelligence. 1,2 In addition to the relevant engineering, computer architecture, and real-time-control issues, we’ve had to address issues particular to integrated systems: What types of sensors should we use, and how should the robot interpret the data? How can the robot act deliberately to achieve a task and remain responsive to the environment? How can the system adapt to changing conditions and learn new tasks? Each humanoid robotics lab must address many of the same motor-control, perception, and machine-learning problems.

Human speech provides a natural and intuitive interface for both communicating with humanoid robots as well as for teaching them. In general, the acoustic pattern of speech contains three kinds of information: who the speaker is, what the speaker said, and how the speaker said it. This paper focuses on the question of recognizing affective communicative intent in robot-directed speech. We present an approach for recognizing four distinct prosodic patterns that communicate praise, prohibition, attention, and comfort to preverbal infants. These communicative intents are well matched to teaching a robot since praise, prohibition, and directing the robot’s attention to relevant aspects of a task, could be used by a human instructor to intuitively facilitate the robot’s learning process. We integrate this perceptual ability into our robot’s ”emotion ” system, thereby allowing a human to directly manipulate the robot’s affective state. This has a powerful organizing influence on the robot’s behavior, and will ultimately be used to socially communicate affective reinforcement. Communicative efficacy has been tested with people very familiar with the robot as well as with naive subjects.

This report reviews ``socially interactive robots'': robots for which social human-robot interaction is important. We begin by discussing the context for socially interactive robots, emphasizing the relationship to other research fields and the different forms of ``social robots''. We then present a taxonomy of design methods and system components used to build socially interactive robots. Following this taxonomy, we survey the current state of the art, categorized by use and application area. Finally, we describe the impact of these these robots on humans and discuss open issues. An abbreviated version of this report, which does not contain the application survey, is available as [T. Fong, I. Nourbakhsh, K. Dautenhahn, A survey of socially interactive robots, Robotics and Autonomous Systems 42 (3-4) (2003)].

A major challenge for the realization of intelligent robots is to supply them with cognitive abilities in order to allow ordinary users to program them easily and intuitively. One way of such programming is teaching work tasks by interactive demonstration. To make this effective and convenient for the user, the machine must be capable to establish a common focus of attention and be able to use and integrate spoken instructions, visual perceptions, and non-verbal clues like gestural commands. We report progress in building a hybrid architecture that combines statistical methods, neural networks, and finite state machines into an integrated system for instructing grasping tasks by man-machine interaction. The system combines the GRAVIS-robot for visual attention and gestural instruction with an intelligent interface for speech recognition and linguistic interpretation, and an modality fusion module to allow multi-modal task-oriented man-machine communication with respect to dextrous robot manipulation of objects. 1

Learning through imitation is a powerful and versatile method for acquiring new behaviors. In humans, a wide range of behaviors, from styles of social interaction to tool use, are passed from one generation to another through imitative learning. Although imitation evolved through Darwinian means, it achieves Lamarckian ends: it is a mechanism for the inheritance of acquired characteristics. Unlike trial-and-error-based learning methods such as reinforcement learning, imitation allows rapid learning.

Abstract: We argue that the direct experimental approaches to elucidate the architecture of higher brains may benefit from insights gained from exploring the possibilities and limits of artificial control architectures for robot systems. We present some of our recent work that has been motivated by that view and that is centered around the study of various aspects of hand actions since these are intimately linked with many higher cognitive abilities. As examples, we report on the development of a modular system for the recognition of continuous hand postures based on neural nets, the use of vision and tactile sensing for guiding prehensile movements of a multifingered hand, and the recognition and use of hand gestures for robot teaching. Regarding the issue of learning, we propose to view real-world learning from the perspective of data mining and to focus more strongly on the imitation of observed actions instead of purely reinforcement-based exploration. As a concrete example of such an effort we report on the status of an ongoing project in our lab in which a robot equipped with an attention system with

Abstract not found