Abstract not found

This article presents a biologically inspired model for motor skills imitation. The model is composed of modules whose functinalities are inspired by corresponding brain regions responsible for the control of movement in primates. These modules are high-level abstractions of the spinal cord, the primary and premotor cortexes (M1 and PM), the cerebellum, and the temporal cortex. Each module is modeled at a connectionist level. Neurons in PM respond both to visual observation of movements and to corresponding motor commands produced by the cerebellum. As such, they give an abstract representation of mirror neurons. Learning of new combinations of movements is done in PM and in the cerebellum. Premotor cortexes and cerebellum are modeled by the DRAMA neural architecture which allows learning of times series and of spatio-temporal invariance in multimodal inputs. The model is implemented in a mechanical simulation of two humanoid avatars, the imitator and the imitatee. Three types of sequences learning are presented: (1) learning of repetitive patterns of arm and leg movements; (2) learning of oscillatory movements of shoulders and elbows, using video data of a human demonstration; 3) learning of precise movements of the extremities for grasp and reach

This thesis presents a perceptual system for a humanoid robot that integrates abilities such as object localization and recognition with the deeper developmental machinery required to forge those competences out of raw physical experiences. It shows that a robotic platform can build up and maintain a system for object localization, segmentation, and recognition, starting from very little. What the robot starts with is a direct solution to achieving figure/ground separation: it simply `pokes around' in a region of visual ambiguity and watches what happens. If the arm passes through an area, that area is recognized as free space. If the arm collides with an object, causing it to move, the robot can use that motion to segment the object from the background. Once the robot can acquire reliable segmented views of objects, it learns from them, and from then on recognizes and segments those objects without further contact. Both low-level and high-level visual features can also be learned in this way, and examples are presented for both: orientation detection and affordance recognition, respectively.

... This paper develops active strategies for a robot to acquire visual experience through simple experimental manipulation. The experiments are oriented towards determining what parts of the environment are physically coherent -- that is, which parts will move together, and which are more or less independent. We argue that following causal chains of events out from the robot's body into the environment allows for a very natural developmental progression of visual competence, and relate this idea to results in neuroscience.

The identification of any form of social learning, imitation, copying or mimicry presupposes a notion of correspondence between two autonomous agents. Judging whether a behavior has been transmitted socially requires the observer to identify a mapping between the demonstrator and the imitator. If the demonstrator and imitator have similar bodies, e.g. are animals of the same species, of similar age, and of the same gender, then to a human observer an obvious correspondence is to map the corresponding body parts: left arm of demonstrator maps to left arm of imitator, right eye of demonstrator maps to right eye of imitator, tail of demonstrator maps to tail of imitator. There is also an obvious correspondence of actions: raising the left arm by the model corresponds to raising the left arm by the imitator, production of vocal signals by the model corresponds to the production of acoustically similar ones by the imitator, picking up a fruit by the demonstrator corresponds to picking up a fruit of the same type by the imitator. Furthermore, there is a correspondence in sensory experience: audible sounds, a touch, visible objects and colors, and so on evidently seem to be detected and experienced in similar ways. What to take as the correspondence seems relatively clear in this case. As humans, we are good at imitating and at recognizing such correspondences. It is also clear that most other animals, robots, and software programs may in fact generally fail to recognize any such correspondences. To judge a produced behavior to be a copy of an observed one, we require at least that it respects some such correspondence. The faithfulness or precision of the behavioral match can obviously vary, and no absolute cutoff or threshold exists defining success as opposed to failure of behavioral matching. But one can study the degree of success using various metrics and measures of correspondence (Nehaniv & Dautenhahn, 2001; also see below). Moreover, it turns out that the “obvious” correspondences between similar bodies mentioned above are not the only ones possible. Consider a human imitating another one that is facing her: if the demonstrator raises her left arm, should the imitator raise her own left arm? Or should she raise her right, to make a "mirror image" of the demonstrator's actions? If the demonstrator picks up a brush, should an imitator pick up the same brush? Or just another brush of the same type? If the demonstrator opens a container to get at chocolate inside, should the imitator open a similar container in the same way – e.g. by unwrapping but not tearing the surrounding paper?, or is it enough just to open the container somehow? The different possible answers to these questions presuppose different correspondences. If a child watches a teacher solving subtraction problems in arithmetic, and then solves for the first time similar but not identical problems on its own, social learning has occurred. But what type of correspondence is at work here? In China and Japan, the ideographic character for “to imitate” also means “to learn” or “to study”. By going through the motions of an algorithm for solving sample problems, students everywhere are able to learn how to solve similar ones, of course without necessarily gaining understanding of why the procedures they have learned work. In this chapter, for lack of a better term, we shall use the word “imitator” to refer to any autonomous agent performing a candidate behavioral match. The use of this word here does not entail any particular mechanism of matching or any particular type of social learning. In what follows, we shall describe how different matching phenomena arise depending on the criteria employed in generating the behavior of the imitator. For example, goal emulation, stimulus enhancement, mimicry, and so on, will all be cast as solutions to correspondence problems with different particular selection criteria.

Introduction This chapter presents the agent-based perspective on imitation. In this perspective, imitation is best considered as the behavior of an autonomous agent in relation to its environment, including other autonomous agents. We argue that such a perspective helps unfold the full potential of research on imitation and helps in identifying challenging and important research issues. We first explain the agent-based perspective and then discuss it in the context of particular research issues in studies with animals and artifacts, with reference to chapters presented in this book. At the end of the chapter we briefly introduce the individual contributions to this book and provide a roadmap that helps the reader in navigating through the exciting and highly interwoven themes that are presented in this book. In order to focus discussions, we explain the agent-based perspective with particular consideration of the correspondence

This article puts research on socially intelligent agents (SIA) in the broader context of how humans (and other primates) perceive and interact with the social world. Phylogenetic (evolutionary) and ontogenetic (developmental) issues are discussed with respect to the social origin of primate and human intelligence and human culture. Implications for designing artifacts and for the evolvability of human societies are outlined. A theory of empathy is presented that is based on current research on the primate social brain. Research projects that investigate some of these issues are reviewed. I argue that Socially Intelligent Agents (SIA) research, although strongly linked to software and robotic engineering, goes beyond a software engineering paradigm: it can potentially serve as a paradigm for a science of social minds. A systematic and experimental investigation of human social minds and the way humans perceive the social world can result in truly social artifacts,...

Abstract. We present a psychophysical study of human arm movement imitation, and an approach to analyzing the resulting data, which is general enough to be applied to human or humanoid movement analysis. We describe a joint-space based segmentation and comparison algorithm that allows us to evaluate the performance of 11 different subjects performing a series of arm movement imitation tasks. The results provide analytical evidence for the strong interference effects of simultaneous rehearsal during observation. Additionally, the results also demonstrate that repeated imitation in these tasks did not affect the subjects ’ performance. 1

A strong correspondence has been repeatedly observed between actually performed and mentally imagined object rotation. This suggests an overlap in the brain regions involved in these processes. Functional neuroimaging studies have consistently revealed parietal and occipital cortex activity during dynamic visuospatial imagery. However, results concerning the involvement of higher-order cortical motor areas have been less consistent. We investigated if and when premotor structures are active during processing of a three-dimensional cube comparison task that requires dynamic visuospatial imagery. In order to achieve a good temporal and spatial resolution, single-trial functional magnetic resonance imaging (fMRI) and scalp-recorded event-related slow cortical potentials (SCPs) were recorded from the same subjects in two separate measurement sessions. In order to reduce inter-subject variability in brain activity due to individual differences, only male subjects (n � 13) with high task-specific ability were investigated. Functional MRI revealed consistent bilateral activity in the occipital (Brodmann area BA18/19) and parietal cortex (BA7), in lateral and medial premotor areas (BA6), the dorsolateral prefrontal cortex (BA9), and the anterior insular cortex. The time-course of SCPs indicated that task-related activity in these areas commenced approximately 550–650 ms after stimulus presentation and persisted until task completion. These results provide strong and consistent evidence that the human premotor cortex is involved in dynamic visuospatial imagery. © 2001 Academic Press

For the purposes of manipulation, we would like to know what parts of the environment are physically coherent ensembles -- that is, which parts will move together, and which are more or less independent. It takes a great deal of experience before this judgement can be made from purely visual information. This paper develops active strategies for acquiring that experience through experimental manipulation, using tight correlations between arm motion and optic flow to detect both the arm itself and the boundaries of objects with which it comes into contact. We argue that following causal chains of events out from the robot's body into the environment allows for a very natural developmental progression of visual competence, and relate this idea to results in neuroscience.