• Documents
  • Authors
  • Tables
  • Log in
  • Sign up
  • MetaCart
  • DMCA
  • Donate

CiteSeerX logo

Advanced Search Include Citations
Advanced Search Include Citations

Reinforcement learning in autonomous robots: an empirical investigation of the role of emotions (1999)

by S D Gadanho
Add To MetaCart

Tools

Sorted by:
Results 1 - 10 of 20
Next 10 →

Intelligence by Design: Principles of Modularity and Coordination for Engineering Complex Adaptive Agents

by Joanna Joy Bryson , 2001
"... All intelligence relies on search --- for example, the search for an intelligent agent's next action. Search is only likely to succeed in resource-bounded agents if they have already been biased towards finding the right answer. In artificial agents, the primary source of bias is engineering. T ..."
Abstract - Cited by 81 (27 self) - Add to MetaCart
All intelligence relies on search --- for example, the search for an intelligent agent's next action. Search is only likely to succeed in resource-bounded agents if they have already been biased towards finding the right answer. In artificial agents, the primary source of bias is engineering. This dissertation

Learning Behavior-Selection by Emotions and Cognition in a Multi-Goal Robot Task

by Sandra Clara Gadanho - JOURNAL OF MACHINE LEARNING RESEARCH , 2003
"... The existence of emotion and cognition as two interacting systems, both with important roles in decision-making, has been recently advocated by neurophysiological research (LeDoux, 1998, Damasio, 1994). Following that idea, this paper presents the ALEC agent architecture which has both emotive an ..."
Abstract - Cited by 26 (0 self) - Add to MetaCart
The existence of emotion and cognition as two interacting systems, both with important roles in decision-making, has been recently advocated by neurophysiological research (LeDoux, 1998, Damasio, 1994). Following that idea, this paper presents the ALEC agent architecture which has both emotive and cognitive learning, as well as emotive and cognitive decision-making capabilities to adapt to real-world environments. These two learning mechanisms embody very different properties which can be related to those of natural emotion and cognition systems. The reported

Robot Learning Driven by Emotions

by Sandra Clara Gadanho, John Hallam , 2001
"... The adaptive value of emotions in nature indicates that they might also be useful in artificial creatures. Experiments were carried out to investigate this hypothesis in a simulated learning robot. For this purpose, a non-symbolic emotion model was developed that takes the form of a recurrent art ..."
Abstract - Cited by 19 (3 self) - Add to MetaCart
The adaptive value of emotions in nature indicates that they might also be useful in artificial creatures. Experiments were carried out to investigate this hypothesis in a simulated learning robot. For this purpose, a non-symbolic emotion model was developed that takes the form of a recurrent artificial neural network where emotions both depend on and influence the perception of the state of the world. This emotion

Emotion-triggered Learning in Autonomous Robot Control

by Sandra Clara Gadanho, John Hallam - CYBERNETICS AND SYSTEMS , 2001
"... The fact that emotions are considered to be essential to human reasoning suggests that they might play an important role in autonomous robots as well. In particular, the decision of when to interrupt on-going behaviour is often associated with emotions in natural systems. The question under exami ..."
Abstract - Cited by 13 (3 self) - Add to MetaCart
The fact that emotions are considered to be essential to human reasoning suggests that they might play an important role in autonomous robots as well. In particular, the decision of when to interrupt on-going behaviour is often associated with emotions in natural systems. The question under examination here is whether this role of emotions can be useful for a robot which adapts to its environment. For this purpose, an emotion model was developed and integrated in a reinforcement learning framework. Robot experiments were done to test an emotion-dependent mechanism for the automatic detection of the relevant events of a learning task, against more traditional approaches. Experimental results are presented that conrm that emotions can be useful in this role, specically by improving the efficiency of the learning algorithm.

The study of sequential and hierarchical organisation of behaviour via artificial mechanisms of action selection

by Joanna Joy Bryson - University of Edinburgh , 2000
"... One of the defining features of intelligent behaviour is the ordering of individual expressed actions into coherent, apparently rational patterns. Psychology has long assumed that hierarchical and sequential structures internal to the intelligent agent underlie this expression. Recently these assump ..."
Abstract - Cited by 13 (7 self) - Add to MetaCart
One of the defining features of intelligent behaviour is the ordering of individual expressed actions into coherent, apparently rational patterns. Psychology has long assumed that hierarchical and sequential structures internal to the intelligent agent underlie this expression. Recently these assumptions have been challenged by claims that behaviour controlled by such structures is necessarily rigid, brittle, and incapable of reacting quickly and opportunistically to changes in the environment (Hendriks-Jansen 1996, Goldfield 1995, Brooks 1991a). This dissertation is intended to support the hypothesis that sequential and hierarchical structures are necessary to intelligent behaviour, and to refute the above claims of their impracticality. Three forms of supporting evidence are provided: • a demonstration in the form of experimental results in two domains that structured intelligence can lead to robust and reactive behaviour, • a review of recent research results and paradigmatic trends within artificial intelligence, and • a similar examination of related research in natural intelligence.
(Show Context)

Citation Context

...e or lower to wag high or low. 118sCHAPTER 5. ANALYSIS: ACTION SELECTION IN NATURE 119 proposing independent hormonal or emotional systems for affecting behaviour or learning (see for a recent review =-=Gadanho 1999-=-, pp. 50–54), and from a biological perspective the limbic system has long been considered a parallel brain mechanism for determining mood and emotion. Exploiting Thórisson’s system is even simpler, b...

Making modularity work: Combining memory systems and intelligent processes in a dialog agent

by Joanna Bryson - AISB’00 Symposium on Designing a Functioning Mind , 2000
"... One of the greatest obstacles to designing a mind is the complexity of integrating different process types, time frames and representational structures. This paper describes a methodology for addressing this obstacle, Behavior Oriented Designed (BOD), and explains it in the context of creating an ag ..."
Abstract - Cited by 10 (9 self) - Add to MetaCart
One of the greatest obstacles to designing a mind is the complexity of integrating different process types, time frames and representational structures. This paper describes a methodology for addressing this obstacle, Behavior Oriented Designed (BOD), and explains it in the context of creating an agent capable of natural language dialogue. 1
(Show Context)

Citation Context

...ve as specialized mechanisms for focusing attention, including by deactivating large sections of the cortex (Damasio, 1999). They can also provide complex reinforcement signals for learning behavior (=-=Gadanho, 1999-=-). These functional considerations can be addressed from within BOD. However, a specialized system for mimicking more exactly human or animal emotions would clearly be useful for certain kinds of soci...

A biologically inspired architecture for an autonomous and social robot,” Autonomous Mental Development

by María Malfaz , Álvaro Castro , Ramón Barber , Miguel A Salichs - IEEE Transactions on , 2011
"... Abstract-Lately, lots of effort has been put into the construction of robots able to live among humans. This fact has favored the development of personal or social robots, which are expected to behave in a natural way. This implies that these robots could meet certain requirements, for example: to ..."
Abstract - Cited by 6 (0 self) - Add to MetaCart
Abstract-Lately, lots of effort has been put into the construction of robots able to live among humans. This fact has favored the development of personal or social robots, which are expected to behave in a natural way. This implies that these robots could meet certain requirements, for example: to be able to decide their own actions (autonomy), to be able to make deliberative plans (reasoning), or to be able to have an emotional behavior in order to facilitate human-robot interaction. In this paper, the authors present a bio-inspired control architecture for an autonomous and social robot, which tries to accomplish some of these features. In order to develop this new architecture, authors have used as a base a prior hybrid control architecture (AD) that is also biologically inspired. Nevertheless, in the later, the task to be accomplished at each moment is determined by a fix sequence processed by the Main Sequencer. Therefore, the Main Sequencer of the architecture coordinates the previously programmed sequence of skills that must be executed. In the new architecture, the Main Sequencer is substituted by a decision making system based on drives, motivations, emotions, and self-learning, which decides the proper action at every moment according to robot's state. Consequently, the robot improves its autonomy since the added decision making system will determine the goal and consequently the skills to be executed. A basic version of this new architecture has been implemented on a real robotic platform. Some experiments are shown at the end of the paper.
(Show Context)

Citation Context

...ons in the cognitive model to approximate the human mind was necessary [7]. Later, near the mid Nineties, Antonio Damasio published Descartes’s Error [8]. His studies proved that damage to the brain’s emotional system caused the patient to make poor judgments despite intact logical reasoning skills. As a consequence, the positive role of human emotions in cognition started to gain prominence among a group of researchers from the scientific community. Later, other studies showed that emotions have influence on many cognitive mechanisms, such as memory, attention, perception, and reasoning [9], [10], [11], [12]. Besides, emotions play a very important role in survival, social interaction and learning of new behaviors [13], [14], [15]. Therefore, in recent years, the role of emotional mechanisms in natural and artificial cognitive architectures, in particular in cognitive robotics, has been considered. According to [16], in relation to the main question: do robots need emotions? many researchers have answered positively, mainly considering the two aspects of emotion: the external (social) one and the internal (individual) one. It seems to be obvious that in humanrobot social interaction, ...

Simplifying the design of human-like behaviour: Emotions as durative dynamic state for action selection

by Joanna J. Bryson, Emmanuel Tanguy - International Journal of Synthetic Emotions , 2009
"... Human intelligence requires decades of full-time training before it can be reliably utilised in modern economies. In contrast, AI agents must be made reliable but interesting in relatively short order. Realistic emotion representations are one way to ensure that even relatively simple specifications ..."
Abstract - Cited by 5 (4 self) - Add to MetaCart
Human intelligence requires decades of full-time training before it can be reliably utilised in modern economies. In contrast, AI agents must be made reliable but interesting in relatively short order. Realistic emotion representations are one way to ensure that even relatively simple specifications of agent behaviour will be expressed with engaging variation, and that social and temporal contexts can be tracked and responded to appropriately. We describe here a representation system for maintaining an interacting set of durative states in order to replicate emotional control. Our model, the Dynamic Emotion Representation (DER) integrates emotional responses and keeps track of emotion intensities changing over time. The developer can specify an interacting network of emotional states with appropriate onsets, sustains and decays. The levels of these states can be used as input for action selection, including emotional expression. We present both a general representational framework and a specific instance of a DER network constructed for a virtual character. The character’s DER uses three types of emotional state as classified by duration timescales, in keeping with current emotional theory. We demonstrate the system with a virtual actor. We also demonstrate how even a simplified version of this representation can improve goal arbitration in autonomous agents. 1
(Show Context)

Citation Context

...tility for affect has focussed on it as a sort of reward accumulator. Emotions serve as additional pieces of internal state to assist in learning and applying action selection policies (Hiller, 1995; =-=Gadanho, 1999-=-; Zadeh et al., 2006; Broekens et al., 2007). Some of this research has been inspired partly by the controversial somatic marker hypothesis (Tomb et al., 2002). Several elaborate architectures have be...

Improved Animal-Like Maintenance of Homeostatic Goals via Flexible Latching ∗

by Joanna J. Bryson
"... Artificial cognitive systems sometimes neglect the impact on action selection of natural durativestate mechanisms like emotions and drives. These chemically-regulated motivation systems assist natural action selection through temporarily focusing an agent’s behavioural attention on particular proble ..."
Abstract - Cited by 3 (3 self) - Add to MetaCart
Artificial cognitive systems sometimes neglect the impact on action selection of natural durativestate mechanisms like emotions and drives. These chemically-regulated motivation systems assist natural action selection through temporarily focusing an agent’s behavioural attention on particular problems. This can improve efficiency by avoiding dithering, but taken to extremes can be inefficient in ways that seem cognitively improbable for mammal-level intelligence. This article demonstrates a flexible latching method that provides appraisal-based sensitivity to interruption, allowing reassessment of the current focus of attention. This drastically improves efficiency in handling multiple competing goals at the cost of a surprisingly small amount of extra cognitive complexity.

The impact of durative state on action selection

by Joanna J. Bryson - Proceedings of the AAAI Spring Symposium on Emotion, Personality, and Social Behavior
"... Chemical / hormonal diffusion is the phylogenetically oldest form of biological action selection. In this paper we argue its persistence in higher animals is a consequence of its utility in solving problems of dithering between high-level goals. Chemical state underlying emotions and drives provides ..."
Abstract - Cited by 2 (2 self) - Add to MetaCart
Chemical / hormonal diffusion is the phylogenetically oldest form of biological action selection. In this paper we argue its persistence in higher animals is a consequence of its utility in solving problems of dithering between high-level goals. Chemical state underlying emotions and drives provides greater persistence more easily than the electrical action potential systems underlying the fine details of action sequencing, while also providing periodicity and transience not easily afforded in longer-term learning systems such as synaptic plasticity. We argue that artificial real-time autonomous systems require similar systems, and review our own efforts and approaches to providing these.
(Show Context)

Citation Context

...tility for affect have focussed on it as a sort of reward accumulator. Emotions serve as additional pieces of internal state to assist in learning and applying action selection policies (Hiller 1995; =-=Gadanho 1999-=-; Zadeh, Shouraki, & Halavati 2006; Broekens, Kosters, & Verbeek 2007). Some of this research has been inspired partly by the controversial somatic marker hypothesis (Tomb et al. 2002)Several elaborat...

Powered by: Apache Solr
  • About CiteSeerX
  • Submit and Index Documents
  • Privacy Policy
  • Help
  • Data
  • Source
  • Contact Us

Developed at and hosted by The College of Information Sciences and Technology

© 2007-2019 The Pennsylvania State University