Abstract

One of the most active areas of research in artificial intelligence is the study of learning methods by which “embedded agents ” can improve performance while acting in complex dynamic environments. An agent, or decision maker, is embedded in an environment when it receives information from, and acts on, that environment in an ongoing closed-loop interaction. An embedded agent has to make decisions under time pressure and uncertainty and has to learn without the help of an ever-present knowledgeable teacher. Although the novelty of this emphasis may be inconspicuous to a biologist, animals being the prototypical embedded agents, this emphasis is a significant departure from the more traditional focus in artificial intelligence on reasoning within circumscribed domains removed from the flow of real-world events. One consequence of the embedded agent view is the increasing interest in the learning paradigm called reinforcement learning (RL). Unlike the more widely studied supervised learning systems, which learn from a set of examples of correct input/output behavior, RL systems adjust their behavior with the goal of maximizing the frequency and/or magnitude of the reinforcing events they encounter over time. While the core ideas of modern RL come from theories of animal classical and instrumental

Citations

157	Neuronlike elements that can solve difficult learning control problems - Barto, Sutton, et al. - 1983
36	Reinforcement learning and adaptive critic methods - Barto - 1992
20	The Hedonistic Neuron: A Theory of - Klopf - 1982
14	Learning to act using real-time dynamic programming, artificial intelligence. Computat. Res. Interaction Agency 72(Special Volume - Barto, Bradtke, et al. - 1995
14	A theory of pavlovian conditioning - Rescorla, Wagner - 1972
11	Some learning tasks from a control perspective - Barto - 1991
10	Brain function and adaptive systems---A heterostatic theory - Klopf - 1972
1	A Model of How the Basal Ganglia Might Generate and Use Neural Signals that Predict Reinforcement, Workshop paper - Houk, Adams, et al. - 1994