DMCA
On the significance of Markov decision processes (1997)
| Venue: | Proceedings of ICANN 97 |
| Citations: | 12 - 0 self |
BibTeX
@INPROCEEDINGS{Sutton97onthe,
author = {Richard S. Sutton},
title = {On the significance of Markov decision processes},
booktitle = {Proceedings of ICANN 97},
year = {1997},
pages = {273--282},
publisher = {Springer}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Formulating the problem facing an intelligent agent as a Markov decision process (MDP) is increasingly common in artificial intelligence, reinforcement learning, artificial life, and artificial neural networks. In this short paper we examine some of the reasons for the appeal of this framework. Foremost among these are its generality, simplicity, and emphasis on goal-directed interaction between the agent and its environment. MDPs may be becoming a common focal point for different approaches to understanding the mind. Finally, we speculate that this focus may be an enduring one insofar as many of the efforts to extend the MDP framework end up bringing a wider class of problems back within it.
