DMCA
Using a Learned Qualitative State Representation ∗
Cached
BibTeX
@MISC{Mugan_usinga,
author = {Jonathan Mugan and Benjamin Kuipers and Jonathan Mugan and Benjamin Kuipers},
title = {Using a Learned Qualitative State Representation ∗},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
We present a method that allows an agent to learn a qualitative state representation that can be applied to reinforcement learning. By exploring the environment the agent is able to learn an abstraction that consists of landmarks that break the space into qualitative regions, and rules that predict changes in qualitative state. For each predictive rule the agent learns a context consisting of qualitative variables that predicts when the rule will be successful. The regions of this context in with the rule is likely to succeed serve as a natural goals for reinforcement learning. The reinforcement learning problems created by the agent are simple because the learned abstraction provides a mapping from the continuous input and motor variables to discrete states that aligns with the dynamics of the environment.
