R-IAC: Robust Intrinsically Motivated Exploration and Active Learning
| Venue: | IEEE Transactions on Autonomous Mental Development |
| Citations: | 11 - 6 self |
BibTeX
@ARTICLE{Baranès_r-iac:robust,
author = {Adrien Baranès and Pierre-yves Oudeyer},
title = {R-IAC: Robust Intrinsically Motivated Exploration and Active Learning},
journal = {IEEE Transactions on Autonomous Mental Development},
year = {},
pages = {2009}
}
OpenURL
Abstract
Abstract—Intelligent adaptive curiosity (IAC) was initially introduced as a developmental mechanism allowing a robot to self-organize developmental trajectories of increasing complexity without preprogramming the particular developmental stages. In this paper, we argue that IAC and other intrinsically motivated learning heuristics could be viewed as active learning algorithms that are particularly suited for learning forward models in unprepared sensorimotor spaces with large unlearnable subspaces. Then, we introduce a novel formulation of IAC, called robust intelligent adaptive curiosity (R-IAC), and show that its performances as an intrinsically motivated active learning algorithm are far superior to IAC in a complex sensorimotor space where only a small subspace is neither unlearnable nor trivial. We also show results in which the learnt forward model is reused in a control scheme. Finally, an open source accompanying software containing these algorithms as well as tools to reproduce all the experiments presented in this paper is made publicly available. Index Terms—Active learning, artificial curiosity, developmental robotics, exploration, intrinsic motivation, sensorimotor learning.







