A Survey of Robot Learning from Demonstration

A Survey of Robot Learning from Demonstration

Cached

Download Links

by Brenna D. Argall , Sonia Chernova , Manuela Veloso , Brett Browning

Citations:

BibTeX

@MISC{Argall_asurvey,
    author = {Brenna D. Argall and Sonia Chernova and Manuela Veloso and Brett Browning},
    title = {A Survey of Robot Learning from Demonstration},
    year = {}
}

Bookmark

OpenURL

Abstract

We present a comprehensive survey of robot Learning from Demonstration (LfD), a technique that develops policies from example state to action mappings. We introduce the LfD design choices in terms of demonstrator, problem space, policy derivation and performance, and contribute the foundations for a structure in which to categorize LfD research. Specifically, we analyze and categorize the multiple ways in which examples are gathered, ranging from teleoperation to imitation, as well as the various techniques for policy derivation, including matching functions, dynamics models and plans. To conclude we discuss LfD limitations and related promising areas for future research.

Citations

2827	Reinforcement Learning: An Introduction - Sutton, Barto - 1998
1430	The Elements of Statistical Learning - Hastie, Tibshirani, et al. - 2009
582	The Elements of - Hastie, Tibshirani, et al. - 2009
431	An introduction to variable and feature selection - Guyon, Elisseeff - 2003
370	Locally weighted learning - ATKESON, MOORE, et al. - 1997
248	S.: Robot learning from demonstration - Atkeson, Schaal - 1997
196	Learning by watching: Extracting reusable task knowledge from visual observation of human performance - Kuniyoshi, Inaba, et al. - 1994
143	Apprenticeship learning via inverse reinforcement learning - Abbeel, Ng - 2004
126	Constructive incremental learning from only local information - Schaal, Atkeson
110	Knowledge-based training of artificial neural networks for autonomous robot driving - Pomerleau - 1993
106	Autonomous helicopter flight via reinforcement learning - Ng, Kim, et al.
104	A.: Computational approaches to motor learning by imitation - Schaal, Ijspeert, et al.
97	Learning to fly - Sammut, Hurst, et al. - 1992
83	Movement imitation with nonlinear dynamical systems in humanoid robots - Ijspeert, Nakanishi, et al.
75	Imitation as a dual-route process featuring predictive and learning components: a biologically plausible computational model - Demiris, Hayes - 2002
75	Effective reinforcement learning for mobile robots - Smart, Kaelbling - 2002
71	Autonomous helicopter control using reinforcement learning policy search methods - Bagnell, Schneider
69	Smoothing by local regression: Principles and methods - Cleveland, Loader - 1995
66	M.: Maximum margin planning - Ratliff, Bagnell, et al. - 2006
61	Learning human arm movements by imitation: Evaluation of a biologically-inspired conectionist architecture - Billard, Mataric - 2001
59	Learning from demonstration and adaptation of biped locomotion. Robotics Autonomous Systems 47: 79–91 - Nakanishi, Morimoto, et al. - 2004
54	An application of reinforcement learning to aerobatic helicopter flight - Abbeel, Coates, et al. - 2007
53	Learning and interacting in humanrobot domains - Nicolescu, Mataric - 2001
52	Exploration and apprenticeship learning in reinforcement learning - Abbeel, Ng
51	Locally weighted projection regression: An o(n) algorithm for incremental real time learning in high dimensional space - Vijayakumar, Schaal
48	Skill acquisition from human demonstration using a Hidden Markov Model - Hovland, Sikka, et al. - 1996
46	Learning from Observation Using Primitives - Bentivegna - 2004
46	Recognizing Teleoperated Manipulations - Pook, Ballard - 1993
44	Robots that imitate humans - Breazeal, Scassellati
43	Learning rhythmic movements by demonstration using nonlinear oscillators - Ijspeert, Nakanishi, et al.
41	Teaching robots by moulding behavior and scaffolding the environment - Nehaniv, L, et al. - 2004
39	Incremental learning of gestures by imitation in a humanoid robot - Calinon, Billard - 2007
38	C.: Tutelage and socially guided robot learning - Lockerd, Breazeal - 2004
38	Common metrics for human-robot interaction - Steinfeld, Fong, et al. - 2006
38	Hierarchical attentive multiple models for execution and recognition of actions - Demiris, Khadhouri
37	Robot programming by demonstration, in - Billard, Calinon, et al.
37	Boosting structured prediction for imitation learning - Ratliff, Bradley, et al. - 2007
36	Mobile robot programming using natural language - Lauria, Bugmann, et al. - 2002
36	C.: Accelerating reinforcement learning through implicit imitation - Price, Boutilier - 2003
35	S.: Primitive-based movement classification for humanoid imitation - Jenkins, Matarić, et al.
34	Learning procedural knowledge through observation - Lent, Laird - 2001
33	O.: Dogged learning for robots - Grollman, Jenkins
32	Programmable pattern generators - Schaal, Sternad - 1998
31	Maximum entropy inverse reinforcement learning - Ziebart, Maas, et al.
29	The correspondence problem - Nehaniv, Dautenhahn
29	Interactive robot task training through dialog and demonstration - Rybski, Yoon, et al. - 2007
28	Robot programming by human demonstration: Adaptation and inconsistency in constrained motion - Delson, West - 1996
26	Discriminative and adaptive imitation in uni-manual and bi-manual tasks. Robotics and Autonomous Systems, 54(5), 370–384. Robot Bizzi - Billard, Calinon, et al. - 2006
26	C.: Reinforcement learning with human teachers: evidence of feedback and guidance with implications for learning performance - Thomaz, Breazeal
23	Making Reinforcement Learning Work on Real Robots - Smart - 2002