We present a novel evolutionary approach to robotic control of a real robot based on genetic programming (GP). Our approach uses genetic programming techniques that manipulate machine code to evolve control programs for robots. This variant of GP has several advantages over a conventional GP system, such as higher speed, lower memory requirements and better real time properties. Previous attempts to apply GP in robotics use simulations to evaluate control programs and have difficulties with learning tasks involving a real robot. We present an on-line control method that is evaluated in two different physical environments and applied to two tasks using the Khepera robot platform: obstacle avoidance and object following. The results show fast learning and good generalization. 1 Introduction Autonomous robots or agents have a large potential for the future. There are many situations where they could relieve humans from dangerous, difficult or monotone tasks. We are convinced that many...
|
941
|
Reinforcement learning: A survey
– Kaelbling, Littman, et al.
- 1996
|
|
713
|
Genetic Programming
– Koza
- 1992
|
|
263
|
Evolving 3D Morphology and Behavior by Competition
– Sims
- 1994
|
|
205
|
Explorations in evolutionary robotics
– Cliff, Harvey, et al.
- 1993
|
|
158
|
Evolution of homing navigation in a real mobile robot
– Floreano, Mondada
- 1996
|
|
132
|
Automatic creation of an autonomous agent: Genetic of a neural-network driven robot
– Floreano, Mondada
- 1994
|
|
132
|
Learning sequential decision rules using simulation models and competition
– Grefenstette, Ramsey, et al.
- 1990
|
|
132
|
Mobile robot miniaturization: A tool for investigation in control algorithms
– Mondada, Franzi, et al.
- 1993
|
|
116
|
Complexity compression and evolution
– Nordin, Banzhaf
- 1995
|
|
112
|
Designing Emergent Behaviors: From Local Interactions to Collective Intelligence
– Matari'c
- 1992
|
|
100
|
Artificial life and real robots
– Brooks
- 1992
|
|
90
|
A compiling genetic programming system that directly manipulates the machine code
– Nordin
- 1994
|
|
87
|
The evolution of mental models
– Teller
- 1994
|
|
72
|
A Study of Reproduction in Generational and Steady-State Genetic Algorithms. Foundations of Genetic Algorithms
– Syswerda
- 1991
|
|
61
|
Neural Darwinism
– Edelman
- 1987
|
|
58
|
The Harpy Speech Understanding System
– Lowerre, Reddy
- 1980
|
|
54
|
Computational neuroethology: A provisional manifesto
– Cliff
- 1991
|
|
43
|
An incremental approach to developing intelligent neural network controllers for robots
– Meeden
- 1996
|
|
34
|
The automatic generation of Plans for a Mobile Robot via Genetic Programming with Automatically defined Functions
– Handley
- 1994
|
|
33
|
Automatic generation of programs for crawling and walking
– Spencer
- 1994
|
|
29
|
Evolution of an artificial neural network based autonomous land vehicle controller
– Baluja
- 1996
|
|
27
|
Learning to select useful landmarks
– Greiner, Isukapalli
- 1996
|
|
26
|
Behavior Analysis and Training - A Methodology for Behavior Engineering
– Colombetti, Dorigo, et al.
- 1996
|
|
21
|
Programmatic compression of images and sound
– Nordin, Banzhaf
- 1996
|
|
20
|
Rapid, safe, and incremental learning of navigation strategies
– Millan
- 1996
|
|
18
|
Not bumping into things
– Reynolds
- 1988
|
|
17
|
Image registration by genetic search
– Fitzpatrick, Grefenstette, et al.
- 1984
|
|
16
|
Vehicles
– Braitenberg
- 1984
|
|
14
|
Evolving Turing Complete Programs for a Register Machine with Self-Modifying Code
– Nordin, Banzhaf
- 1995
|
|
9
|
The effect of extensive use of the mutation operator on generalization in genetic programming using sparse data sets
– Banzhaf, Francone, et al.
- 1996
|
|
9
|
Generating adaptive behavior using function regression within genetic programming and a real robot
– Banzhaf, Nordin, et al.
- 1997
|
|
7
|
Evolving real-time behavior modules for a real robot with genetic programming
– Olmer, Banzhaf, et al.
- 1996
|
|
7
|
Evolution of Obstacle Avoidance Behavior
– Reynolds
- 1994
|
|
6
|
Real time evolution of behavior and a world model for a miniature robot using genetic programming
– Nordin, Banzhaf
- 1995
|
|
4
|
Putting INK into a BIRo: A Discussion of Problem Domain Knowledge for Evolutionary Robotics
– Fraser, Rush
- 1994
|
|
2
|
Explicitly Defined Introns in Genetic Programming
– Nordin, Francone
- 1995
|
|
2
|
The SPARC Architecture Manual
– Sparc
- 1991
|
|
1
|
Learning Monitoring Strategies: A Difficult Genetic Programming Application
– Cohen
- 1994
|
|
1
|
Evolution of Homing Navigation in a Real Mobile Robot
– Donnart
- 1996
|
|
1
|
Genetic Programming in C++: Implementation and Design Issues
– Keith
- 1993
|
|
1
|
Learning from Delayed Response
– Krose
- 1995
|
|
1
|
Image Recognition and Image Encoding Using Paint Primitives and Genetic Programming. Unpublished manuscript
– Nordin
- 1996
|
|
1
|
Best First Search
– Rosenbloom
- 1987
|