Abstract:
We analyze a general model of multi-agent communication in which all agents communicate simultaneously to a message board. A genetic algorithm is used to evolve multi-agent languages for the predator agents in a version of the predator-prey pursuit problem. We show that the resulting behavior of the communicating multi-agent system is equivalent to that of a Mealy finite state machine whose states are determined by the agents' usage of the evolved language. Simulations show that the evolution of a communication language improves the performance of the predators. Increasing the language size (and thus increasing the number of possible states in the Mealy machine) improves the performance even further. Furthermore, the evolved communicating predators perform significantly better than all previous work on similar preys. We introduce a method for incrementally increasing the language size which results in an effective coarse-to-fine search that significantly reduces the evolution time required to find a solution. We present some observations on the effects of language size, experimental setup, and prey difficulty on the evolved Mealy machines. In particular, we observe that the start state is often revisited, and incrementally increasing the language size results in smaller Mealy machines. Finally, a simple rule is derived that provides a pessimistic estimate on the minimum language size that should be used for any multi-agent problem. 1
Citations
|
598
|
Speech Acts: An Essay in the Philosophy of Language
– Searle
- 1969
|
|
275
|
A Comparative Analysis of Selection Schemes Used in Genetic Algorithms
– Goldberg, Deb
- 1991
|
|
199
|
Multi-agent reinforcement learning: Independent vs. cooperative agents
– Tan
- 1993
|
|
173
|
Communication in reactive multiagent robotic systems
– Balch, Arkin
- 1994
|
|
107
|
A semantics approach for KQML -- a general purpose communication language for software agents
– Labrou, Finin
- 1994
|
|
87
|
Self-organising vocabularies
– Steels
- 1996
|
|
64
|
On optimal cooperation of knowledge sources
– Benda, Jaganathan, et al.
- 1986
|
|
63
|
A rigorous, operational formalization of recursive modeling
– Gmytrasiewicz, Durfe
- 1995
|
|
58
|
Synthetic ethology and the evolution of cooperative communication
– MacLennan, Burghardt
- 1993
|
|
57
|
Co-evolving predator and prey robots: Do ‘arms races’ arise in artificial evolution
– Nolfi, Floreano
- 1998
|
|
52
|
Evolving behavioral strategies in predators and prey
– Haynes, Sen
- 1995
|
|
50
|
Challenges for Complete Creature Architectures
– Brooks
- 1990
|
|
46
|
A formal analysis of the role of multi-point crossover in genetic algorithms
– Jong, Spears
- 1992
|
|
44
|
Understanding the Emergence of Conventions in Multi-Agent Systems.” Pp
– Walker, Wooldridge
- 1995
|
|
43
|
Altruism in the evolution of communication
– Ackley, Littman
- 1994
|
|
36
|
A simple solution to pursuit games
– Korf
- 1992
|
|
26
|
The effect of agent control strategy on the performance of a dai pursuit problem
– Stephens, Merx
- 1990
|
|
23
|
The evolution of communication schemes over continuous channels
– Saunders, Pollack
- 1996
|
|
20
|
A semantics approach for KQML--a general purpose communication language for software agents
– Labrou, Finin
- 1994
|
|
8
|
Emergence of collective strategies in preypredator game model
– Nishimura, Ikegami
- 1997
|
|
5
|
Evolutionary stagnation due to pattern pattern interactions in a co-evolutionary predator prey model
– Savill, Hogeweg
- 1997
|
|
4
|
Co-evolving predator and prey robots: do `arm races’ arise in arti¯cial evolution
– unknown authors
- 1998
|
|
3
|
A game-theoretic account of collaboration in communication
– Hasida, Nogao, et al.
- 1995
|
|
2
|
Toward rational communicative behavior
– Gmytrasiewicz, Durfee, et al.
- 1995
|
|
2
|
Nishimura and Takashi Ikegami. Emergence of collective strategies in a prey-predator game model
– Shin
- 1997
|
|
1
|
Savill and Paulien Hogeweg. Evolutionary stagnation due to pattern-pattern interactions in a coevolutionary predator-prey model
– Nicholas
- 1997
|