Evolutionary agent learning

Abstract

Evolutionary Platform for Agent Learning (EPAL) is a novel methodology for agent learning, based on an extension to genetic programming that Lockheed Martin Advanced Technology Laboratories (LM ATL) developed. EPAL allows software agents to learn how to better operate under external conditions, so they do not repeat their mistakes. It creates both subtle and drastic changes to agent behavior. Subtle changes arise from learning task parameters; drastic changes emerge from learning improved workflows containing new programming constructs and tasks. Although EPAL was constructed for learning by LM ATL developed extendible mobile agent architecture agents, it is a suitable learning methodology for any software agent whose behavior can be represented as a workflow and further decomposed into building blocks, such as operators, tasks, and parameters. Our agents learned to solve a real-world problem that is similar to problems encountered in Navy Fleet Battle Experiment-Juliet. Results for both parameter learning and workflow learning are very encouraging.

Keywords:

• Intelligent software agents
• Machine learning
• Genetic programming
• Agent learning
• Complex systems

Notes

^‡Work done while at LM ATL.

Additional information

Notes on contributors

A. L. Buczak

‡ ‡Work done while at LM ATL.

D. G. Cooper

Work done while at LM ATL.

M. O. Hofmann

Work done while at LM ATL.