Environment-driven distributed evolutionary adaptation in a population of autonomous robotic agents

References

• Bonabeau , E. , Dorigo , M. and Theraulaz , G. 1999 . Swarm Intelligence: From Natural to Artificial Systems , Oxford : Oxford University Press .
   Google Scholar
• Trianni , V. , Nolfi , S. and Dorigo , M. 2008 . “ Evolution, self-organization and swarm robotics ” . In Swarm Intelligence, Natural Computing Series , Edited by: Blum , C. and Merkle , D. 163 – 191 . Berlin : Springer .
   Google Scholar
• Baele , G. , Bredeche , N. , Haasdijk , E. , Maere , S. , Michiels , N. , Van de Peer , Y. , Schmickl , T. , Schwarzer , C. and Thenius , R. 2009 . Open-ended on-board evolutionary robotics for robot swarms , 1123 – 1130 . Trondheim , , Norway : Proceedings of the IEEE Conference on Evolutionary Computation (CEC 2009) .
   Google Scholar
• Bernstein , D.S. , Givan , R. , Immerman , N. and Zilberstein , S. 2002 . The complexity of decentralized control of Markov decision processes . Math. Oper. Res. , 27 ( 4 ) : 819 – 840 .
   Web of Science ®Google Scholar
• Kohl , N. and Stone , P. 2004 . Policy gradient reinforcement learning for fast quadrupedal locomotion , 2619 – 2624 . New Orleans , LA : Proceedings of the IEEE International Conference on Robotics and Automation .
   Google Scholar
• Marbach , P. and Tsitsiklis , J.N. 2003 . Approximate gradient methods in policy space optimization of Markov reward processes . J. Discrete Event Dyn. Syst. , 13 : 111 – 148 .
   Web of Science ®Google Scholar
• Williams , R.J. 1992 . Simple statistical gradient-following algorithms for connectionist reinforcement learning . Mach. Learn. , 8 : 229 – 256 .
   Web of Science ®Google Scholar
• Taylor , M. , Whiteson , S. and Stone , P. 2006 . Comparing evolutionary and temporal difference methods for reinforcement learning , 1321 – 1328 . Seattle , WA : Proceedings of the Genetic and Evolutionary Computation Conference (GECCO) .
   Google Scholar
• Taylor , M.E. , Whiteson , S. and Stone , P. 2007 . Temporal difference and policy search methods for reinforcement learning: An empirical comparison , 1675 – 1678 . Vancouver , , Canada : Proceedings of the Twenty-Second Conference on Artificial Intelligence (AAAI-07) .
   Google Scholar
• Ficici , S. , Watson , R. and Pollack , J. 1999 . Embodied evolution: A response to challenges in evolutionary robotics , Edited by: Wyatt , J.L. and Demiris , J. 14 – 22 . Lausanne , , Switzerland : Proceedings of the Eighth European Workshop on Learning Robots .
   Google Scholar
• Elfwing , S. , Uchibe , E. , Doya , K. and Christensen , H.I. 2005 . Biologically inspired embodied evolution of survival . Proceedings of the 2005 IEEE Congress on Evolutionary Computation IEEE Congress on Evolutionary Computation . September 2–5 2005 , Edinburgh , UK. Edited by: Corne , D. , Michalewicz , Z. , Dorigo , M. , Eiben , G. , Fogel , D. , Fonseca , C. , Greenwood , G. , Chen , T.K. , Raidl , G. , Zalzala , A. , Lucas , S. , Paechter , B. , Willies , J. , Merelo , J.J. Guervos , Eberbach , E. , McKay , B. , Channon , A. , Tiwari , A. , Volkert , L. Gwenn , Ashlock , D. and Schoenauer , M. Vol. 3 , pp. 2210 – 2216 . UK : IEEE Press .
   Google Scholar
• Usui , Y. and Arita , T. 2003 . Situated and embodied evolution in collective evolutionary robotics , 212 – 215 . Oita , , Japan : Proceedings of the 8th International Symposium on Artificial Life and Robotics .
   Google Scholar
• Watson , R.A. , Ficici , S.G. and Pollack , J.B. 2002 . Embodied evolution: Distributing an evolutionary algorithm in a population of robots . Rob. Auton. Syst. , 39 ( 1 ) : 1 – 18 .
   Web of Science ®Google Scholar
• Wischmann , S. , Stamm , K. and örgötter , F. W . 2007 . “ Embodied evolution and learning: The neglected timing of maturation ” . In Advances in Artificial Life: 9th European Conference on Artificial Life , Edited by: Francesco , Almeida e Costa . Vol. 4648 , 284 – 293 . Lisbon , , Portugal : of Lecture Notes in Artificial Intelligence, Springer-Verlag .
   Google Scholar
• Bredeche , N. , Haasdijk , E. and Eiben , A.E. 2009 . On-line, on-board evolution of robot controllers , 110 – 121 . Proceedings of Artificial Evolution/Evolution Artificielle (EA'09), Strasbourg, France .
   Google Scholar
• Montanier , J.-M. and Bredeche , N. 2011 . “ Embedded evolutionary robotics: The (1 + 1)-restart-online adaptation algorithm ” . In New Horizons in Evolutionary Robotics: Extended Contributions from the 2009 EvoDeRob Workshop , Edited by: Doncieux , S. , Bredeche , N. and Mouret , J.-B. 155 – 168 . Berlin : Springer .
   Google Scholar
• Bedau , M.A. 2001 . Comparison of the growth of adaptive structure in artificial life models and in the fossil record . PaleoBios , 21 : 30
   Google Scholar
• Bedau , M.A. , McCaskill , J.S. , Packard , N.H. , Rasmussen , S. , Adami , C. , Green , D.G. , Ikegami , T. , Kaneko , K. and Ray , T.S. 2000 . Open problems in artificial life . Artif. Life , 6 : 363 – 376 .
   PubMed Web of Science ®Google Scholar
• Holland , J.H. 1994 . “ Echoing emergence: Objectives, rough definitions, and speculations for echo – class models ” . In Complexity: Metaphors, Models and Reality , Edited by: Cowan , G.A. , Pines , D. and Meltzer , D. 309 – 342 . Reading , MA : Addison-Wesley .
   Google Scholar
• Ray , T. 1991 . Is it alive, or is it GA? , San Diego , CA : Proceedings of International Conference on Genetic Algorithms .
   Google Scholar
• Spector , L. , Klein , J. , Perry , C. and Feinstein , M. 2005 . Emergence of collective behavior in evolving populations of flying agents . Genet. Program. Evolvable Mach. , 6 ( 1 ) : 111 – 125 .
   Google Scholar
• Dawkins , R. 1976 . The Selfish Gene , Oxford : Oxford University Press .
   Google Scholar
• Fletcher , J.A. , Bedau , M.A. and Zwick , M. 1998 . “ Effect of environmental structure on evolutionary adaptation ” . In Artificial Life VI , Edited by: Adami , C. , Belew , R. , Kitano , H. and Taylor , C. 189 – 198 . Cambridge , MA : MIT Press .
   Google Scholar
• Beyer , H.-G. and Schwefel , H.-P. 2002 . Evolution strategies – a comprehensive introduction . Nat. Comput. , 1 : 3 – 52 .
   Google Scholar
• Futuyma , D. 2009 . Evolution , 2nd , Sunderland , MA : Sinauer Associates Inc .
   Google Scholar
• Rosin , C. and Belew , R. 1996 . New methods for competitive coevolution . Evol. Comput. , 5 : 1 – 29 .
   Google Scholar
• Jakobi , N. , Husband , P. and Harvey , I. 1995 . “ Noise and the reality gap: The use of simulation in evolutionary robotics ” . In Advances in Artificial Life: Proceedings of the Third European Conference on Artificial Life , Edited by: Moran , F. , Moreno , A. , Merelo , J. and Chancon , P. 704 – 720 . Berlin : Springer-Verlag .
   Google Scholar
• Nolfi , S. and Floreano , D. 2000 . Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , Cambridge , MA : MIT Press/Bradford Books .
   Google Scholar
• Şahin , E. and Spears , W. 2005 . Swarm Robotics Workshop: State-of-the-Art Survey , Vol. 3342 , New York : of Lecture Notes in Computer Science, Springer .
   Google Scholar
• Şahin , E. and Winfield , A.F.T. 2008 . Swarm Intelligence: Special Issue on Swarm Robotics , Vol. 2 , Berlin : Springer .
   Google Scholar
• Dorigo , M. and Şahin , E. 2004 . Autonomous Robots: Special Issue on Swarm Robotics , Vol. 17 , Berlin : Springer .
   Google Scholar
• Winfield , A.F.T. and Holland , O.E. 2000 . The application of wireless local area network technology to the control of mobile robots . Microprocess. Microsyst. , 23 ( 10 ) : 597 – 607 .
   Web of Science ®Google Scholar
• Caprari , G. , Estier , T. and Siegwart , R. 2002 . Fascination of down scaling – Alice the sugar cube robot . J. Micro Mechatron. , 1 ( 3 ) : 177 – 189 .
   Google Scholar
• Kornienko , S. , Kornienko , O. and Levi , P. 2005 . Collective AI: Context Awareness via Communication , 1464 – 1470 . San Francisco , CA : IJCAI'05: Proceedings of the 19th International Joint Conference on Artificial Intelligence, Morgan Kaufmann Publishers Inc .
   Google Scholar
• Gross , R. , Bonani , M. , Mondada , F. and Dorigo , M. 2006 . Autonomous selfassembly in swarm-bots . IEEE Trans. Rob. , 22 ( 6 ) : 1115 – 1130 .
   Web of Science ®Google Scholar
• Mondada , F. , Bonani , M. , Raemy , X. , Pugh , J. , Cianci , C. , Klaptocz , A. , Magnenat , S. , Zufferey , J.-C. , Floreano , D. and Martinoli , A. 2009 . The e-puck, a robot designed for education in engineering , Vol. 1 , 59 – 65 . Castelo Branco , , Portugal : Proceedings of the 9th Conference on Autonomous Robot Systems and Competitions .
   Google Scholar
• Liu , W. and Winfield , A.F.T. 2011 . Open-hardware e-puck Linux extension board for experimental swarm robotics research . Microprocess. Microsyst. , 35 ( 1 ) : 60 – 67 .
   Web of Science ®Google Scholar
• Vaughan , R. 2008 . Massively multi-robot simulation in stage . Swarm Intell. , 2 ( 2–4 ) : 189 – 208 .
   Google Scholar
• Wolpert , D.H. and Tumer , K. 2001 . Optimal payoff functions for members of collectives . Adv. Complex Syst. , 4 ( 2/3 ) : 265 – 279 .
   Google Scholar
• Lehman , J. and Stanley , K.O. 2011 . Abandoning objectives: Evolution through the search for novelty alone . Evol. Comput. , 19 ( 2 ) : 189 – 223 .
   PubMed Web of Science ®Google Scholar