A MATHEMATICAL MODEL THAT LEARNS AN ADAPTIVELY GENERATED NOVEL PATTERN IN QUADRUPED LOCOMOTION

REFERENCES

• Beer , R. D. “A Dynamical Systems Perspective on Agent–Environment Interaction.” Artificial Intelligence 72 , nos. 1–2 ( 1995 ): 173 – 215 .
   Web of Science ®Google Scholar
• Cohen , A. H. , Holmes , P. J. , and Rand , R. H. “The Nature of the Coupling between Segmental Oscillators of the Lamprey Spinal Generator for Locomotion: A Mathematical Model.” Journal of Mathematical Biology 13 , no. 3 ( 1982 ): 345 – 69 .
   PubMed Web of Science ®Google Scholar
• Collins , J. J. and Richmond , S. A. “Hard-Wired Central Pattern Generators for Quadrupedal Locomotion.” Biological Cybernetics 71 , no. 5 ( 1994 ): 375 – 85 .
   Web of Science ®Google Scholar
• Cruse , H. , Durr , V. , and Schmitz , J. “Insect Walking Is Based on a Decentralized Architecture Revealing a Simple and Robust Controller.” Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 365 , no. 1850 ( 2007 ): 221 – 50 .
   Web of Science ®Google Scholar
• Daun , S. , Rubin , J. E. , and Rybak , I. A. “Control of Oscillation Periods and Phase Durations in Half-Center Central Pattern Generators: A Comparative Mechanistic Analysis.” Journal of Computational Neuroscience 27 , no. 1 ( 2009 ): 3 – 26 .
   Web of Science ®Google Scholar
• Ekeberg , O. , Wallen , P. , Lansner , A. , Traven , H. , Brodin , L. , and Grillner , S. “A Computer Based Model for Realistic Simulations of Neural Networks.” Biological Cybernetics 65 , no. 2 ( 1991 ): 81 – 90 .
   Web of Science ®Google Scholar
• Endo , G. , Morimoto , J. , Matsubara , T. , Nakanishi , J. , and Cheng , G. “Learning CPG-Based Biped Locomotion with a Policy Gradient Method: Application to a Humanoid Robot.” The International Journal of Robotics Research 27 , no. 2 ( 2008 ): 213 – 28 .
   Web of Science ®Google Scholar
• Fukuoka , Y. , Kimura , H. , and Cohen , A. H. “Adaptive Dynamic Walking of a Quadruped Robot on Irregular Terrain Based on Biological Concepts.” The International Journal of Robotics Research 22 , nos. 3–4 ( 2003 ): 187 – 202 .
   Web of Science ®Google Scholar
• Golubitsky , M. , Stewart , I. , Buono , P. L. , and Collins , J. J. “Symmetry in Locomotor Central Pattern Generators and Animal Gaits.” Nature 401 , no. 6754 ( 1999 ): 693 – 95 .
   Web of Science ®Google Scholar
• Grillner , S. “Locomotion in Vertebrates: Central Mechanisms and Reflex Interaction.” Physiological Reviews 55 , no. 2 ( 1975 ): 247 – 304 .
   PubMed Web of Science ®Google Scholar
• Hase , K. and Yamazaki , N. “Computer Simulation Study of Human Locomotion with a Three-Dimensional Entire-Body Neuro-Musculo-Skeletal Model.” JSME International Journal – Series C: Mechanical Systems, Machine Elements and Manufacturing Quarterly 45 , no. 4 ( 2002 ): 1040 – 50 .
   Google Scholar
• Holmes , P. , Koditschek , D. , and Guckenheimer , J. “The Dynamics of Legged Locomotion: Models, Analyses, and Challenges.” SIAM Review 48 , no. 2 ( 2006 ): 207 – 304 .
   Web of Science ®Google Scholar
• Huss , M. , Wang , D. , Trane , C. , Wikstrom , M. , and Hellgren Kotaleski , J. “An Experimentally Constrained Computational Model of NMDA Oscillations in Lamprey CPG Neurons.” Journal of Computational Neuroscience 25, no. 1 (2008): 108–21.
   Web of Science ®Google Scholar
• Ijspeert , A. J. “Central Pattern Generators for Locomotion Control in Animals and Robots: A Review.” Neural Networks 21 , no. 4 ( 2008 ): 642 – 53 .
   PubMed Web of Science ®Google Scholar
• Inagaki , S. , Yuasa , H. , and Arai , T. “CPG Model for Autonomous Decentralized Multi-Legged Robot System? Generation and Transition of Oscillation Patterns and Dynamics of Oscillators.” Robotics and Autonomous Systems 44 , nos. 3–4 ( 2003 ): 171 – 9 .
   Web of Science ®Google Scholar
• Ishiguro , A. , Fujii , A. , and Hotz , P. E. “Neuromodulated Control of Bipedal Locomotion Using a Polymorphic CPG Circuit.” Adaptive Behavior 11 , no. 1 ( 2003 ): 7 – 17 .
   Web of Science ®Google Scholar
• Ito , S. , Yuasa , H. , Luo , Z. , Ito , M. , and Yanagihara , D. “A Mathematical Model of Adaptive Behavior in Quadruped Locomotion.” Biological Cybernetics 78 , no. 5 ( 1998 ): 337 – 47 .
   Web of Science ®Google Scholar
• Kimura , S. , Yano , M. , and Shimizu , H. “A Self-Organizing Model of Walking Patterns of Insects.” Biological Cybernetics 69 , no. 3 ( 1993 ): 183 – 93 .
   Web of Science ®Google Scholar
• Lewis , M. A. , Tenore , F. , and Etienne-Cummings , R. “CPG Design Using Inhibitory Networks.” In Proceedings of the 2005 IEEE International Conference on Robotics and Automation , 3682 – 87 . Barcelona , Spain , 2005 .
   Google Scholar
• Matsubara , T. , Morimoto , J. , Nakanishi , J. , Sato , M. , and Doya , K. “Learning CPG-Based Biped Locomotion with a Policy Gradient Method.” Robotics and Autonomous Systems 54 , no. 11 ( 2006 ): 911 – 20 .
   Web of Science ®Google Scholar
• Nagashima , F. “A Motion Learning Method Using CPG/NP.” Proceedings of the 2nd International Symposium on Adaptive Motion of Animals and Machines , ThP-II-3 . Kyoto , Japan , 2003 .
   Google Scholar
• Nakamura , Y. , Mori , T. , Sato , M. , and Ishii , S. “Reinforcement Learning for a Biped Robot Based on a CPG-Actor-Critic Method.” Neural Networks 20 , no. 6 ( 2007 ): 723 – 35 .
   Web of Science ®Google Scholar
• Nishii , J. “A Learning Model for Oscillatory Networks.” Neural Networks 11 , no. 2 ( 1998 ): 249 – 57 .
   Web of Science ®Google Scholar
• Paul , C. “Sensorimotor Control of Biped Locomotion.” Adaptive Behavior 13 , no. 1 ( 2005 ): 67 – 80 .
   Web of Science ®Google Scholar
• Pinto , C. M. A. “Numerical Simulations in Two CPG Models for Bipedal Locomotion.” Journal of Vibration and Control 13 , nos. 9–10 ( 2007 ): 1487 – 1504 .
   Web of Science ®Google Scholar
• Righetti , L. and Ijspeert , A. J. “Programmable Central Pattern Generators: An Application to Biped Locomotion Control.” In Proceedings 2006 IEEE International Conference on Robotics and Automation , 1585 – 90 . Orlando , FL , 2006 .
   Google Scholar
• Skinner , F. K. , Kopell , N. , and Mulloney , B. “How Does the Crayfish Swimmeret System Work? Insights from Nearest-Neighbor Coupled Oscillator Models.” Journal of Computational Neuroscience 4 , no. 2 ( 1997 ): 151 – 60 .
   Web of Science ®Google Scholar
• Sproewitz , A. , Moeckel , R. , Maye , J. , and Ijspeert , A. J. “Learning to Move in Modular Robots Using Central Pattern Generators and Online Optimization.” The International Journal of Robotics Research 27 , nos. 3–4 ( 2008 ): 423 – 43 .
   Web of Science ®Google Scholar
• Taga , G. “A Model of the Neuro-Musculo-Skeletal System for Human Locomotion.” Biological Cybernetics 73 , no. 2 ( 1995 ): 97 – 111 .
   Web of Science ®Google Scholar
• Tomita , N. and Yano , M. “A Model of Learning Free Bipedal Walking in Indefinite Environment.” In Proceedings of the SICE Annual Conference , 3176–81. Fukui , Japan , 2003.
   Google Scholar
• Tsujita , K. , Inoura , T. , and Masuda , T. “Oscillator-Controlled Bipedal Walker with Pneumatic Actuators.” In Proceedings of the SICE Annual Conference , 2165 – 69 . Kagawa , Japan , 2007 .
   Google Scholar
• Yanagihara , D. , Udo , M. , Kondo , I. , and Yoshida , T. “A New Learning Paradigm: Adaptive Changes in Interlimb Coordination during Perturbed Locomotion in Decerebrate Cats.” Neurosciences Research 18 , no. 3 ( 1993 ): 241 – 44 .
   Google Scholar
• Yuasa , H. and Ito , M. “Coordination of Many Oscillators and Generation of Locomotory Patterns.” Biological Cybernetics 63 , no. 3 ( 1990 ): 177 – 84 .
   Web of Science ®Google Scholar