Behaviour generation in humanoids by learning potential-based policies from constrained motion

References

• Alissandrakis , A , Nehaniv , C and Dautenhahn , K . 2007 . Correspondence mapping induced state and action metrics for robotic imitation . IEEE Trans. Sys. Man Cybernetics , 37 ( 2 ) : 299 – 307 .
   Web of Science ®Google Scholar
• Antonelli , G , Arrichiello , F and Chiaverini , S . The null-space-based behavioral control for soccer-playing mobile robots . Proceedings 2005 IEEE international conference on advanced intelligent mechatronics . Monterey, CA, USA.
   Google Scholar
• Atkeson , C G and Schaal , S . Robot learning from demonstration . Proceedings 1997 international conference on machine learning . pp. 12 – 20 .
   Google Scholar
• Billard , A , Calinon , S , Dillmann , R and Schaal , S . 2007 . “ Robot programming by demonstration ” . In Handbook of Robotics , MIT Press .
   Google Scholar
• Calinon , S and Billard , A . Learning of gestures by imitation in a humanoid robot . Proceedings 2007 imitation & social learning in robots, humans & animals: Behavioural, social & communicative dimensions .
   Google Scholar
• Chajewska , U , Koller , D and Ormoneit , D . Learning an agent's utility function by observing behavior . Proceedings 2001 international conference on machine learning .
   Google Scholar
• Chajewska , U , Getoor , L , Norman , J and Shahar , Y . Utility elicitation as a classification problem . Proceedings 1998 conference on uncertainty in artificial intelligence .
   Google Scholar
• Chalodhorn , R , Grimes , D B , Maganis , G Y , Rao , R P and Asada , M . Learning humanoid motion dynamics through sensory-motor mapping in reduced dimensional space . Proceedings 2006 ICRA .
   Google Scholar
• Chaumette , F and Marchand , A . 2001 . A redundancy-based iterative approach for avoiding joint limits . Appl. Vis. Servoing , 17 ( 5 )
   Google Scholar
• Choi , S I and Kim , B K . 2000 . Obstacle avoidance control for redundant manipulators using collidability measure . Robotica , 18 ( 2 ) : 143 – 151 .
   Google Scholar
• Conner , D , Rizzi , A and Choset , H . Composition of local potential functions for global robot control and navigation . Proceedings 2003 IEEE international conference on intelligent robots and systems .
   Google Scholar
• D'Souza , A , Vijayakumar , S and Schaal , S . Learning inverse kinematics . Proceedings 2001 IEEE international conference on intelligent robots and systems .
   Google Scholar
• English , J and Maciejewski , A . 2000 . On the implementation of velocity control for kinematically redundant manipulators . IEEE Trans. Sys. Man and Cybern. , 30 ( 3 ) : 233 – 237 .
   Web of Science ®Google Scholar
• Gienger , M , Janssen , H and Goerick , C . Task-oriented whole body motion for humanoid robots . Proceedings IEEE International conference on humanoid robots .
   Google Scholar
• Grimes , D , Chalodhorn , R and Rao , R . Dynamic imitation in a humanoid robot through nonparametric probabilistic inference . Proceedings 2006 robotics: science and systems, Conference proceedings .
   Google Scholar
• Grimes , D , Rashid , D and Rao , R . 2007 . Learning nonparametric models for probabilistic imitation . Adv. Neural Infor. Proce. Syst. ,
   Google Scholar
• Guenter , F , Hersch , M , Calinon , S and Billard , A . 2007 . Reinforcement learning for imitating constrained reaching movements . RSJ Advanced Robotics, Special Issue on Imitative Robots , 21 ( 13 ) : 1521 – 1544 .
   Web of Science ®Google Scholar
• Howard , M , Gienger , M , Goerick , C and Vijayakumar , S . Learning utility surfaces for movement selection . Proceedings 2006 IEEE International conference robotics and biomimetics .
   Google Scholar
• Howard , M and Vijayakumar , S . 2007 . Reconstructing null-space policies subject to dynamic task constraints in redundant manipulators W.S. Robot
   Google Scholar
• Howard , M , Klanke , S , Gienger , M , Goerick , C and Vijayakumar , S . Learning potential-based policies from constrained motion . Proceedings 2008 IEEE International conference on humanoid robots .
   Google Scholar
• Ijspeert , A , Nakanishi , J and Schaal , S . Movement imitation with nonlinear dynamical systems in humanoid robots . Proceedings 2002 ICRA .
   Google Scholar
• Ijspeert , A , Nakanishi , J and Schaal , S . Learning attractor landscapes for learning motor primitives . Proceedings 2003 NIPS .
   Google Scholar
• Inamura , T , Toshima , I , Tanie , H and Nakamura , Y . 2004 . Embodied Symbol emergence based on mimesis theory . Int. J. Robotics Res. , 23 ( 4 ) : 363 – 377 .
   Web of Science ®Google Scholar
• Itiki , C , Kalaba , R and Udwadia , F . 1996 . Inequality constraints in the process of jumping . Appl Math Comput. , 78 : 163 – 173 .
   Web of Science ®Google Scholar
• Kannan , R , Vempala , S and Vetta , A . 2004 . On clusterings: Good, bad and spectral . J. of the ACM , 51 ( 3 ) : 497 – 515 .
   Web of Science ®Google Scholar
• Khatib , O . Real-time obstacle avoidance for manipulators and mobile robots . Proceedings 1985 ICRA .
   Google Scholar
• Khatib , O . 1987 . A unified approach for motion and force control of robot manipulators: The operational space formulation . IEEE J. Robotics and Automation , RA-3 ( 1 ) : 43 – 53 .
   Google Scholar
• Körding , K , Fukunaga , I , Howard , I , Ingram , J and Wolpert , D . 2004 . A neuroeconomics approach to inferring utility functions in sensorimotor control . PLoS Biol , 2 ( 10 ) : 330
   Web of Science ®Google Scholar
• Körding , K and Wolpert , D . The loss function of sensorimotor learning . Proceedings 2004 National academy of sciences .
   Google Scholar
• Liégeois , A . Automatic supervisory control of the configuration and behavior of multibody mechanisms . Proceedings 1977 IEEE Transaction system, man, and cybernetics .
   Google Scholar
• Mattikalli , R and Khosla , P . Motion constraints from contact geometry: Representation and analysis . Proceedings 1992 ICRA .
   Google Scholar
• Murray , R M , Li , Z and Sastry , S S . 1994 . A Mathematical Introduction to Robotic Manipulation , CRC Press .
   Google Scholar
• Mussa-Ivaldi , F A . Nonlinear force fields: A distributed system of control primitives for representing and learning movements . Proceedings of the 1997 International Symposium on Computational Intelligence in Robotics and Automation . pp. 84 – 90 .
   Google Scholar
• Nakamura , Y . 1991 . Advanced robotics: Redundancy and optimization , Addison Wesley .
   Google Scholar
• Nakanishi , J , Morimoto , J , Endo , G , Cheng , G , Schaal , S and Kawato , M . 2004 . Learning from demonstration and adaptation of biped locomotion . Robotics and Autonomous Sys. , 47 ( 2-3 ) : 79 – 91 .
   Web of Science ®Google Scholar
• Ohta , K , Svinin , M , Luo , Z , Hosoe , S and Laboissiere , R . 2004 . Optimal trajectory formation of constrained human arm reaching movements . Biol. Cybern. , 91 : 23 – 36 .
   PubMed Web of Science ®Google Scholar
• Park , J and Khatib , O . Contact consistent control framework for humanoid robots . Proceedings 2006 ICRA .
   Google Scholar
• Peters , J , Mistry , M , Udwadia , F , Nakanishi , J and Schaal , S . 2008 . A unifying framework for robot control with redundant DOFs . Autonomous Robots J. , 24 : 1 – 12 .
   Web of Science ®Google Scholar
• Peters , J and Schaal , S . 2008 . Learning to control in operational space . Int. J. Robotics Res. , 27 : 197 – 212 .
   Web of Science ®Google Scholar
• Ren , J , McIsaac , K A and Patel , R V . Modified Newton's method applied to potential field-based navigation for mobile robots . Proceedings 2006 IEEE transactions on robotics .
   Google Scholar
• Rimon , E and Koditschek , D . 1992 . Exact robot navigation using artificial potential functions . IEEE Trans. on Robotics and Automation , 8 ( 5 ) : 501 – 518 .
   Google Scholar
• Sapio , V D , Khatib , O and Delp , S . 2006 . Task-level approaches for the control of constrained multibody systems
   Google Scholar
• Sapio , V D , Warren , J , Khatib , O and Delp , S . 2005 . Simulating the task-level control of human motion: A methodology and framework for implementation . Vis. Comput. , 21 ( 5 ) : 289 – 302 .
   Web of Science ®Google Scholar
• Schaal , S , Ijspeert , A and Billard , A . 2003 . Computational approaches to motor learning by imitation . Phil. Trans. Biol Sci. , 358 : 537 – 547 .
   PubMed Web of Science ®Google Scholar
• Sentis , L and Khatib , O . Task-oriented control of humanoid robots through prioritization . Proceedings 2004 IEEE International conference on humanoid robots .
   Google Scholar
• Sentis , L and Khatib , O . 2005 . Synthesis of whole-body behaviors through hierarchical control of behavioral primitives . Int. J. Humanoid Robot , 2 ( 4 ) : 505 – 518 .
   Google Scholar
• Sentis , L and Khatib , O . A Whole-body control framework for humanoids operating in human environments . Proceedings 2006 ICRA . May .
   Google Scholar
• Sugiura , H , Gienger , M , Janssen , H and Goerick , C . Real-time collision avoidance with whole body motion control for humanoid robots . Proceedings 2007 IROS .
   Google Scholar
• Sutton , R and Barto , A . 1998 . Reinforcement Learning: An Introduction , Cambridge, MA, , USA : MIT Press .
   Google Scholar
• Svinin , M , Odashima , T , Ohno , S , Luo , Z and Hosoe , S . An analysis of reaching movements in manipulation of constrained dynamic objects . Proceedings 2005 IROS .
   Google Scholar
• Takano , W , Yamane , K , Sugihara , T , Yamamoto , K and Nakamura , Y . Primitive communication based on motion recognition and generation with hierarchical mimesis model . Proceedings 2006 ICRA .
   Google Scholar
• Todorov , E . 2006 . “ Optimal Control Theory ” . In Bayesian Brain , MIT Press .
   Google Scholar
• Verbeek , J , Roweis , S and Vlassis , N . 2004 . Non-linear CCA and PCA by alignment of local models . Adv. Neural Inform. Proces. Syst. ,
   Google Scholar
• Verbeek , J . 2006 . Learning non-linear image manifolds by combining local linear models . IEEE Trans. Pattern Ana & Mach Intell , 28 ( 8 ) : 1236 – 1250 .
   PubMed Web of Science ®Google Scholar
• Vijayakumar , S , D'Souza , A and Schaal , S . 2005 . Incremental online learning in high dimensions . Neural Comp. , 17 : 2602 – 2634 .
   PubMed Web of Science ®Google Scholar
• Yoshikawa , T . 1985 . Manipulability of robotic mechanisms . Int. J. Robotics Res. , 4 ( 2 ) : 3 – 9 .
   Web of Science ®Google Scholar