Advanced search
Publication Cover
Connection Science Volume 13, 2001 - Issue 3
Submit an article Journal homepage
221
Views
7
CrossRef citations to date
0
Altmetric
Original Articles

Shaping: A multiple contingencies analysis and its relevance to behaviour-based robotics

Tony Savage
Pages 199-234 | Published online: 01 Jul 2010

  • Balsam , P. D. , Deich , J. D. , Ohyama , T. and Stokes , P. D. 1998 . “ Origins of new behavior ” . In Learning and Behavior Therapy , Edited by: O'Donohue , W. Needham Heights, MA : Allyn and Bacon .
  • Banzhaf , W. , Nordin , P. , Keller , R. and Francone , R. 1998 . Genetic Programming:An Introduction , San Francisco : Morgan Kaufmann .
  • Bindra , D. 1976 . A Theory of Intelligent Behavior , New York : Wiley .
  • Blumberg , B. , Todd , P. and Maes , P. 1996 . “ No bad dogs: ethologjcal lessons for learning in hamsterdam ” . In From A nimals to A nimats 4, Proceedings of the Fourth International Conference on the Simulation of Adaptive Behavior , Edited by: Maes , P. , Mataric , M. , Meyer , J.-A. , Pollack , J. and Wilson , S. W. Cambridge, MA : The MIT Press/Bradford Books .
  • Brown , P. L. and Jenkins , H. M. 1968 . Auto-shaping of the pigeon's key peck . Journal of the Experimental Analysis of Behavior , 11 : 1 – 8 .
  • Colombetti , M. , Dorigo , M. and Borghi , G. 1996 . Behavior analysis and training: a methodology for behavior engineering . IEEE Transactions on System s, Man and Cybernetics-PartB , 26 : 365 – 380 .
  • Dickinson , A. , Hall , G. and Mackintosh , N. J. 1976 . Surprise and the attenuation of blocking . Journal of Experimental Psychology , 37B : 397 – 416 .
  • Dickinson , A. and Shanks , D. 1995 . “ Instrumental action and causal representation ” . In Causal Cognition: A Multidisciplinary Debate , Edited by: Sperber , D. , Premack , D. and Premack , A. J. Oxford : Clarendon Press .
  • Dorigo , M. and Colombetti , M. 1998 . Robot Shaping: AnEexperiment in Behavior Engineering , Cambridge, MA : MIT Press .
  • Dorigo , M. and Colombetti , M. 1994 . Robot shaping: developing autonomous agents through learning . A rtificial Intelligence , 71 ( 2 ) : 321 – 370 .
  • Frick , R. W. 1986 . aIs the force of response shaped by reinforcement? . Perceptual and Motor Skills , 62 : 267 – 277 .
  • Galbicka , G. 1994 . Shaping in the 21st century: moving percentile schedules into applied settings . Journal of Applied Behavior Analysis , 27 : 739 – 760 .
  • Galbicka , G. 1988 . Differentiating the behavior of organisms . Journal of the Experimental A nalysis of Behavior , 50 : 343 – 354 .
  • Galbicka , G. and Platt , J. 1986 . Parametric manipulation of inter response-time contingency independent of reinforcement rate . Journal of Experimental Psychology: Animal Behavior Processes , 12 : 371 – 380 .
  • Gaussier , P. , Joulain , C. , Revel , A. and Banquet , J. Are shaping techniques the correct answer for the control of an autonomous robot? . UKACC International Conference on Control '96 . University of Exeter, IEE .
  • Harvey , I. , Husbands , P. and Cliff , D. 1993 . “ Issues in evolutionary robotics ” . In From Animals to Animals 2, Proceedings of the Second International Conference on the Simulation of Adaptive Behavior , Edited by: Meyers , J.-A. , Roitblat , H. L. and Wilson , S. W. Cambridge, MA : The MIT Press/Bradford Books .
  • Harvey , I. , Husbands , ? , Cuff , D. , Thompson , A. and Jakobi , N. 1997 . Evolutionary robotics: the Sussex approach . Robotics and Autonomous Systems , 20 : 205 – 224 .
  • Lee , W.-P. 1999 . Evolving complex robot behaviors . Information Sciences , 121 : 1 – 25 .
  • Lund , H. and Parisi , D. 1995 . Pre-adaptations in populations of neural networks evolving in a changing environment . Artificial Life , 2 ( 2 ) : 179 – 197 .
  • Malott , R. W. , Whaley , D. L. and Malott , M. E. 1997 . Elementary Principles of Behavior , Englewood Cuffs, NJ : Prentice Hall .
  • Martin , G. and Pear , J. 1999 . Behavior Modification: What it is and How to do it , 6th edn , Englewood Cuffs, NJ : Prentice Hall .
  • Midgley , M. , Lea , S. E. G. and Kirby , R. 1989 . Algorithmic shaping and misbehavior in the acquisition of token deposit by rats . Journal of the Experimental A nalysis of Behavior , 52 : 27 – 40 .
  • Moore , B. R. 1973 . “ The role of directed Pavlovian reactions in simple instrumental learning in the piegeon ” . In Constraints on Learning , Edited by: Hinde , R. A. and Stevenson-Hinde , J. London : Academic Press .
  • Morgan , M. J. and Nicholas , D. J. 1979 . Discrimination between reinforced action patterns in the rat . Learning and Motivation , 10 : 1 – 22 .
  • Nolfl , S. 1998 . Evolutionary robotics: exploiting the full power of self-organization . Connection Science , 10 : 167 – 184 .
  • Nolfl , S. 1997a . Using emergent modularity to develop control systems for mobile robots . Adaptive Behavior , 3-4 : 343 – 364 .
  • Nolfl , S. 1997b . Evolving non-trivial behaviors on real robots: a garbage collecting robot . Robotics and A utonomous Systems , 22 : 187 – 198 .
  • Nolfl , S. and Floreano , D. 1999 . Learning and evolution . A Monom aus Robots , 7 : 89 – 113 .
  • Nolfl , S. and Parisi , D. 1995 . “ 'Genotypes' for neural networks ” . In The Handbook of Brain Theory and Neural Networks , Edited by: Arbib , M. A. Cambridge, MA : MIT Press .
  • Pear , J. J. and Legris , J. A. 1987 . Shaping by automated tracking of an arbitrary operant response . Journal of the Experimental Analysis of Behavior , 47 : 241 – 247 .
  • Platt , J. R. 1984 . “ Motivational and response factors in temporal differentiation ” . In Timing and Time Perception , Edited by: Gibbon , J. and Alien , L. New York : New York Academy of Sciences .
  • Platt , J. R. 1973 . Percentile reinforcement: paradigms for experimental analysis of response shaping . Psychology of Learning and Motivation , 7 : 271 – 296 .
  • Saksida , L. M. , Raymond , S. M. and Toutetzky , D.S. 1997 . Shaping robot behavior using principles frominstrumental conditioning . Robotics and A Monomous Systems , 22 : 231 – 249 .
  • Savage , T. 1998 . Shaping: the link between rats and robots . Connection Science , 10 : 321 – 340 .
  • Savage , T. and Ziemke , T. 2001 . Learning and unlearning mechanisms in animals and animals . A daptiveBehavior , 8 ( 2 ) : 93 – 124 .
  • Scutt , T. and Damper , R. 1997 . “ Designing a nervous system for an adaptive robot ” . In Neural Network Perspectives on Cognition and Adaptive Robotics , Edited by: Brown , A. J. Bristol : IOP Press .
  • Shanks , D. R. 1994 . “ Human associative learning ” . In Animal Learning andCognition , Edited by: Mackintosh , N. J. London : Academic Press .
  • Sharkey , N. and Heemskerk , J. 1997 . “ The neural mind and the robot ” . In NeuralNetwork Perspectives on Cognition and Adaptive Robotics , Edited by: Brown , A. J. Bristol : IOP Press .
  • Skinner , B. R. 1938 . The Behavior of Organisms , New York : Appleton-Century .
  • Staddon , J. E. R. 1983 . Adaptive Behavior and Learning , New York : Cambridge University Press .
  • Stein , L. , Xue , B. G. and Belluzzi , J. D. 1993 . A cellular analogue of operant conditioning . Journal ofExperimental Analysis of Behavior , 60 : 41 – 53 .
  • Stokes , P. D. 1995 . Learned variability . A nimal Learning and Behavior , 23 : 164 – 176 .
  • Stokes , P. D. and Balsam , P. D. 1991 . Effects of reinforcing preselected approximations on thetopography of the rat's bar press . Journal of Experimental Analysis of Behavior , SS : 213 – 231 .
  • Timberlake , A. and Lucas , G. 1989 . “ Behavior systems and learning; from misbehavior to generalprinciples ” . In Contemporary Learning Theories: InstrumentalConditioning Theory and the Impact of Biological Constraints on Learning , Edited by: Klein , S. B. and Mower , R. R. Hillsdale, NJ : LEA .
  • Timberlake , W. , Wahl , G. and King , D. 1982 . Stimulus and response contingencies in the misbehavior ofrats . Journal of Experimental Psychology .-Animal Behavior Processes , 8 : 62 – 85 .
  • Urzelai , J. , Floreano , D. , Dorigo , M. and Colombetti , M. 1998 . Incremental robot shaping . ConnectionScience , 10 : 341 – 360 .
  • Williams , D. R. and Williams , H. 1969 . Auto-maintenance in the pigeon: sustained pecking despitecontingent non reinforcement . Journal of the Experimental Analysis of Behavior , 12 : 511 – 520 .

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.