35
Views
3
CrossRef citations to date
0
Altmetric
Original Article

Catastrophic forgetting in simple networks: an analysis of the pseudorehearsal solution

&
Pages 227-236 | Received 27 Nov 1998, Published online: 09 Jul 2009

References

  • Burgess N, Shapiro J L, Moore M A. Neural network models of list learning. Network. 1991; 2: 399–422
  • Christos G A. Investigation of the Crick-Mitchison reverse-learning dream sleep hypothesis in a dynamical setting. Neural Networks 1996; 9: 427–34
  • Crick F, Mitchison G. The function of dream sleep. Nature 1983; 304: 111–4
  • French R M. Semi-distributed representations and catastrophic forgetting in connectionist networks. Connection Sci. 1992; 4: 365–77
  • French R M. Dynamically constraining connectionist networks to produce distributed, orthogonal representations to reduce catastrophic forgetting. Proc. 6th Ann. Cognitive Science Soc. Conf. Earlbaum, Hillsdale, NJ 1990; 335–40
  • French R M. Interactive connectionist networks: an approach to the ‘sensitivity-stability’ dilemma. Connection Sci. 1997; 9: 353–80
  • Hetherington P A, Seidenberg M S. Is there catastrophic interference in neural networks?. Proc. 11th Ann. Cognitive Science Soc. Conf. Earlbaum, Hillsdale, NJ 1989; 26–33
  • Hopfield J J, Feinstein D I, Palmer R G. Unlearning has a stabilising effect in collective memories. Nature 1983; 304: 158–9
  • Lewandowsky S. Gradual unlearning and catastrophic interference: a comparison of distributed architectures. Relating Theory and Data: Essays on Human Memory in Honour of Bennet B. Murdok, W E Hockley, S Lewandowsky. Earlbaum, Hillsdale, NJ 1991; 445–76
  • Lewandowsky S, Li S. Catastrophic interference in neural networks: causes, solutions and data. Interference and Inhibition in Cognition, F N Dempster, C Brainerd. Academic, San Diego, CA 1995; 329–61
  • McCloskey M, Cohen N J. Catastrophic Interference in connectionist networks: the sequential learning problem. The Psychology of Learning and Motivation, G H Bower. Academic, New York 1989; 23: 109–64
  • McRae K, Hetherington P A. Catastrophic interference is eliminated in pretrained networks. Proc. 15th Ann. Mtg of the Cognitive Science Soc. Earlbaum, Hillsdale, NJ 1993; 723–8
  • Murre J M J. Learning and Categorization in Modular Neural Networks. Earlbaum, Hillsdale, NJ 1992
  • Murre J M J. Hypertransfer in neural networks. Connection Sci. 1995; 8: 249–58
  • Nadal J P, Toulouse G, Changeux J P, Dehaene S. Networks of formal neurons and memory palimpsets. Europhys. Lett. 1986; 1: 535–42
  • Ratcliff R. Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. Psychol. Rev. 1990; 97: 285–308
  • Robins A V. Catastrophic interference, rehearsal and pseudorehearsal. Connection Sci. 1995; 7: 123–46
  • Robins A V. Consolidation in neural networks and the sleeping brain. Connection Sci. 1996; 8: 259–75
  • Robins A V, Frean M R. Learning and generalization in a stable network. Progress in Connectionist-Based Information Systems: Proc. 1997 Conf. on Neural Information Processing and Intelligent Information Systems. N Kasabov, et al. Springer, Singapore 1998; 314–7
  • Robins A, McCallum S. Catastrophic forgetting and the pseudorehearsal solution in Hopfield type networks. Connection Sci. 1998; 7: 121–35
  • Sharkey N E, Sharkey A J C. An analysis of catastrophic interference. Connection Sci. 1995; 7: 301–29
  • van Hemmen J. Hebbian learning, its correlation catastrophe, and unlearning. Network 1997; 8: 1–17
  • Wimbauer S, Klemmer N, van Hemmen J. Universality of unlearning. Neural Networks 1994; 7: 261–70

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.