Hebbian learning, its correlation catastrophe, and unlearning

References

• Hobson J A. Sleep. Scientific American Library, New York 1989, Hobson J A 1990 Sleep and dreaming J. Neurosci. 10 371–82
   Google Scholar
• Winson J. The meaning of dreams. Sci. Am. 1990; 263(5)42–8
   Google Scholar
• Crick, F, Mitchison, G. 1986. The function of dream sleep. Nature, 304: 111–4. Crick, F, Mitchison, G, 1986; 7. 229–50
   Web of Science ®Google Scholar
• Gerstner W, Ritz R, van Hemmen J L. Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns. Biol. Cybern. 1993; 69: 503–15
   PubMed Web of Science ®Google Scholar
• Hebb D O. The Organization of Behavior. Wiley, New York 1949; 62
   Google Scholar
• Hopfield J J. Neural networks and physical systems with emergent collective computational abilities. Proc. Natl Acad. Sci. USA 1982; 79: 2554–8
   PubMed Web of Science ®Google Scholar
• Herz, A V M, Sulzer, B, Kühn, R, van Hemmen, J L. The Hebb rule: Storing static and dynamic objects in an associative neural network. Europhys. Lett., 7: 663–9. Herz, A V M, Sulzer, B, Kühn, R, van Hemmen, J L. Hebbian learning reconsidered: Representation of static and dynamic objects in associative neural nets. Biol. Cybern. 60. 457–67
   Google Scholar
• Herz A V M, Li Z, van Hemmen J L. Statistical mechanics of temporal association in neural networks with transmission delays. Phys. Rev. Lett. 1991; 66: 1370–3
   PubMed Web of Science ®Google Scholar
• Van Hemmen J L, Gerstner W, Herz A V M, Kühn R, Vaas M. Encoding and decoding of patterns which are correlated in space and time. Konnektionismus in Artificial Intelligence und Kognitionsforschung, G Dorffner. Springer, Berlin 1990; 153–62
   Google Scholar
• Hopfield J J, Feinstein D I, Palmer R G. ‘Unlearning’ has a stabilizing effect in collective memories. Nature 1983; 304: 158–9
   PubMed Web of Science ®Google Scholar
• Smith C, Kelly G. Paradoxical sleep deprivation applied two days after end of training retards learning. Psychol. Behav. 1988; 43: 213–6
   Google Scholar
• Karni A, Tanne D, Rubenstein B S, Askenasy J J M, Sagi D. Dependence on REM sleep of overnight improvement of a perceptual skill. Science 1994; 265: 679–82
   PubMed Web of Science ®Google Scholar
• Freud S. Die Traumdeutung (Leipzig: Deuticke-Verlag); translation 1976. The Interpretation of Dreams. Penguin, London 1900
   Google Scholar
• Pavlides C, Winson J. Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes. J. Neurosci. 1989; 9: 2907–18
   PubMed Web of Science ®Google Scholar
• Hennevin E, Hars B, Bloch V. Improvement of learning by mesencephalic reticular stimulation during postlearning paradoxical sleep Behav. Neural Biol. 1989; 51: 291–306
   PubMedGoogle Scholar
• Hobson J A, McCarley R W. The brain as a dream state generator: an activation-synthesis hypothesis of the dream process. Am. J. Psychiatry 1977; 134: 1335–48
   PubMed Web of Science ®Google Scholar
• Van Hemmen J L, Kühn R. Collective phenomena in neural networks. Models of Neural Networks I2nd edn, E Domany. Springer, Berlin 1995; 1–113
   Google Scholar
• Gardner E. The space of interactions in neural network models. J.Phys. A: Math. Gen. 1988; 21: 257–70
   Google Scholar
• Lamperti J. Benjamin, New York 1966 Probability
   Google Scholar
• Van Hemmen J L, Ioffe L B, Kühn R, Vaas M. Increasing the efficiency of a neural network through unlearning. Physica A 1990; 163: 386–92
   Web of Science ®Google Scholar
• Kleinfeld D, Pendergraft D B. ‘Unlearning’ increases the storage capacity of content addressable memories. Biophys. J. 1987; 51: 47–53
   PubMed Web of Science ®Google Scholar
• Van Hemmen J L, Klemmer N. Unlearning and its relevance to REM sleep: Decorrelating correlated data. Neural Network Dynamics, J G Caianiello, E R Taylor, R M J Cotterill, J W Clark. Springer, Berlin 1992; 40–53
   Google Scholar
• Kanter I. Convergence time in infinite-range neural networks with parallel dynamics at zero temperature. Phys. Rev. A 1989; 40: 2611–4
   PubMed Web of Science ®Google Scholar
• Wimbauer S, Klemmer N, van Hemmen J L. Universality of unlearning. Neural Networks 1994; 7: 261–70
   Web of Science ®Google Scholar
• Klemmer N. Diploma thesis. Technical University of Munich. 1991
   Google Scholar
• Hopfield J J. Collective processing and neural states. Modeling in Analysis and Biomedicine, C Nicolini. World Scientific. 1984; 369–89
   Google Scholar
• Van Hemmen J L, Keller G, Kühn R. Forgetful memories. Europhys. Lett. 1988; 5: 663–8
   Google Scholar
• Plakhov A Yu, Semenov S A. Neural networks: Iterative unlearning algorithm converging to the projector rule matrix. J. Physique I 1994; 4: 253–60
   Google Scholar
• Markram H, Lübke J, Frotscher M, Sakmann B. Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 1997; 275: 213–5
   PubMed Web of Science ®Google Scholar
• Brown T H, Chattarji S. Hebbian synaptic plasticity: Evolution of the contemporary concept Models of Neural Networks I. 2nd edn, E Domany, J L van Hemmen, K Schulten. Springer, Berlin 1995; 287–314
   Google Scholar
• Gerstner W, Kempter R, van Hemmen J L, Wagner H. A neuronal learning rule for sub-millisecond temporal coding. Nature 1996; 383: 76–8
   PubMed Web of Science ®Google Scholar