26
Views
15
CrossRef citations to date
0
Altmetric
Review Article

Informational characteristics of neural networks capable of associative learning based on Hebbian plasticity

&
Pages 495-536 | Received 15 Apr 1991, Published online: 09 Jul 2009

References

  • Albus J S. A theory of cerebellar function. Math. Biosci. 1971; 10: 25–61
  • Amari S. Characteristics of sparsely encoded associative memory. Neural Networks 1989; 2: 451–7
  • Amari S. Mathematical foundations of neurocomputing. Proc. IEEE 1990; 78: 1443–63
  • Amari S, Maginu K. Statistical neurodynamics of associative memory. Neural Networks 1988; 1: 63–73
  • Amit D J, Gutfreund H, Sompolinsky H. Information storage in neural networks with low levels of activity. Phys. Rev. 1987; A 35: 2293–303
  • Asratian E A. Notes on Physiology of Condition Reflexes. Nauka, Moscow 1970, (in Russian)
  • Belenkov N J. Memory as effectogenic basis of condition reflex. Usp. Physiol. Nauk 1976; 7: 120–33, (in Russian)
  • Braitenberg V. Cell assemblies in the cerebral cortex. Theoretical Approaches to Complex Systems, R Heim, G Palm. Springer, Berlin 1978; 171
  • Buhmann J, Divko R, Schulten K. Associative memory with high information content. Phys. Rev. 1989; A 39: 2689–92
  • Derrida B, Gardner E, Zippelius A. An exactly soluble asymmetric neural network model. Europhys. Lett. 1987; 4: 167–73
  • Dunin-Barkowski V L. Information Processes in Neural Structures. Nauka, Moscow 1978, (in Russian)
  • Dunin-Barkowski V L, Larionova N P. An information learning and its recall in Marr's memory unit. Biol. Cybern. 1985; 51: 407–15
  • Frolov A A. Informational properties of neuron assemblies. Biophysika 1989a; 34: 280–6, (in Russian)
  • Frolov A A. Information properties of bilayer neuron nets with binary plastic synapses. Biofizika 1989b; 34: 868–76, (in Russian)
  • Frolov A A, Husek D. Once more on the information capacity of the Hopfield model. Proc. Eur. Symp. on Artificial Neural Networks (Brussels, April 1993). De Facto Conference Services, Brussels 1993; 195–202
  • Frolov A A, Kharitonov A P. Model of the local condition reflex. Avtometria 1981; 31–38, (in Russian)
  • Frolov A A, Murav'ev I P. Neural Models of Associative Memory. Nauka, Moscow 1987, (in Russian)
  • Frolov A A, Murav'ev I P. Informational Characteristics of Neural Networks. Nauka, Moscow 1988a, (in Russian)
  • Frolov A A, Murav'ev I P. Informational characteristics of neural and synaptic plasticity. Biophysics 1988b; 33: 708–16
  • Frolov A A, Mushinsky A M, Tsodyks M V. Imitation model of autoassociative memory as a neuron network with low activity level. Biofizika 1991; 36: 339–43
  • Frolov A A, Shulgina G I. Memory model based on plasticity of inhibitory neurons. Biofizika 1983; 28: 475–80, (in Russian)
  • Gantmakher F R. The Theory of Matrices. Nauka, Moscow 1966, (in Russian)
  • Gardner E. The space of interactions in neural network models. J. Phys. A.: Math. Gen. 1988; 21: 257–80
  • Girko V L. Theory of Random Determinants. Vysshaya Shkola, Kiev 1980, (in Russian)
  • Gradshtein I S, Ryzhik I S. Tables of Integrals, Sums, Series and Products. Fizmatgiz, Moscow 1963
  • Grossberg S. Adaptive resonance in development, perception and cognition. Mathematical Psychology and Psychophysiology, S Grossberg. American Mathematical Society, Providence, RI 1981; 107–56, SIAM-AMS Proc. 13
  • Hebb D O. The Organization of Behavior. Wiley, New York 1949
  • Hopfield J J. Neural network and physical systems with emergent collective computational abilities. Proc. Natl Acad. Sci. USA 1982; 79: 2554–8
  • Horner H. Neural networks with low levels of activity: Ising vs. McCulloch-Pitts neurons. Z. Phys. 1989; B 75: 133–6
  • Kohonen T. Analysis of a simple self-organizing process. Biol. Cybern. 1982; 44: 135–40
  • Korn G A, Korn T M. Mathematical Handbook (For Scientists and Engineers). McGraw-Hill, New York 1968
  • Kosko B. Adaptive bidirectional associative memories. Appl. Opt. 1987; 26: 4947–60
  • Little W A. The existence of persistent states in the brain. Math. Biosci. 1974; 19: 101–20
  • Litvinov E G, Frolov A A. Network of plastic neurons with unmodified synapses capable to conditioning (membrane model of learning). Biofizika 1978; 23: 1069–75, (in Russian)
  • Marr D. A theory of cerebral neocortex. Proc. R. Soc. London 1970; B 176: 161–234
  • Nadal J-P. Associative memory: on the (puzzling) sparse coding limit. J. Phys. A: Math. Gen. 1991; 24: 1093–101
  • Nadal J-P, Toulouse G. Information storage in sparse coded nets. Network 1990; 1: 64–74
  • Palm G. On associative memory. Biol. Cybern. 1981a; 36: 19–31
  • Palm G. On storage capacity of an associative memory with randomly distributed elements. Biol. Cybern. 1981b; 39: 125–7
  • Perez-Vicente C J, Amit D J. Optimized network for sparsely coded patterns. J. Phys. A: Math. Gen. 1989; 22: 559–69
  • Shannon C. Works on Information Theory and Cybernetics. Inostrannaya Literatura, Moscow 1963, (in Russian)
  • Sokolov E N. Orientation reflex, its structure and mechanisms. Orientation Reflex and Research Behaviour. APN RSFSR, Moscow 1958; 111–120, (in Russian)
  • Solomatin V F. Theory of associative memory with distributed information recording. Avtometria 1982; 29–34, (in Russian)
  • Steinbuch K. Die Lern Matrix. Kybernetik 1961; 1: 36
  • Tsodyks M V. Associative memory in neural networks with the Hebbian learning rule. Mod. Phys. Lett. 1989; B 3: 555–60
  • Tsodyks M V, Fiegelman M V. The enhanced storage capacity in neural networks with low activity level. Europhys. Lett. 1988; 6: 101–5
  • Vinogradova O S. Hippocampus and Memory. Nauka, Moscow 1978, (in Russian)
  • Willshaw D J, Buneman O P, Longuet-Higgins H C. Nonholographic associative memory. Nature 1969; 222: 960–2

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.