Advanced search
Publication Cover
Network: Computation in Neural Systems Volume 5, 1994 - Issue 1
Submit an article Journal homepage
11
Views
2
CrossRef citations to date
0
Altmetric
Original Article

Using generalized principal component analysis to achieve associative memory in a Hopfield net

S Coombes Centre for Neural Networks, King's College, University of London, Strand, London, WCZR 2LS, UK
&
J G Taylor Centre for Neural Networks, King's College, University of London, Strand, London, WCZR 2LS, UK
Pages 75-88 | Received 10 Jun 1993, Published online: 09 Jul 2009

References

  • Linsker R. Self-organization in a perceptual network. Computer 1988; 21: 105–117
  • Hertz J, Krogh A, Palmer R G. Introduction to the Theory of Neural Computation. Addison-Wesley, Reading, MA 1991, ch 8
  • Lee Y C, Doolen G, Chen H H, Sun G Z, Maxwell T, Lee H Y, Giles C L. Machine learning using a higher-order correlation network. Physica 1986; 22D: 276–306
  • Peretto P, Niez J J. Long-term memory storage capacity of multiconnected neural networks. Biol. Cybern. 1986; 54: 53–63
  • Giles L C, Maxwell T. Learning, invariance and generalisation in high-order neural networks. Appl. Opt. 1987; 26: 4972–8
  • Gardner E. Multiconnected neural network models. J. Phys. A: Math. Gen. 1987; 20: 3453–64
  • Amari S. Dualistic geometry of the manifold of higher-order neurons. Neural Networks 1991; 4: 443–51
  • Taylor J G, Coombes S. Learning higher-order correlations. Neural Networks 1993; 6: 423–8
  • Hopfield J J. Neural networks and physical systems with emergent collective computational abilities. Proc. Natl Acad. Sci USA 1982; 79: 2554–8
  • Edwards S F, Anderson P W. Theory of spin glasses. J. Phys. F. Metal Phys. 1975; 5: 965–74
  • Sherrington D, Kirkpatrick S. Solvable model of a spin glass. Phys. Rev. Lett. 1975; 35: 1792–6
  • Amit D J. Modeling Brain Function. Cambridge University Press, Cambridge 1989
  • Gardner E. The space of interactions in neural network models. J. Phys. A: Math. Gen. 1988; 21: 257–70
  • Kohring G A. Neural networks with many-neuron interactions. J. Physique 1990; 51: 145–55
  • Cover T. Geometrical and statistical properties of linear inequalities with applications in pattern recognition. IEEE Trans. Electron. Comput. 1965; 14: 326
  • Gardner E, Gutfreund H, Yekutieli I. The phase space of interactions in neural networks with definite symmetry. J. Phys. A: Math. Gen. 1989; 22: 1995–2008
  • Abu-Mostafu Y S, Jacques J S T. Information capacity of the Hopfield model. IEEE Trans. Inform. Theory 1985; IT-31: 461–4
  • Toulouse G, Dehaene S, Changeux J. Spin glass model of learning by selection. Proc. Natl Acad. Sci. USA 1986; 83: 1695–8
  • Krauth W, Mézard M. Learning algorithms with optimal stability in neural networks. J. Phys. A: Math. Gen. 1987; 20: L745–52
  • Abbot L F, Kepler T B. Optimal learning in neural network memories. J. Phys. A: Math. Gen. 1989; 22: L711–7
  • Monasson R. Properties of neural networks storing spatially correlated patterns. J. Phys. A: Math. Gen. 1992; 25: 3701–20
  • Oja E. A simplified neuron model as a principal components analyser. J. Math. Biol. 1982; 16: 267–73
  • Krogh A, Hertz J A. Hebbian learning of principal components. Parallel Processing in Neural Systems and Computers, R Eckmiller, G Hartmann, G Hauske. North-Holland, Amsterdam 1990; 183–6
  • Ljung L. Analysis of recursive stochastic algorithms. IEEE Trans. Automatic Control 1977; AC-22: 551–75
  • Davies T V, James E M. Non-Linear Differential Equations. Addison-Wesley, Reading, MA 1966
  • Xu L, Oja E, Suen C Y. Modified Hebbian learning for curve and surface fitting. Neural Networks 1993; 5: 441–57
  • Sanger T D. Optimal unsupervised learning in a single layer linear feedforward neural network. Neural Networks 1989; 2: 459–73
  • Muller B, Reinhardt J. Neural Networks: An Introduction. Springer, Berlin 1991
  • Atick J J. Could information theory provide an ecological theory of sensory processing?. Network 1992; 3: 213–51
  • Coombes S, Taylor J G. The storage and stabilization of patterns in a Hopfield net. Network submitted 1994
  • Kanter I, Sompolinsky H. Associative recall of memory without errors. Phys. Rev. A. 1987; 35: 380–92
  • Personnaz L, Guyon I, Drefus G. Collective computational properties of neural networks: new learning mechanisms. Phys. Rev. A. 1986; 34: 4217–28
  • van Hemmen J L, Kuhn R. Models of neural networks. Collective Phenomena in Neural Networks, E Domany, J L van Hemmen, K Schulten. Springer, Berlin 1991, ch 1
  • Opper M. Learning times of neural networks: exact solution for a perceptron algorithm. Phys. Rev. 1988; A 38: 3824–6
  • Muller K, Waldenspuhl A. Performance comparison of learning algorithms in Hopfield networks. Artifical Neural Networks, I Aleksander, J G Taylor. Elsevier, Amsterdam 1992; 2: 961–4
  • Gorse D, Taylor J G. Learning higher-order principal components by pRAMS, in preparation. 1993

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.