28
Views
8
CrossRef citations to date
0
Altmetric
Original Article

Maximization of mutual information in a linear noisy network: a detailed study

, , &
Pages 449-468 | Received 10 Mar 1995, Published online: 09 Jul 2009

References

  • Barlow H B. Unsupervised learning. Neural Comput. 1989; 1: 295–311
  • Linsker R. Self-organization in a perceptual network. Computer 1988; 21: 105–17
  • Atick J J. Could information theory provide an ecological theory of sensory processing?. Network 1992; 3: 213–51
  • Oja E. A simplified neuron model as a principal component analyzer. J. Math. Biol. 1982; 15: 267–73
  • Sanger T D. Optimal unsupervised learning in a single-layer linear feedforward neural network. Neural Networks 1989; 2: 459–73
  • Hertz J A, Krogh A, Palmer R G. Introduction to the Theory of Neural Computation. Addison-Wesley, Reading, MA 1991
  • Oja E. Neural networks, principal components, and subspaces. Int. J. Neural Syst. 1989; 1: 61–8
  • Krogh A, Hertz J A. Hebbian learning of principal components. Parallel Processing in Neural Systems and Computers, R Eckmiller, G Hartmann, G Hauske. Elsevier, Amsterdam 1990; 183–6
  • Barlow H B. The coding of sensory messages. Current Problems in Animal Behaviour, W H Thorpe, O L Zangwill. Cambridge University Press, Cambridge 1990; 331–60
  • Linsker R. Deriving receptive fields using an optimal encoding criterion. Advances in Neural Information Processing Systems 5, S J Hanson, J Cowan, C L Giles. Morgan Kaufmann, San Mateo, CA 1993; 953–60
  • Atick J J, Redlich A N. Quantitative tests of a theory of retinal processing: contrast sensitivity curves. Preprint 1990, IASSNS-HEP-90/51
  • van Hateren J H. Theoretical predictions of spatiotemporal receptive fields of fly LMCs, and experimental validation. J. Comp. Physiol. A 1992; 71: 157–70
  • Goldman S. Information Theory. Dover, New York 1953
  • Cover T M, Thomas J A. Elements of Information Theory. Wiley, New York 1991
  • Campa A, Del Giudice P, Nadal J-P, Parga N. Neural networks as optimal information processors. Int. J. Mod. Phys. C 1994; 5: 855–62
  • Ruderman D L. Designing receptive fields for highest fidelity. Network 1994; 5: 147–55
  • Atick J J, Li Z, Redlich A N. Color coding and its interaction with spatiotemporal processing in the retina. Preprint 1990, IASSNS-HEP-90/75
  • Nadal J-P, Parga N. Nonlinear neurons in the low noise limit: a factorial code maximizes information transfer. Network 1994; 5: 565–81

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.