76
Views
5
CrossRef citations to date
0
Altmetric
TOPICAL REVIEW

Mutual information maximization: models of cortical self-organization

Pages 7-31 | Received 24 Oct 1995, Published online: 26 Feb 2018

References

  • Hancock P J B, Smith L S and Phillips W A 1991 A biologically supported error-correcting learning rule Neural Comput. 3 201–12
  • Rumelhart D E, Hinton G E and Williams R J 1986 Learning internal representations by back-propagating errors Nature 323 533–6
  • Linsker R 1988 Self-organization in a perceptual network IEEE Computer 21 105–17
  • Barlow H B 1985 Cognitronics: methods for acquiring and holding cognitive knowledge, unpublished manuscript
  • Barlow H B 1989 Unsupervised learning Neural Comput. 1 295–311
  • Atick J J and Redlich A N 1990 Towards a theory of early visual processing Neural Comput. 2 308–20
  • Bialek W, Ruderman D L and Zee A 1991 Optimal sampling of natural images: A design principle for the visual system? Advances in Neural Information Processing Systems vol 3, ed R P Lippmann et al (San Mateo, CA: Morgan Kaufmann) pp 363–9
  • Plumbley M D 1993 Efficient information transfer and anti-hebbian neural networks Neural Networks 6 823–33
  • Shannon C E 1948 A mathematical theory of communication Bell Sys. Tech. J. 27 379–423, 623–56
  • Atick J J 1992 Could information theory provide an ecological theory of sensory processing? Network 3 213–52
  • Laughlin S B 1987 Form and function in retinal processing Trends in Neurosci. 10 478–83
  • Becker S and Hinton G E 1992 A self-organizing neural network that discovers surfaces in random-dot stereograms Nature 355 161–3
  • Becker S 1992 An information-theoretic unsupervised learning algorithm for neural networks PhD Thesis University of Toronto, also published as Technical Report CRG-TR9a-3
  • Bahl L R, Brown P F, de Souza P V and Mercer R L 1989 A tree-based statistical language model for natural language speech recognition IEEE Trans. Acoust., Speech, Sig. Proc. 37 1001–8
  • Brown P F, Della Pietra V J, de Souza P V, Lai J C and Mercer R L 1990 Class-based n-gram models of natural language Proc. IBM Natural Language ITL pp 283–98
  • Becker S and Hinton G E 1995 Using spatial coherence as an internal teacher for a neural network Back-Propagation: Theory, Architectures and Applications ed Y Chauvin and D E Rumelhart (Hillsdale, NJ: Erlbaum) pp 313–49
  • Phillips W A, Kay J and Smyth D 1995 The discovery of structure by multi-stream networks of local processors with contextual guidance Network 6 225–46
  • Kay J 1995 Probabilistic modelling of a binary multiple output local processor: local objective functions, local learning rules and approximations based on information theoretic ideas, unpublished manuscript
  • de Sa V R and Ballard D 1995 Neural networks for different modalities to teach each other, in preparation
  • Bridle J S 1990 Training stochastic model recognition algorithms as networks can lead to maximum mutual information estimation of parameters Advances in Neural Information Processing Systems vol 2, ed D S Touretzky (San Mateo, CA: Morgan Kaufmann) pp 111–217
  • Becker S 1993 Learning to categorize objects using temporal coherence Advances in Neural Information Processing Systems vol 5, ed S J Hanson et al (San Mateo, CA: Morgan Kaufmann) pp 361–8
  • Edelman S 1995 Representation of similarity in three-dimensional object discrimination Neural Comput. 7 408–23
  • Peterson G E and Barney H L 1952 Control methods used in a study of vowels J. Acoust. Soc. Am. 24 175–84
  • de Sa V R 1994 Learning classification with unlabeled data Advances in Neural Information Processing Systems vol 6 (San Mateo, CA: Morgan Kaufmann) pp 112–9
  • Dempster A P, Laird N M and Rubin D B 1977 Maximum likelihood from incomplete data via the EM algorithm Proc. R. Stat. Soc. B 39 1–38
  • Nowlan S J 1990 Maximum likelihood competitive learning Neural Information Processing Systems vol 2 ed D S Touretzky (San Mateo, CA: Morgan Kaufmann) pp 574–82
  • Ghahramani Z 1995 Computation and Psychophysics of Sensorimotor Integration PhD Thesis MIT, Department of Brain and Cognitive Sciences
  • Mardia K V, Kent J T and Bibby J M 1979 Multivariate Analysis (New York: Academic)
  • Kay J 1992 Feature discovery under contextual supervision using mutual information Proc. Int. Joint Conf. Neural Networks vol IV, pp 79–84
  • Becker S and Hinton G E 1993 Learning mixture models of spatial coherence Neural Comput. 5 267–77
  • Stone J 1995 Learning perceptually salient visual parameters using spatio-temporal smoothness constraints Neural Comput. to appear
  • Ukrainec A and Haykin S 1995 A mutual information-based learning strategy and its application to radar Fuzzy Logic and Neural Network Handbook (McGraw Hill)
  • Ukrainec A and Haykin S 1996 A modular neural network for enhancement of cross-polar radar targets Neural Networks to appear
  • Haykin S 1992 Polarimetrie radar for accurate navigation Can. J. Elec. Comput. Eng. 17 130–5
  • Zemel R S and Hinton G E 1991 Discovering viewpoint-invariant relationships that characterize objects Advances In Neural Information Processing Systems vol 3, ed R P Lippmann et al (San Mateo, CA: Morgan Kaufmann) pp 299–305
  • Bell T J and Sejnowski T J 1995 An information-maximisation approach to blind separation and blind deconvolution Neural Comput. to appear
  • Yuille A L, Stelios M S and Xu L 1994 Bayesian self-organization driven by prior probability distributions Neural Comput. 7 580–93
  • Becker S 1995 JPMAX: Learning to recognize moving objects as a model-fitting problem Advances in Neural Information Processing Systems vol 7 (MIT) pp 933–40
  • Ukrainec A and Haykin S 1991 Application of unsupervised neural networks to the enhancement of polarization targets in dual-polarized radar images IEEE Can. Conf. Elec. Comput. Eng.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.