681
Views
362
CrossRef citations to date
0
Altmetric
Review Article

Could information theory provide an ecological theory of sensory processing?

Pages 213-251 | Received 31 Dec 1991, Published online: 09 Jul 2009

References

  • Atick J J, Redlich A N. Towards a theory of early visual processing. Neural Computation 1990a; 2: 308–20
  • Atick J J. Quantitative tests of a theory of retinal processing: contrast sensitivity curves. Report. Inst. for Advanced Study IASSNS-HEP-90/51. 1990b, submitted for publication
  • Atick J J. What does the retina know about natural scenes?. Neural Computation 1992a; 4: 196–210
  • Atick J J. Convergent algorithm for sensory receptive field development. Report. Inst. for Advanced Study IASSNS-HEP-91/80. 1992b, submitted for publication
  • Atick J J, Li Z, Redlich A N. Color coding and its interaction with spatiotemporal processing in the retina. Report. Inst. for Advanced Study IASSNS-HEP-90/75. 1990
  • Atick J J. Understanding retinal color coding from first principles. Report Inst. for Advanced Study 1991, IASSNS-HEP-91/1 (1992 Neural Computation, in press)
  • Atick J J. What does post-adaptation color appearance reveal about cortical color representation?. Report. Inst. for Advanced Study IASSNS-HEP-92/7. 1992, submitted for publication
  • Attneave F. Some informational aspects of visual perception. Psychol. Rev. 1954; 61: 183–93
  • Barlow H B. Possiple principles underlying the transformation of sensory messages. Sensory Communication, W A Rosenblith. MIT Press, Cambridge, MA 1961
  • Barlow H B. Perception: what quantitative laws govern the acquisition of knowledge from the senses?. Functions of the Brain, C W Coen. Clarendon, Oxford 1985
  • Barlow H B. Unsupervised learning. Neural Computation 1989; 1: 295–311
  • Barlow H B, Hawken M, Kaushal T P, Parker A J. Human contrast discrimination and the contrast discrimination of cortical neurons. J. Opt. Soc. Am. A 1987; 4: 2366–71
  • Barlow H B, Foldiak P. The Computing Neuron. Addison-Wesley, Reading, MA 1989
  • Barlow H B, Kaushal T P, Mitchison G J. Finding minimum entropy codes. Neural Computation 1989; 1: 412–23
  • Barnard G A. Statistical calculations of word entropies for four western languages. IRE Trans. Inform. Theory 1955; 1: 49–53
  • Bialek W. Theoretical physics meets experimental neurobiology. Lectures in Complex Systems (SFI Studies in the Sciences of Complexity, Lecture vol II), E Jen. Addison-Wesley, Menlo Park, CA 1990
  • Bialek W, Rieke F, de Ruyter van Steveninck R R, Warland D. Reading a neural code. Science 1991; 252: 1854–57
  • Bialek W, Ruderman D L, Zee A. Optimal sampling of natural images: A design principle for the visual system?. Advances in Neural Information Processing Systems, R P Lippmann, J E Moody, D S Touretzky. Morgan Kaufman, San Mateo, CA 1991; 3
  • Buchsbaum G, Gottschalk A. Trichromacy, opponent colours coding and optimum colour information transmission in the retina. Proc. R. Soc. Lond. B 1983; 220: 89–113
  • Campbell F W, Gubisch R W. Optical quality of the human eye. J. Physiol. 1966; 186: 558–78
  • Davson H. Physiology of the Eye. Academic, London 1980
  • Daw N W. Colour-coded ganglion cells in the goldfish retina: extension of their receptive fields by means of new stimuli. J. Physiol. 1968; 197: 567–92
  • De Monasterio F M, McCrane E P, Newlander J K, Shein S J. Density profiles of blue-sensitive cones along the horizontal meridian of macaque retina. Invest. Opthalmol. Vis. Sci. 1985; 26: 289–302
  • Derrington A M, Krauskopf J, Lennie P. Chromatic mechanisms in lateral geniculate nucleus of macaque. J. Physiol. 1984; 357: 241–65
  • De Valois R L, Morgan H, Snodderly D M. Psychophysical studies of monkey vision: III spatial luminance contrast sensitivity tests of macaque and human observers. Vision Res. 1974; 14: 75–81
  • Enroth-Cugell C, Robson J G. The contrast sensitivity of retinal ganglion cells of the cat. J. Physiol. 1966; 187: 517–52
  • Field D J. Relations between the statistics of natural images and the response properties of cortical cells. J. Opt. Soc. Am. A 1987; 4: 2379–94
  • Field D J. What the statistics of natural images tell us about visual coding. Human Vision, Visual Processing and Digital Display (Proc. SPIE 1077) 1989; 269–76
  • Gallager R G. Information Theory and Reliable Communication. Wiley, New York 1968
  • Geman S, Geman D. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Machine Intell. 1984; 6: 721–41
  • Goodall M C. Performance of stochastic net. Nature 1960; 185: 557–8
  • Gouriet G G. A method of measuring television picture detail. Electron. Eng. 1952; 24: 308
  • Harrison G W. Experiments with linear prediction in television. Bell System Tech. J. 1952; 31: 764
  • Hentschel H G, Barlow H B. Minimum-entropy coding with Hopfield networks. Netw, Comput. Neural Syst. 1991; 2: 135–48
  • Hinton G E, Sejnowski T J. Optimal perceptual inference. Proc. IEEE Conf. Computer Vision and Pattern Recognition. Washington, DC. IEEE, Piscataway, NJ 1983; 448–53
  • Jacobson H. The informal capacity of the human eye. Science 1951; 113: 292–3
  • Kelly D H. Adaptation effects on spatio-temporal sine-wave thresholds. Vision Res. 1972; 12: 89–101
  • Kersten D. Statistical limits to image understanding. Vision: Coding and Efficiency, C Blakemore. Cambridge University Press, Cambridge 1990
  • Kretzmer E R. Statistics of television signals. Bell System Tech. J. 1952; 31: 751–63
  • Kornhuber H H. Neural control of input into long term memory: limbic system and amnestic syndrome in man. Memory and Transfer of Information, H P Zippel. Plenum, New York 1973
  • Laughlin S B. A simple coding procedure enhances a neuron's information capacity. Z. Naturf. 1981; 36c: 910–2
  • Laughlin S B. Form and function in retinal processing. Trends Neurosci. 1987; 10: 478–83
  • Laughlin S B. Coding efficiency and design in visual processing. Facets of Vision, D G Stavenga, R C Hardie. Springer, Berlin 1989
  • Linsker R. Self-organization in a perceptual network. Computer March 1988, 1988; 21105–17
  • Linsker R. An application of the principle of maximum information preservation to linear systems. Advances in Neural Information Processing Systems, D S Touretzky. Morgan Kaufman, San Mateo, CA 1989a; 1: 186–94
  • Linsker R. How to generate ordered maps by maximizing the mutual information between input and output signals. Neural Computation 1989b; 1: 402–11
  • Lythgoe J N. The Ecology of Vision. Oxford University Press, Oxford 1979
  • Mullen K T. The contrast sensitivity of human colour vision to red-green and blue-yellow chromatic gratings. J. Physiol. 1985; 359: 381–400
  • Papoulis A. Probability, Random Variables, and Stochastic Processes. McGraw-Hill, New York 1984
  • Pearlmutter B A, Hinton G E. G-maximization: an unsupervised learning procedure for discovering regularities. Neural Networks for Computing (AIP Conf. Proc. 151). J S Denker. AIP, New York 1986
  • Pratt F. Secret and Urgent. Blue Ribbon Books, New York 1942
  • Redlich A N. Redundancy reduction as a strategy for unsupervised learning. Report. Inst. for Advanced Study IASSNS-HEP-91/87. 1991
  • Schreiber W F. The measurement of third order probability distributions of television signals. IRE Trans. Inform. Theory 1956; 2: 94–105
  • Shannon C E. Prediction and entropy of printed English. Bell System Tech. J. 1951; 30: 50–64
  • Shannon C E, Weaver W. The Mathematical Theory of Communication. University of Illinois Press, Urbana, IL 1949
  • Shapley R, Enroth-Cugell C. Prog. Retinal Research 1984,. Visual adaptation and retinal gain controls; 3: 263–346
  • Shaw S R. Early visual processing in insects. J. Exp. Biol. 1984; 112: 225–51
  • Srinivisan M V, Laughlin S B, Dubs A. Predictive coding: a fresh view of inhibition in the retina. Proc. R. Soc. Lond. B 1982; 216: 427–59
  • Sterling P. Retina. The Synaptic Organization of the Brain, G Shepherd. Oxford University Press, Oxford 1990
  • Sziklai G. Some studies in the speed of visual perception. IRE Trans. Inform. Theory 1956; 2: 125–8
  • Uttley A M. Information Transmission in the Nervous System. Academic, London 1979
  • Van Essen D C, Anderson C H. Information processing strategies and pathways in the primate retina and visual cortex. Introduction to Neural and Electronic Networks. Academic, Orlando, FL 1988
  • Van Essen D C, Olshausen B, Anderson C H, Gallant J L. Pattern recognition, attention, and information bottlenecks in the primate visual system. Conf. on Visual Information Processing: From Neurons to Chips (SPIE Proc. 1473). 1991
  • Van Nes F L, Bouman M A. Spatial modultion transfer in the human eye. J. Opt. Soc. Am. 1967; 57: 401–6
  • Warland D, Landolfa M A, Miller J P, Bialek W. Reading between the spikes in the cercel filiform hair receptors of the cricket. Analysis and Modeling of Neural Systems, F Eeckman. Kluwer, Norwell, MA 1992
  • Watanabe S. Pattern recognition as a quest for minimum entropy. Pattern Recognition 1981; 13: 381–7
  • Watanabe S. Pattern Recognition: Human and Mechanical. Wiley, New York 1985

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.