Estimating linear–nonlinear models using Rényi divergences

References

• Ahrens MB, Paninski L, Sahani M. Inferring input nonlinearities in neural encoding models. Network: Computation in Neural Systems 2008; 19: 35–67
   PubMed Web of Science ®Google Scholar
• Aldworth ZN, Miller JP, Gedeon T, Cummins GI, Dimitrov AG. Dejittered spike-conditioned stimulus waveforms yield improved estimates of neuronal feature selectivity and spike-timing precision of sensory interneurons. Journal of Neuroscience 2005; 25: 5323–5332
   PubMed Web of Science ®Google Scholar
• Ali SM, Silvey SD. A general class of coefficient of divergence of one distribution from another. Journal of Royal Statistical Society B 1966; 28: 131–142
   Google Scholar
• Bell AJ, Sejnwoski TJ. An information-maximization approach to blind separation and blind deconvolution. Neural Computation 1995; 7: 1129–1159
   PubMed Web of Science ®Google Scholar
• Bialek W, de Ruyter van Steveninck RR. Features and dimensions: Motion estimation in fly vision. 2005, arXiv:q-bio/0505003v1
   Google Scholar
• Brenner N, Strong SP, Koberle R, Bialek W, de Ruyter van Steveninck RR. Synergy in a neural code. Neural Computation 2000; 12: 1531–1552, See also physics/9902067
   PubMed Web of Science ®Google Scholar
• Cardoso JF. Infomax and maximum likelihood for blind source separation. Signal Processing Letters, IEEE 1997; 4: 112–114
   Web of Science ®Google Scholar
• Christianson GB, Sahani M, Linden JF. The consequences of response nonlinearities for interpretation of spectrotemporal receptive fields. Journal of Neuroscience 2008; 28: 446–455
   PubMed Web of Science ®Google Scholar
• Cover TM, Thomas JA. Information theory. John Wiley & Sons, INC, New York 1991
   Google Scholar
• Csiszár I. Information-type measures of difference of probability distributions and indirect observations. Studia Scientarium Mathematicarum Hungararica 1967; 2: 299–318
   Google Scholar
• Daniels HE. The asymptotic efficiency of a maximum likelihood estimator. Proceeding of the Fourth Symposium on Mathematical Statistics and Problems 1961; 1: 151–163
   Google Scholar
• David SV, Gallant JL. Predicting neuronal responses during natural vision. Network 2005; 22: 239–260
   Web of Science ®Google Scholar
• David SV, Hayden BY, Gallant JL. Spectral receptive field properties explain shape selectivity in area V4. Journal of Neurophysics 2006; 96: 3492–3505
   PubMed Web of Science ®Google Scholar
• Dayan P, Abbott LF. Theoretical neuroscience: Computational and mathematical modeling of neural systems. MIT Press, Cambridge 2001
   Google Scholar
• de Boer E, Kuyper P. Triggered correlation. IEEE Transactions Biomedical Engineering 1968; 15: 169–179
   PubMed Web of Science ®Google Scholar
• de Ruyter van Steveninck RR, Bialek W. Real-time performance of a movement-sensitive neuron in the blowfly visual system: Coding and information transfer in short spike sequences. Proceeding of the Royal Society London B 1988; 265: 259–265
   Google Scholar
• Dimitrov AG, Gedeon T. Effects of stimulus transformations on estimates of sensory neuron selectivity. Journal of Computational Neuroscience 2006; 20: 265–283
   PubMed Web of Science ®Google Scholar
• Dimitrov AG, Miller JP, Gedeon T, Aldworth Z, Parker AE. Analysis of neural coding through quantization with an information-based distortion measure. Network: Computation Neural Systems 2003; 14: 151–176
   PubMed Web of Science ®Google Scholar
• Dimitrov AG, Sheiko MA, Baker J, Yen SC. Spatial and temporal jitter distort estimated functional properties of visual sensory neurons. 2009, DOI: 10.1007/S10827-009-0144-8. Journal of Computational Neuroscience [Epub ahead of print]
   Google Scholar
• Felsen G, Touryan J, Han F, Dan Y. Cortical sensitivity to visual features in natural scenes. Public Library of Science Biology 2005; 3: 1819–1828
   Google Scholar
• Gollisch T. Estimating receptive fields in the presence of spike-time jitter. Network: Computation in Neural Systems 2006; 17: 103–129
   PubMed Web of Science ®Google Scholar
• Harremoës P, Tishby N. The information bottleneck revisited or how to choose a good distortion measure. Proceeding of the IEEE International Symposium on Information Theory (ISIT) 2007
   Google Scholar
• Hinton GE, Sejnowski TJ. Learning and relearning in Boltzmann machines. Parallel distributed processing: Explorations in the microstructure of cognition, DE Rumelhart, JL McClelland. MIT Press, Cambridge 1986; 282–317
   Google Scholar
• Hunter IW, Korenberg MJ. The identification of nonlinear biological systems: Wiener and hammerstein cascade models. Biological Cybernetics 1986; 55: 135–144
   PubMed Web of Science ®Google Scholar
• Kinney JB, Tkaćik G, Callan CG. Precise physical models of protein-DNA interaction from high-throughput data. Proceeding of the National Academy of Science 2007; 104: 501–506
   PubMed Web of Science ®Google Scholar
• MacKay D. Information theory, inference, and learning algorithms. Cambridge University Press, Cambridge 2003
   Google Scholar
• Marmarelis VZ. Modeling methodology for nonlinear physiological systems. Annals of Biomedical Engineering 1997; 25: 239–251
   PubMed Web of Science ®Google Scholar
• Paninski L. Convergence properties of three spike-triggered average techniques. Network: Computation Neural Systems 2003; 14: 437–464
   PubMed Web of Science ®Google Scholar
• Paninski L. Maximum likelihood estimation of cascade point-process neural encoding models. Network: Computation in Neural Systems 2004; 15: 243–262
   PubMed Web of Science ®Google Scholar
• Pillow JW, Paninski L, Uzzell VJ, Simoncelli EP, Chichilnisky EJ. Prediction and decoding of retinal ganglion cell responses with a probabilistic spiking model. Journal of Neuroscience 2005; 25: 11003–11013
   PubMed Web of Science ®Google Scholar
• Pillow JW, Shlens J, Paninski L, Shar A, Litke AM, Chichilnisky EJ, Simoncelli EP. Spatio-temporal correlations and visual signaling in a complete neural population. Nature 2008; 454: 995–999
   PubMed Web of Science ®Google Scholar
• Press WH, Teukolsky SA, Vetterling WT, Flannery BP. Numerical Recipes in C: The Art of Scientific Computing. Cambridge University Press, Cambridge 1992
   Google Scholar
• Rényi, A. 1961. On measures of entropy and information. In: Neyman, J, editor. Proceeding of the Fourth Berkeley Symposium Mathematical Statistics Problems. Vol. 1: pp 547–561.
   Google Scholar
• Rieke F, Warland D, de Ruyter van Steveninck RR, Bialek W. Spikes: Exploring the neural code. MIT Press, Cambridge 1997
   Google Scholar
• Ringach DL, Hawken MJ, Shapley R. Receptive field structure of neurons in monkey visual cortex revealed by stimulation with natural image sequences. Journal of Vision 2002; 2: 12–24
   PubMed Web of Science ®Google Scholar
• Ringach DL, Sapiro G, Shapley R. A subspace reverse-correlation technique for the study of visual neurons. Vision Research 1997; 37: 2455–2464
   PubMed Web of Science ®Google Scholar
• Ruderman DL, Bialek W. Statistics of natural images: Scaling in the woods. Physical Review Letters 1994; 73: 814–817
   PubMed Web of Science ®Google Scholar
• Rust NC, Schwartz O, Movshon JA, Simoncelli EP. Spatiotemporal elements of macaque v1 receptive fields. Neuron 2005; 46: 945–956
   PubMed Web of Science ®Google Scholar
• Sahani M. Neural coding. [Published 2008]. 2008, Available from: http://www.gatsby.ucl.ac.uk/~maneesh/
   Google Scholar
• Schwartz O, Pillow JW, Rust NC, Simoncelli EP. Spike-triggered neural characterization. Journal of Vision 2006; 176: 484–507
   Google Scholar
• Sharpee T, Rust NC, Bialek W. 2004. Analyzing neural responses to natural signals: Maximally informative dimensions. Neural Computation 16:223–250, 2004. [See also physics/0212110 and a preliminary account in Advances in Neural Information Processing 15 edited by Becker S, Thrun S, Obermayer K. 2003. pp. 261–268.].
   Google Scholar
• Sharpee TO. Comparison of information and variance maximization strategies for characterizing neural feature selectivity. Statistics in Medicine 2007; 26: 4009–40031
   PubMed Web of Science ®Google Scholar
• Sharpee TO, Sugihara H, Kurgansky AV, Rebrik SP, Stryker MP, Miller KD. Adaptive filtering enhances information transmission in visual cortex. Nature 2006; 439: 936–942
   PubMed Web of Science ®Google Scholar
• Simoncelli EP, Olshausen BA. Natural image statistics and neural representation. Annual Review of Neuroscience 2001; 24: 1193–1216
   PubMed Web of Science ®Google Scholar
• Theunissen FE, David SV, Singh NC, Hsu A, Vinje WE, Gallant JL. Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli. Network 2001; 3: 289–316
   Google Scholar
• Tishby N, Pereira FC, Bialek W. The information bottleneck method. Proceedings of the 37th Allerton Conference on Communication Control and Computing. 1999, B Hajek, RS Sreenivas. University of Illinois, 368–377, [See also physics/0004057.]
   Google Scholar
• Weisberg S, Welsh AH. Adapting for the missing link. Annals of Statistics 1994; 22: 1674–1700
   Web of Science ®Google Scholar