105
Views
78
CrossRef citations to date
0
Altmetric
Original Article

Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer

&
Pages 565-581 | Received 07 Jul 1994, Published online: 09 Jul 2009

Keep up to date with the latest research on this topic with citation updates for this article.

Read on this site (11)

Andrés Antico. (2012) Independent component analysis of MODIS-NDVI data in a large South American wetland. Remote Sensing Letters 3:5, pages 383-392.
Read now
Dirk Calow & Markus Lappe. (2008) Efficient encoding of natural optic flow. Network: Computation in Neural Systems 19:3, pages 183-212.
Read now
Li Zhaoping. (2006) Theoretical understanding of the early visual processes by data compression and data selection. Network: Computation in Neural Systems 17:4, pages 301-334.
Read now
Allan Gottschalk, Matthew G Sexton & Guilherme Roschke. (2004) Multiplicative neural noise can favor an independent components representation of sensory input. Network: Computation in Neural Systems 15:4, pages 291-311.
Read now
Y.-M. Cheung & L. Xu. (2003) A New Information-Theoretic Based Ica Algorithm For Blind Signal Separation. International Journal of Computers and Applications 25:2, pages 106-110.
Read now
Yogesh Singh & C. S. Rai. (2001) An information theoretic approach to blind source separation. Journal of Discrete Mathematical Sciences and Cryptography 4:2-3, pages 163-175.
Read now
Ángel Nevado, Antonio Turiel & Néstor Parga. (2000) Scene dependence of the non-Gaussian scaling properties of natural images. Network: Computation in Neural Systems 11:2, pages 131-152.
Read now
Jean-Pierre Nadal, Nicolas Brunel & Nestor Parga. (1998) Nonlinear feedforward networks with stochastic outputs: infomax implies redundancy reduction. Network: Computation in Neural Systems 9:2, pages 207-217.
Read now
Anthony J Bell & Terrence J Sejnowski. (1996) Learning the higher-order structure of a natural sound. Network: Computation in Neural Systems 7:2, pages 261-266.
Read now
Alessandro Campa, Paolo Del Giudice, Nestor Parga & Jean-Pierre Nadal. (1995) Maximization of mutual information in a linear noisy network: a detailed study. Network: Computation in Neural Systems 6:3, pages 449-468.
Read now

Articles from other publishers (67)

Jun Ma, Jiawei Fan, Lin Wang, C.L. Philip Chen, Bo Yang, Fengyang Sun, Jin Zhou, Xiaojing Zhang, Fenghui Gao & Na Zhang. (2023) Factorization of broad expansion for broad learning system. Information Sciences 630, pages 271-285.
Crossref
N. Parga, L. Serrano-Fernández & J. Falcó-Roget. (2023) Emergent computations in trained artificial neural networks and real brains. Journal of Instrumentation 18:02, pages C02060.
Crossref
Hua Li & Tianlong Zhang. 2022. Chemometrics and Numerical Methods in LIBS. Chemometrics and Numerical Methods in LIBS 127 187 .
Stefan F. Bucher & Adam M. Brandenburger. (2022) Divisive normalization is an efficient code for multivariate Pareto-distributed environments. Proceedings of the National Academy of Sciences 119:40.
Crossref
Laurent Bonnasse-Gahot & Jean-Pierre Nadal. (2022) Categorical Perception: A Groundwork for Deep Learning. Neural Computation 34:2, pages 437-475.
Crossref
Matthias Bethge. 2022. Encyclopedia of Computational Neuroscience. Encyclopedia of Computational Neuroscience 1257 1264 .
Mehdi Adibi & Ilan Lampl. (2021) Sensory Adaptation in the Whisker-Mediated Tactile System: Physiology, Theory, and Function. Frontiers in Neuroscience 15.
Crossref
Hamid Niknazar, Ali Motie Nasrabadi & Mohammad Bagher Shamsollahi. (2021) A new blind source separation approach based on dynamical similarity and its application on epileptic seizure prediction. Signal Processing 183, pages 108045.
Crossref
François Deloche. (2020) Fine-grained statistical structure of speech. PLOS ONE 15:3, pages e0230233.
Crossref
Eitan Z. Gross. (2020) Fisher information in Poissonian model neurons. Physica A: Statistical Mechanics and its Applications 542, pages 123451.
Crossref
Pierre Baudot. (2019) Elements of qualitative cognition: An information topology perspective. Physics of Life Reviews 31, pages 263-275.
Crossref
Julijana Gjorgjieva, Markus Meister & Haim Sompolinsky. (2019) Functional diversity among sensory neurons from efficient coding principles. PLOS Computational Biology 15:11, pages e1007476.
Crossref
Wenrui Zhang & Peng Li. (2019) Information-Theoretic Intrinsic Plasticity for Online Unsupervised Learning in Spiking Neural Networks. Frontiers in Neuroscience 13.
Crossref
Houssem Maghrebi & Emmanuel Prouff. 2018. Constructive Side-Channel Analysis and Secure Design. Constructive Side-Channel Analysis and Secure Design 61 81 .
Robert G Rasmussen, Andrew Schwartz & Steven M Chase. (2017) Dynamic range adaptation in primary motor cortical populations. eLife 6.
Crossref
Ameya Akkalkotkar & Kevin Scott Brown. (2017) An algorithm for separation of mixed sparse and Gaussian sources. PLOS ONE 12:4, pages e0175775.
Crossref
Lubomir Kostal & Ryota Kobayashi. (2015) Optimal decoding and information transmission in Hodgkin–Huxley neurons under metabolic cost constraints. Biosystems 136, pages 3-10.
Crossref
Jian-Xun Mi. (2014) A Novel Algorithm for Independent Component Analysis with Reference and Methods for Its Applications. PLoS ONE 9:5, pages e93984.
Crossref
Matthias Bethge. 2013. Encyclopedia of Computational Neuroscience. Encyclopedia of Computational Neuroscience 1 9 .
Md Shiblee & B. Chandra. (2013) Novel Approach for Blind Source Separation. Novel Approach for Blind Source Separation.
Fredrik Bengtsson, Romain Brasselet, Roland S. Johansson, Angelo Arleo & Henrik Jörntell. (2013) Integration of Sensory Quanta in Cuneate Nucleus Neurons In Vivo. PLoS ONE 8:2, pages e56630.
Crossref
Jeffrey A. Edlund, Nicolas Chaumont, Arend Hintze, Christof Koch, Giulio Tononi & Christoph Adami. (2011) Integrated Information Increases with Fitness in the Evolution of Animats. PLoS Computational Biology 7:10, pages e1002236.
Crossref
Chyun-Chau Fuh & Mei-Chuan Wang. (2010) A Combined Input-state Feedback Linearization Scheme and Independent Component Analysis Filter for the Control of Chaotic Systems with Significant Measurement Noise. Journal of Vibration and Control 17:2, pages 215-221.
Crossref
Stuart D. Wick, Martin T. Wiechert, Rainer W. Friedrich & Hermann Riecke. (2009) Pattern orthogonalization via channel decorrelation by adaptive networks. Journal of Computational Neuroscience 28:1, pages 29-45.
Crossref
Jan Eichhorn, Fabian Sinz & Matthias Bethge. (2009) Natural Image Coding in V1: How Much Use Is Orientation Selectivity?. PLoS Computational Biology 5:4, pages e1000336.
Crossref
Md. Shiblee, B. Chandra & P. K. Kalra. 2009. Advances in Neuro-Information Processing. Advances in Neuro-Information Processing 27 36 .
Andrei V. Medvedev, Jana Kainerstorfer, Sergey V. Borisov, Randall L. Barbour & John VanMeter. (2008) Event-related fast optical signal in a rapid object recognition task: Improving detection by the independent component analysis. Brain Research 1236, pages 145-158.
Crossref
Klaus Wimmer, K. Jannis Hildebrandt, R. Matthias Hennig & Klaus Obermayer. (2008) Adaptation and Selective Information Transmission in the Cricket Auditory Neuron AN2. PLoS Computational Biology 4:9, pages e1000182.
Crossref
Hao Miao, Xiaodong Li & Jing Tian. (2008) An EME blind source separation algorithm based on generalized exponential function. Journal of Electronics (China) 25:2, pages 262-267.
Crossref
Zhenhai Wang & C. H. Chen. (2007) Adaptive Blind Source Separation in Underwater Wireless Speech Communication. Adaptive Blind Source Separation in Underwater Wireless Speech Communication.
Naoki Masuda & Kazuyuki Aihara. (2007) Dual coding hypotheses for neural information representation. Mathematical Biosciences 207:2, pages 312-321.
Crossref
Matthias Bethge. (2006) Factorial coding of natural images: how effective are linear models in removing higher-order dependencies?. Journal of the Optical Society of America A 23:6, pages 1253.
Crossref
Bruno B. Averbeck, Peter E. Latham & Alexandre Pouget. (2006) Neural correlations, population coding and computation. Nature Reviews Neuroscience 7:5, pages 358-366.
Crossref
O.G. Sezer, Y. Altunbasak & A. Ercil. (2006) Subspace-based Super-resolution for Face Recognition from Video. Subspace-based Super-resolution for Face Recognition from Video.
. 2006. Face Processing. Face Processing 219 253 .
M.J. McKeown, R. Saab & R. Abu-Gharbieh. (2005) A Combined Independent Component Analysis (ICA)/ Empirical Mode Decomposition (EMD) Method to Infer Corticomuscular Coupling. A Combined Independent Component Analysis (ICA)/ Empirical Mode Decomposition (EMD) Method to Infer Corticomuscular Coupling.
X. Li, R. Du & X.P. Guan. (2004) Utilization of Information Maximum for Condition Monitoring With Applications in a Machining Process and a Water Pump. IEEE/ASME Transactions on Mechatronics 9:4, pages 711-714.
Crossref
Allan Gottschalk, Matthew Sexton & Guilherme Roschke. (2004) Multiplicative neural noise can favor an independent components representation of sensory input. Network: Computation in Neural Systems 15:4, pages 291-311.
Crossref
S.A. Cruces-Alvarez, A. Cichocki & S. Amari. (2004) From Blind Signal Extraction to Blind Instantaneous Signal Separation: Criteria, Algorithms, and Stability. IEEE Transactions on Neural Networks 15:4, pages 859-873.
Crossref
Bruno B. Averbeck & Lizabeth M. Romanski. (2004) Principal and Independent Components of Macaque Vocalizations: Constructing Stimuli to Probe High-Level Sensory Processing. Journal of Neurophysiology 91:6, pages 2897-2909.
Crossref
INES JENTZSCH. (2011) INDEPENDENT COMPONENT ANALYSIS SEPARATES SEQUENCE-SENSITIVE ERP COMPONENTS. International Journal of Bifurcation and Chaos 14:02, pages 667-678.
Crossref
Allan Kardec Barros, Andrzej Cichocki & Noboru Ohnishi. (2011) Wavelet-Like Receptive Fields Emerges by Non-Linear Minimization of Neuron Error. International Journal of Neural Systems 13:02, pages 87-91.
Crossref
M. Kermit & O. Tomic. (2003) Independent component analysis applied on gas sensor array measurement data. IEEE Sensors Journal 3:2, pages 218-228.
Crossref
Jianfeng Feng, Yunlian Sun, H. Buxton & Gang Wei. (2003) Training integrate-and-fire neurons with the informax principle II. IEEE Transactions on Neural Networks 14:2, pages 326-336.
Crossref
Rong-Bo Huang, Yiu-Ming Cheung & Shi-Ming Zhu. (2003) A parallel architecture using discrete wavelet transform for fast ICA implementation. A parallel architecture using discrete wavelet transform for fast ICA implementation.
M.S. Bartlett, J.R. Movellan & T.J. Sejnowski. (2002) Face recognition by independent component analysis. IEEE Transactions on Neural Networks 13:6, pages 1450-1464.
Crossref
Jianfeng Feng, Hilary Buxton & Yingchun Deng. (2002) Training the integrate-and-fire model with the informax principle: I. Journal of Physics A: Mathematical and General 35:10, pages 2379-2394.
Crossref
. 2014. Independent Component Analysis. Independent Component Analysis.
Filipe Aires, Alain Chédin & Jean-Pierre Nadal. (2000) Independent component analysis of multivariate time series: Application to the tropical SST variability. Journal of Geophysical Research: Atmospheres 105:D13, pages 17437-17455.
Crossref
Lei Xu. (2000) Temporal BYY learning for state space approach, hidden Markov model, and blind source separation. IEEE Transactions on Signal Processing 48:7, pages 2132-2144.
Crossref
Ángel Nevado, Antonio Turiel & Néstor Parga. (2000) Scene dependence of the non-Gaussian scaling properties of natural images. Network: Computation in Neural Systems 11:2, pages 131-152.
Crossref
Scott MakeigMarissa Westerfield, Jeanne Townsend, Tzyy-Ping Jung, Eric Courchesne & Terrence J. Sejnowski. (1999) Functionally independent components of early event-related potentials in a visual spatial attention task. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences 354:1387, pages 1135-1144.
Crossref
Michael S. Lewicki & Bruno A. Olshausen. (1999) Probabilistic framework for the adaptation and comparison of image codes. Journal of the Optical Society of America A 16:7, pages 1587.
Crossref
S.C. Douglas. (1999) Equivariant adaptive selective transmission. IEEE Transactions on Signal Processing 47:5, pages 1223-1231.
Crossref
S. Amari. (1999) Superefficiency in blind source separation. IEEE Transactions on Signal Processing 47:4, pages 936-944.
Crossref
Antonio Turiel, Elka Korutcheva & Néstor Parga. (1999) The mutual information of a stochastic binary channel: validity of the replica symmetry ansatz. Journal of Physics A: Mathematical and General 32:10, pages 1875-1894.
Crossref
Didier Herschkowitz & Jean-Pierre Nadal. (1999) Unsupervised and supervised learning:  Mutual information between parameters and observations. Physical Review E 59:3, pages 3344-3360.
Crossref
G. Donato, M.S. Bartlett, J.C. Hager, P. Ekman & T.J. Sejnowski. (1999) Classifying facial actions. IEEE Transactions on Pattern Analysis and Machine Intelligence 21:10, pages 974-989.
Crossref
Lei Xu. (1998) Bayesian Kullback Ying–Yang dependence reduction theory. Neurocomputing 22:1-3, pages 81-111.
Crossref
Jean-Pierre Nadal, Nicolas Brunel & Nestor Parga. (1998) Nonlinear feedforward networks with stochastic outputs: infomax implies redundancy reduction. Network: Computation in Neural Systems 9:2, pages 207-217.
Crossref
J.-F. Cardoso. (1998) Blind signal separation: statistical principles. Proceedings of the IEEE 86:10, pages 2009-2025.
Crossref
Elka Korutcheva, Nestor Parga & Jean-Pierre Nadal. (1997) Information processing by a noisy binary channel. Network: Computation in Neural Systems 8:4, pages 405-424.
Crossref
Scott Makeig, Tzyy-Ping Jung, Anthony J. Bell, Dara Ghahremani & Terrence J. Sejnowski. (1997) Blind separation of auditory event-related brain responses into independent components. Proceedings of the National Academy of Sciences 94:20, pages 10979-10984.
Crossref
Jean-francois Cardoso. (1997) Statistical Principles of Source Separation. IFAC Proceedings Volumes 30:11, pages 9-16.
Crossref
Shun-Ichi Amari & J.-F. Cardoso. (1997) Blind source separation-semiparametric statistical approach. IEEE Transactions on Signal Processing 45:11, pages 2692-2700.
Crossref
Anthony Bell & Terrence Sejnowski. (1996) Learning the higher-order structure of a natural sound. Network: Computation in Neural Systems 7:2, pages 261-266.
Crossref
Alessandro Campa, Paolo Del Giudice, Nestor Parga & Jean-Pierre Nadal. (1995) Maximization of mutual information in a linear noisy network: a detailed study. Network: Computation in Neural Systems 6:3, pages 449-468.
Crossref

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.