Multi-network evolutionary systems and automatic decomposition of complex problems

References

• Abu-Mostafa , Y.S. 1993 . “ A method for learning from hints ” . In Advances in Neural Information Processing Systems , Edited by: Hanson , S.J. , Cowan , J. and Giles , C.L. Vol. 5 , 73 – 80 . San Mateo, CA : Morgan Kaufmann .
   Google Scholar
• Bishop , C.M. 1996 . Neural Networks for Pattern Recognition , Oxford, UK : Oxford University Press .
   Google Scholar
• Brown , G. 2004 . “ Diversity in neural network ensembles ” . PhD thesis University of Birmingham .
   Google Scholar
• Bullinaria , J.A. 2002 . “ To modularize or not to modularize? ” . In Proceedings of the 2002 U.K. Workshop on Computational Intelligence (UKCI-02) , Birmingham Edited by: Bullinaria , J. 3 – 10 .
   Google Scholar
• Calabretta , R. , Nolfi , S. , Parisi , D. and Wagner , G.P. 1998 . “ A case study of the evolution of modularity: towards a bridge between evolutionary biology, artificial life, neuro- and cognitive science ” . In Proceedings of the Sixth International Conference on Artificial Life (ALIFE VI) , Edited by: Adami , C. , Belew , R.K. , Kitano , H. and Taylor , C.E. 275 – 284 . Cambridge, MA : MIT Press .
   Google Scholar
• Ferdinando , A.D. , Calabretta , R. and Parisi , D. 2001 . “ Evolving modular architectures for neural networks ” . In Proceedings of the Sixth Neural Computation and Psychology Workshop , Edited by: French , R.M. and Sougné , J.P. 253 – 264 . New York : Springer Verlag .
   Google Scholar
• García-Pedrajas , N. , Hervás-Martínez , C. and Muñoz-Pérez , J. 2002 . Multi-objective cooperative coevolution of artificial neural networks . Neural Networks , 15 : 1259 – 1278 .
   Google Scholar
• García-Pedrajas , N. , Hervás-Martínez , C. and Ortiz-Boyer , D. 2005 . Cooperative coevolution of artificial neural network ensembles for pattern classification . IEEE Trans. Evolution. Comput. , 9 : 271 – 302 .
   Web of Science ®Google Scholar
• Gruau , F. , Whitley , D. and Pyeatt , L. 1996 . “ A comparison between cellular encoding and direct encoding for genetic neural networks ” . In Genetic Programming 1996: Proceedings of the First Annual Conference , Edited by: Koza , J.R. , Goldberg , D.E. , Fogel , D.B. and Riolo , R.L. 81 – 89 . Cambridge, MA : MIT Press .
   Google Scholar
• Hansen , J.V. 2000 . “ Combining predictors: Meta machine learning methods and bias/variance and ambiguity decompositions ” . PhD thesis Aarhus Universitet, Datalogisk Institut .
   Google Scholar
• Hrycej , T. 1992 . Modular Learning in Neural Networks. A Modularized Appproach to Neural Network Classification , New York : Wiley .
   Google Scholar
• Hüsken , M. , Gayko , J.E. and Sendhoff , B. 2000 . “ Optimization for problem classes—neural networks that learn to learn ” . In 2000 IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks (ECNN 2000) , Edited by: Yao , X. and Fogel , D.F. 98 – 109 . New York : IEEE Press .
   Google Scholar
• Hüsken , M. , Igel , C. and Toussaint , M. 2002 . Task-dependent evolution of modularity in neural networks . Connect. Sci. , 14 : 219 – 229 .
   Web of Science ®Google Scholar
• Igel , C. and Hüsken , M. 2003 . Empirical evaluation of the improved Rprop learning algorithm . Neurocomput. , 50 : 105 – 123 .
   Web of Science ®Google Scholar
• Jacobs , R.A. , Jordan , M.I. and Barto , A.G. 1991a . Task decomposition through competition in a modular connectionist architecture: the what and where vision tasks . Cognitive Sci. , 15 : 219 – 250 .
   Web of Science ®Google Scholar
• Jacobs , R.A. , Jordan , M.I. , Nowlan , S.J. and Hinton , G.E. 1991b . Adaptive mixtures of local experts . Neural Comput. , 3 : 79 – 87 .
   PubMed Web of Science ®Google Scholar
• Jenkins , R.E. and Yuhas , B.P. 1992 . A simplified neural-network solution through problem decomposition: the case of the truck backer-upper . Neural Comput. , 4 : 647 – 649 .
   Google Scholar
• Jordan , M.I. and Jacobs , R.A. 1995 . “ Modular and hierarchical learning systems ” . In The Handbook of Brain Theory and Neural Networks , Edited by: Arbib , M. 579 – 582 . Cambridge, MA : MIT Press .
   Google Scholar
• Khare , V.R. , Yao , X. Sendhoff , B. 2004 . “ Credit assignment among neurons in co-evolving populations ” . In 8th International Conference on Parallel Problem Solving from Nature, PPSN VIII, Lecture Notes in Computer Science , Edited by: X.Y. Vol. 3242 , 882 – 891 . New York : Springer Verlag .
   Google Scholar
• Khare , V.R. , Yao , X. , Sendhoff , B. , Jin , Y. and Wersing , H. 2005 . “ Co-evolutionary modular neural networks for automatic problem decomposition ” . In 2005 IEEE Congress on Evolutionary Computation, CEC 2005 , Edinburgh, UK, IEEE Press pp. 2691–2698
   Google Scholar
• Kohavi , R. and John , G.H. 1997 . Wrappers for feature subset selection . Artif. Intell. , 97 : 273 – 324 .
   Web of Science ®Google Scholar
• Lendaris , G.G. and Mathia , K. pp. 319–324 . “ On prestructuring anns using a priori knowledge ” . In Proceedings of World Conference on Neural Networks (WCNN'94) , San Diego, California, Earlbaum/INNS 1994
   Google Scholar
• Liao , Y. and Moody , J. 1999 . Constructing heterogeneous committees using input feature grouping: application to economic forecasting . Adv. Neural Inf. Process. Syst. , 12 : 921 – 927 .
   Google Scholar
• Liu , Y. 1998 . “ Negative correlation learning and evolutionary neural network ensembles ” . PhD thesis Canberra, Australia : University College, The University of New South Wales, Australian Defence Force Academy .
   Google Scholar
• Lorenz , E.N. 1963 . Deterministic nonperiodic flow . J. Atmosph. Sci. , 20 : 130 – 141 .
   Web of Science ®Google Scholar
• Lu , B.-L. and Ito , M. 1999 . Task decomposition and module combination based on class relations: a modular neural network for pattern classification . IEEE Trans. Neural Networks , 10 : 1244 – 1256 .
   PubMedGoogle Scholar
• Mackey , M.C. and Glass , L. 1977 . Oscillation and chaos in physiological control systems . Science , 197 : 287 – 289 .
   PubMed Web of Science ®Google Scholar
• Maimon , O. and Rokach , L. 2002 . “ Improving supervised learning by feature decomposition ” . In Proceedings of the Second International Symposium on Foundations of Information and Knowledge Systems, Lecture Notes in Computer Science , 178 – 196 . New York : Springer Verlag .
   Google Scholar
• Moriarty , D.E. and Miikkulainen , R. 1997 . Forming neural networks through efficient and adaptive coevolution . Evolutionary Comput. , 5 : 373 – 399 .
   PubMed Web of Science ®Google Scholar
• Opitz , D. 1999 . “ Feature selection for ensembles ” . In Proceedings of the Sixteenth National Conference on Artificial Intelligence, California, AAAI 379 – 384 .
   Google Scholar
• Potter , M.A. and DeJong , K.A. 2000 . Cooperative coevolution: an architecture for evolving coadapted subcomponents . Evolution. Comput. , 8 : 1 – 29 .
   PubMed Web of Science ®Google Scholar
• Ronco , E. , Gollee , H. and Gawthrop , P. 1997 . “ Modular neural networks and selfdecomposition ” . Technical Report CSC-96012 Glasgow, UK : Centre for System and Control, University of Glasgow .
   Google Scholar
• Rueckl , J.G. , Cave , K.R. and Kosslyn , S. 1989 . Why are “what” and “where” processed by separate cortical visual systems? A computational investigation . J. Cognitive Neurosci. , 1 : 171 – 186 .
   PubMedGoogle Scholar
• Schlosser , G. and Wagner , G.P. , eds. 2005 . Modularity in Development and Evolution , Chicago : The University of Chicago Press .
   Google Scholar
• Sendhoff , B. and Kreutz , M. 1999 . “ Variable encoding of modular neural networks for time series prediction ” . In Congress on Evolutionary Computation CEC , Edited by: Porto , V. 259 – 266 . New York : IEEE Press .
   Google Scholar
• Sharkey , A.J.C. , ed. 1999 . Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems , New York : Springer-Verlag .
   Google Scholar
• Sharkey , N.E. 1997 . Neural networks for coordination and control: the portability of experiential representations . Robot. Autonom. Syst. , 22 : 345 – 359 .
   Google Scholar
• Sindhwani , V. , Rakshit , S. , Deodhare , D. , Erdogmus , D. , Principe , J. and Niyogi , P. 2004 . Feature selection in MLPs and SVMs based on maximum output information . IEEE Trans. Neural Networks , 15 : 937 – 948 .
   PubMed Web of Science ®Google Scholar
• Yang , H. and Moody , J. 1999 . “ Feature selection based on joint mutual information ” . In Advances in Intelligent Data Analysis (AIDA), Computational Intelligence Methods and Applications (CIMA), International Computer Science Conventions , 22 – 25 . New York : Rochester .
   Google Scholar
• Yong , C.H. and Miikkulainen , R. 2001 . “ Cooperative coevolution of multi-agent systems ” . Technical Report AI01-287 Austin, TX, USA : Department of computer Sciences, The University of Texas at Austin .
   Google Scholar
• Zaffalon , M. and Hutter , M. 2002 . “ Robust feature selection by mutual information distributions ” . In Proceedings of the 18th Conference on Uncertainty in Artificial Intelligence , 577 – 584 . San Francisco : Morgan Kaufmann .
   Google Scholar