Comprehensibility maximization and humanly comprehensible representations

References

• Anderson , J.R. 1980 . Cognitive psychology and its implication , New York : Worth Publishers .
   Google Scholar
• Andrews , R. , Diederich , J. and Tickle , A.B. 1993 . Survey and critique of techniques for extracting rules from trained artificial neural networks . Knowledge-based systems , 8 ( 6 ) : 373 – 389 .
   Web of Science ®Google Scholar
• Barakat , N. and Diederich , J. 2005 . Eclectic rule-extraction from support vector machines . International journal of computational intelligence , 2 ( 1 ) : 59 – 62 .
   Google Scholar
• Barlow , H.B. 1989 . Unsupervised learning . Neural computation , 1 : 295 – 311 .
   Web of Science ®Google Scholar
• Barlow , H.B. , Kaushal , T.P. and Mitchison , G.J. 1989 . Finding minimum entropy code . Neural computation , 1 : 412 – 423 .
   Web of Science ®Google Scholar
• Garcez d'Avila , A.S. , Broda , K. and Gabbay , D.M. 2001 . Symbolic knowledge extraction from trained neural networks: a sound approach . Artificial intelligence , 125 : 155 – 207 .
   Web of Science ®Google Scholar
• Guyon , I. and Elisseeff , A. 2003 . An introduction to variable and feature selection . Journal of machine learning research , 3 : 1157 – 1182 .
   Google Scholar
• Hamker , F.H. and Zirnsak , M. 2006 . V4 receptive field dynamics as predicted by a systems-level model of visual attention using feedback from the frontal eye field . Neural networks , 19 : 1371 – 1382 .
   PubMed Web of Science ®Google Scholar
• Kahramanli , H. and Allahverdi , N. 2009 . Rule extraction from trained adaptive networks using artificial immune systems . Expert systems with applications , 36 : 1513 – 1522 .
   Web of Science ®Google Scholar
• Kamimura , R. 2003a . Information theoretic competitive learning in self-adaptive multi-layered networks . Connection science , 13 ( 4 ) : 323 – 347 .
   Web of Science ®Google Scholar
• Kamimura , R. 2003b . Information-theoretic competitive learning with inverse Euclidean distance output units . Neural processing letters , 18 : 163 – 184 .
   Web of Science ®Google Scholar
• Kamimura , R. 2003c . Progressive feature extraction by greedy network-growing algorithm . Complex systems , 14 ( 2 ) : 127 – 153 .
   Google Scholar
• Kamimura , R. 2003d . Teacher-directed learning: information-theoretic competitive learning in supervised multi-layered networks . Connection science , 15 : 117 – 140 .
   Web of Science ®Google Scholar
• Kamimura , R. 2007 . “ Information loss to extract distinctive features in competitive learning ” . Proceedings of IEEE conference on systems, Man, and Cybernetics 1217 – 1222 .
   Google Scholar
• Kamimura , R. 2008a . “ Conditional information and information loss for flexible feature extraction ” . Proceedings of the international joint conference on neural networks (IJCNN2008) 2047 – 2083 .
   Google Scholar
• Kamimura , R. 2008b . “ Feature detection and information loss in competitive learning ” . Proceedings of the international conference on soft computing and intelligent systems and the international symposium on advanced intelligent systems (SCIS and ISIS2008) 1144 – 1148 .
   Google Scholar
• Kamimura , R. 2008c . “ Feature discovery by enhancement and relaxation of competitive units ” . In Intelligent data engineering and automated learning-IDEAL2008 (LNCS) , Vol. LNCS5326 , 148 – 155 . Springer .
   Google Scholar
• Kamimura , R. 2008d . “ Mutual information maximization by free energy-based competitive learning for self-organizing maps ” . Proceedings of the international conference on systems, man, and cybernetics (SMC2008) 1819 – 1825 .
   Google Scholar
• Kamimura , R. 2009 . Enhancing and relaxing competitive units for feature discovery . Neural processing letters , 30 ( 1 ) : 37 – 57 .
   Web of Science ®Google Scholar
• Kamimura , R. and Kamimura , T. 2000 . “ Structural information and linguistic rule extraction ” . Proceedings of ICONIP-2000 720 – 726 .
   Google Scholar
• Kamimura , R. , Kamimura , T. and Uchida , O. 2001 . Flexible feature discovery and structural information control . Connection science , 13 ( 4 ) : 323 – 347 .
   Web of Science ®Google Scholar
• Kamimura , R. 2010 . Information-theoretic enhancement learning and its application to visualization of self-organizing maps . Neurocomputing , 73 ( 13–15 ) : 2642 – 2664 .
   Web of Science ®Google Scholar
• Kaski , S. , Nikkila , J. and Kohonen , T. 1998 . “ Methods for interpreting a self-organized map in data analysis ” . Proceedings of European symposium on artificial neural networks. Bruges, Belgium
   Google Scholar
• Kilmer , W. 1996 . Global inhibition for selecting modes of attention . Neural networks , 9 ( 4 ) : 567 – 573 .
   Web of Science ®Google Scholar
• Kiviluoto , K. 1996 . “ Topology preservation in self-organizing maps ” . Proceedings of the IEEE international conference on neural networks 294 – 299 .
   Google Scholar
• Kohonen , T. 1988 . Self-organization and associative memory , New York : Springer-Verlag .
   Google Scholar
• Kohonen , T. 1995 . Self-organizing maps , Berlin, Heidelberg : Springer-Verlag .
   Google Scholar
• Korsten , N.J.H. , Fragopanagos , N. , Hartle , M. , Taylor , N. and Taylor , J.G. 2006 . Attention as a controller . Neural networks , 19 : 1408 – 1421 .
   PubMed Web of Science ®Google Scholar
• Lanyon , L.J. and Denham , S.L. 2004 . A biased competition computational model of spatial and object-based attention mediating active visual search . Neurocomputing , 58–60 : 655 – 662 .
   Web of Science ®Google Scholar
• Lanyon , L.J. and Denham , S.L. 2006 . A model of active visual search with object-based attention guiding scan paths . Neural networks , 19 : 873 – 897 .
   Google Scholar
• Lehn-Schioler , T. , Hegde , A. , Erdogmus , D. and Principe , J.C. 2004 . Vector-quantization using information theoretic concepts . Natural computation , 4 ( 1 ) : 39 – 51 .
   Google Scholar
• Linsker , R. 1988 . Self-organization in a perceptual network . Computer , 21 : 105 – 117 .
   Web of Science ®Google Scholar
• Linsker , R. 1989 . How to generate ordered maps by maximizing the mutual information between input and output . Neural computation , 1 : 402 – 411 .
   Web of Science ®Google Scholar
• Mak , B. and Munakata , T. 2002 . Rule extraction from expert heuristics: a comparative study of rough sets with neural network and ID3 . European journal of operational research , 136 : 212 – 229 .
   Web of Science ®Google Scholar
• Mao , I. and Jain , A.K. 1995 . Artificial neural networks for feature extraction and multivariate data projection . IEEE transactions on neural networks , 6 ( 2 ) : 296 – 317 .
   PubMed Web of Science ®Google Scholar
• Morejon , R.A. and Principe , J.C. 2004 . Advanced search algorithms for information-theoretic learning with kernel-based estimators . IEEE transactions on neural networks , 15 ( 4 ) : 874 – 884 .
   Web of Science ®Google Scholar
• Nayak , R. 2009 . Generating rules with predicates, terms and variables from the pruned neural networks . Neural networks , 22 : 405 – 414 .
   PubMed Web of Science ®Google Scholar
• Newman , J. , Baars , B.J. and Cho , S.B. 1997 . A neural global workspace model for conscious attention . Neural networks , 10 ( 7 ) : 1195 – 1206 .
   Web of Science ®Google Scholar
• Polzlbauer , G. , Dittenbach , M. and Rauber , A. 2006 . Advanced visualization of self-organizing maps with vector fields . Neural networks , 19 : 911 – 922 .
   PubMed Web of Science ®Google Scholar
• Principe , J.C. , Xu , D. , Zhao , Q. and Fisher , J.W. III . 2000 . Learning from examples with information theoretic criteria . The journal of VLSI signal processing , 26 ( 1–2 ) : 61 – 77 .
   Web of Science ®Google Scholar
• Rolls , E.T. and Deco , G. 2006 . Attention in natural scenes: neurophysiological and computational bases . Neural networks , 19 : 1383 – 1394 .
   PubMed Web of Science ®Google Scholar
• Rumelhart , D.E. , Hinton , G.E. and Williams , R.J. 1986 . “ Learning internal representations by error propagation ” . In Parallel distributed processing , Edited by: Rumelhart , D.E. Hinton , G.E. Vol. 1 , 318 – 362 . Cambridge : MIT Press .
   Google Scholar
• Saito , K. and Nakano , R. 2002 . Extracting regression rules from neural networks . Neural networks , 15 : 1279 – 1288 .
   PubMed Web of Science ®Google Scholar
• Setino , R. 1997 . A penalty-function approach for pruning feedforward neural networks . Neural computation , 9 ( 1 ) : 185 – 204 .
   Web of Science ®Google Scholar
• Tasdemir , K. and Merenyi , E. 2009 . Exploiting data topology in visualizations and clustering of self-organizing maps . IEEE transactions on neural networks , 20 ( 4 ) : 549 – 562 .
   Web of Science ®Google Scholar
• Taylor , J.G. and Gragopanagos , N.F. 2005 . The interaction of attention and emotion . Neural networks , 18 : 353 – 369 .
   PubMed Web of Science ®Google Scholar
• Thrun , S. 1995 . Extracting rules from artificial neural networks with distributed representations . IEEE transactions on neural networks , 11 ( 2 ) : 377 – 389 .
   Google Scholar
• Torkkola , K. 2003a . Feature extraction by non-parametric mutual information maximization . Journal of machine learning research , 3 : 1415 – 1438 .
   Google Scholar
• Torkkola , K. 2003b . Feature extraction by non-parametric mutual information maximization . Journal of machine learning research , 3 : 1415 – 1438 .
   Google Scholar
• Towell , G. and Shavlik , J.W. 1993 . Extracting refined rules from knowledge-based neural networks . Machine learning , 13 : 71 – 101 .
   Web of Science ®Google Scholar
• Tsukimoto , H. 2000 . Extracting rules from trained neural networks . IEEE transactions on neural networks , 11 ( 2 ) : 377 – 389 .
   PubMed Web of Science ®Google Scholar
• Ultsch, A., 2003. U*-matrix: a tool to visualize clusters in high dimensional data, Technical Report 36, Department of Computer Science, University of Marburg
   Google Scholar
• Ultsch , A. and Siemon , H.P. 1990 . “ Kohonen self-organization feature maps for exploratory data analysis ” . In Proceedings of international neural network conference , 305 – 308 . Dordrecht : Kulwer Academic Publisher .
   Google Scholar
• Vesanto , J. 1999 . SOM-based data visualization methods . Intelligent data analysis , 3 : 111 – 126 .
   Google Scholar
• Vesanto, J., Himberg, J., Alhoniemi, E. and Parhankangas, J., 2000. SOM toolbox for Matlab, Technical report, Laboratory of Computer and Information Science, Helsinki University of Technology
   Google Scholar
• Xu , R. and Wunsch , D. II . 2005 . Survey of clustering algorithms . IEEE transactions on neural networks , 16 ( 3 ) : 645 – 678 .
   PubMed Web of Science ®Google Scholar