Information Content in Neural Net Optimization

References

• Ackley , D.H. , Hinton , G.E. & Sejnowski , T.J. ( 1985 ) A learning algorithm for Boltzmann machines. Cognitive Science , 9 , 147 – 169 .
   Web of Science ®Google Scholar
• Atick , J.J. ( 1992 ) Could information theory provide an ecological theory of sensory processing? Networks , 3 , 213 – 251 .
   Google Scholar
• Blue , J.L. & Grother , P.J. ( 1992 ) Training feed forward networks using conjugate gradients. In Conference on Character Recognition and Digitizer Technologies , Vol. 1661 . San Jose , CA : SPIE, pp. 179 – 190 .
   Google Scholar
• Guyon , I. , Vapnick , V.N. , Boser , B.E. , Botton , L.Y. & Solla , S.A. ( 1992 ) Structural risk minimization for character recognition. In R. Lippmann (Ed.), Advances in Neural Information Processing System , Vol. 4 . Palo Aito , CA : Morgan Kauffman, pp. 471 – 470 .
   Google Scholar
• Jain , K.J. ( 1989 ) Fundamentals of Digital Image Processing , Chapter 5.8, pp. 155 – 157 . Englewood Cliffs, NJ : Prentice Hall .
   Google Scholar
• Kirkpatrick , S. , Gelatt , C.D. & Vacchi , M.P. ( 1983 ) Optimization by simulated annealing. Science , 220 , 671 – 680 .
   PubMed Web of Science ®Google Scholar
• Le Cun , Y. , Denken , J.S. & Solla , S.A. ( 1990 a) Optimal brain damage. In D. Touretzky (Ed.), Advances in Neural Information Processing Systems , Vol. 2 . Palo Alto , CA : Morgan Kaufman, pp. 396 – 404 .
   Google Scholar
• Le Cun , Y. , Boser , B. , Denker , J.S. , Henderson , D. , Howard , R.E. , Hubbard , W. } & Jackel, L.D. ( 1990 b) Handwritten digit recognition with a back-propagation network. In D. Touretzky (Ed.), Advances in Neural Information Processing Systems , Vol. 2 . Palo Alto , CA : Morgan Kaufman, pp. 598 – 605 .
   Google Scholar
• Møller , M.F. ( 1990 ) A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning. , Technical Report PB-339, Aarhus University.
   Google Scholar
• Moody , J.E. ( 1992 ) The effective numbers of parameters: an analysis of generalization and regularization in nonlinear systems. In R. Lippmann (Ed.), Advances in Neural Information Processing System , Vol. 4 . Palo Alto , CA : Morgan Kauffman, pp. 847 – 854 .
   Google Scholar
• Omidvar , O.M. } & Wilson, C.L. ( 1992 a) Optimization of neural network topology and information content using Boltzmann methods. In Proceedings of the IFCNN , Vol. IV, pp. 594 – 599 .
   Google Scholar
• Omidvar , O.M. } & Wilson, C.L. ( 1992 b) Optimization of adaptive resonance theory network with Boltzman. In Dennis W. Ruck (Ed.), Science of Artificial Neural Networks II , Vol. 1966 . Orlando , FL : SPIE.
   Google Scholar
• Watson , C.I. } & Wilson, C.L. ( 1992 ) Fingerprint database. National Institute of Standards and Technology , Special Database 4 , FPDB, April 18.
   Google Scholar
• Wilson , C.L. ( 1992 ) Massively parallel neural network recognition. In Proceedings of the IFCNN , Vol. III, pp. 227 – 232 .
   Google Scholar
• Wilson , C.L. , Candela , G.T. , Grother , P.J. , Watson , C.I. & Wilkinson , R.A. ( 1992 ) Massively Parallel Neural Network Fingerprint Classification System. , Technical Report NISTIR 4880, National Institute of Standards and Technology.
   Google Scholar