Sparse discriminant analysis based on estimation of posterior probabilities

References

• G. Baudat and F. Anouar, Generalized discriminant analysis using a kernel approach, Neural Comput. 12 (2000), pp. 2385–2404. doi: 10.1162/089976600300014980
   PubMed Web of Science ®Google Scholar
• Banana data, https://www.openml.org/d/1460
   Google Scholar
• C.M. Bishop, Pattern Recognition and Machine Learning, Springer, New York, 2006.
   Google Scholar
• C.K. Chow, An optimum character recognition system using decision functions, IRE Trans. EC-6 (1957), pp. 247–254.
   Google Scholar
• L. Clemmensen, T. Hastie, D. Witten and B. Ersbøll, Sparse discriminant analysis, Technometrics 53 (2011), pp. 406–413. doi: 10.1198/TECH.2011.08118
   Web of Science ®Google Scholar
• X. Du, S. Dua, R.U. Acharya and C.K. Chua, Classification of epilepsy using high-order spectra features and principle component analysis, J. Med. Syst. 36 (2012), pp. 1731–1743. doi: 10.1007/s10916-010-9633-6
   PubMed Web of Science ®Google Scholar
• V. Fontaine, C. Ris and J-M. Boite, Nonlinear discriminant analysis for improved speech recognition, Proceedings of Eurospeech-97, Rhodes, Vol. 4, 1997, pp. 2071–2074.
   Google Scholar
• T. Hastie, A. Buja and R. Tibshirani, Penalized discriminant analysis, Ann. Statist. 23 (1995), pp. 73–102. doi: 10.1214/aos/1176324456
   Web of Science ®Google Scholar
• A. Hidaka and T. Kurita, Sparse discriminant kernel based on the Bayesian posterior probability obtained by L1 regression, Proceedings of Joint IAPR International Workshops on Structural and Syntactic Pattern Recognition (SSPR 2012) and Statistical Techniques in Pattern Recognition (SPR 2012), Hiroshima, Japan, Nov. 7–9, 2012, pp. 648–656.
   Google Scholar
• A. Hidaka and T. Kurita, Nonlinear discriminant analysis based on probability estimation by Gaussian mixture model, IAPR Joint International Workshops on Statistical Techniques in Pattern Recognition (SPR 2014) and Structural and Syntactic Pattern Recognition (SSPR 2014), Joensuu, Finland, Aug. 20–22, 2014, pp. 133–142.
   Google Scholar
• A. Hidaka and T. Kurita, Optimum nonlinear discriminant analysis and discriminant kernel support vector machine, IEICE Trans. Inf. Syst. E99-D (2016), pp. 2734–2744. doi: 10.1587/transinf.2016EDP7081
   Google Scholar
• P. Hu and D. Ramanan, Finding tiny faces, Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (CVPR2017), 2017, pp. 951–959.
   Google Scholar
• A. Krizhevsky and G. Hinton, Learning multiple layers of features from tiny images, Tech. Rep., University of Toronto, 2009.
   Google Scholar
• T. Kurita, H. Asoh and N. Otsu, Nonlinear discriminant features constructed by using outputs of multilayer perceptron, Proceedings of International Symposium on Speech, Image Processing and Neural Networks (ISSIPNN' 94), Vol. 2, 1994, pp. 417–420.
   Google Scholar
• T. Kurita, K. Watanabe and A. Hidaka, Sparse logistic discriminant analysis, Proceedings of IEEE International Conference on Systems, Man, and Cybernetics (SMC 2013), Manchester, UK, Oct. 13–16, 2013, pp. 3003–3008.
   Google Scholar
• T. Kurita, K. Watanabe and N. Otsu, Logistic discriminant analysis, Proceedings of IEEE International Conference, Vol. SMC, 2009, pp. 2236–2341.
   Google Scholar
• J.W. Lee, J.B. Lee, M. Park and S.H. Song, An extensive comparison of recent classification tools applied to microarray data, Comput. Statist. Data Anal. 48 (2005), pp. 869–885. doi: 10.1016/j.csda.2004.03.017
   Web of Science ®Google Scholar
• M. Lichman, UCI machine learning repository, School of Information and Computer Science, University of California, Irvine, CA (2013). Available at http://archive.ics.uci.edu/ml.
   Google Scholar
• P. McCullagh and J. Nelder, Generalized Linear Models, Chapman and Hall, London, 1989.
   Google Scholar
• S. Mika, G. Ratsch, J. Weston, B. Scholkopf, A. Smola and K. Muller, Fisher discriminant analysis with kernels, Proceedings of IEEE Neural Networks for Signal Processing Workshop, 1999, pp. 41–48.
   Google Scholar
• T.P. Minka, A comparison of numerical optimizers for logistic regression, Tech. Rep., Microsoft Re-search, 2003
   Google Scholar
• A.Y. Ng, Feature selection, l1 vs. l2 regularization, and rotational invariance, Proceedings of 21th ICML, 2004, pp. 78–85.
   Google Scholar
• N. Otsu, Nonlinear discriminant analysis as a natural extension of the linear case, Behaviormetrika 2 (1975), pp. 45–59.
   Google Scholar
• N. Otsu, Mathematical Studies on Feature Extraction in Pattern Recognition, Researches of the Electrotechnical Laboratory 818, 1981 (in Japanese).
   Google Scholar
• N. Otsu, Optimal linear and nonlinear solutions for least-square discriminant feature extraction, Proceedings of 6th ICPR, 1982, pp. 557–560.
   Google Scholar
• V. Roth and V. Steinhage, Nonlinear discriminant analysis using kernel functions, Adv. Neural Inf. Process. Syst. 12 (1999), pp. 568–574.
   Google Scholar
• M. Schmidt, Graphical model structure learning with L1-regularization, Ph.D. thesis, University of British Columbia, 2010.
   Google Scholar
• M. Schmidt, G. Fung and R. Rosales, Fast optimization methods for L1 regularization: A comparative study and two new approaches, European Conference on Machine Learning (ECML), 2007.
   Google Scholar
• R. Tibshirani, Regression shrinkage and selection via the lasso, J. R. Statist. Soc. Ser. B 58 (1996), pp. 267–288.
   Google Scholar
• L. Wolf, T. Hassner and Y. Taigman, Effective face recognition by combining multiple descriptors and learned background statistics, IEEE Trans. Pattern Anal. Mach. Intell. 33 (2011), pp. 1978–1990. doi: 10.1109/TPAMI.2010.230
   PubMed Web of Science ®Google Scholar
• A.R. Webb and D. Lowe, The optimised internal representation of multilayer classifier networks performs nonlinear discriminant analysis, Neural Netw. 3 (1990), pp. 367–375. doi: 10.1016/0893-6080(90)90019-H
   Web of Science ®Google Scholar