Gradient-Based Kernel Dimension Reduction for Regression

REFERENCES

• Aronszajn, N. (1950), Theory of Reproducing Kernels, Transactions of the American Mathematical Society, 68, 337–404.
   Web of Science ®Google Scholar
• Baker, C.R. (1973), Joint Measures and Cross-Covariance Operators, Transactions of the American Mathematical Society, 186, 273–289.
   Web of Science ®Google Scholar
• Bauer, F., Pereverzev, S., Rosasco, L. (2007), On Regularization Algorithms in Learning Theory, Journal of Complexity, 23, 52–72.
   Web of Science ®Google Scholar
• Bernard-Michel, C., Gardes, L., Girard, S. (2008), A Note on Sliced Inverse Regression With Regularizations, Biometrics, 64, 982–986.
   PubMed Web of Science ®Google Scholar
• Boser, B.E., Guyon, I.M., and Vapnik, V.N. (1992), ‘‘A Training Algorithm for Optimal Margin Classifiers,” in Fifth Annual ACM Workshop on Computational Learning Theory, Pittsburgh, PA: ACM Press, pp. 144–152.
   Google Scholar
• Bura, E., Cook, R.D. (2001), Extending Sliced Inverse Regression: The Weighted Chi-squared Test, Journal of the American Statistical Association, 96, 996–1003.
   Web of Science ®Google Scholar
• Caponnetto, A., and De Vito, E. (2007), ‘‘Optimal Rates for Regularized Least-Squares Algorithm,” Foundations of Computational Mathematics, 7, 331–368.
   Web of Science ®Google Scholar
• Chang, C.-C., and Lin, C.-J. (2011), ‘‘LIBSVM: A Library for Support Vector Machines,” ACM Transactions on Intelligent Systems and Technology, 2, 27:1–27:. 27. Available at http://www.csie.ntu.edu.tw/cjlin/libsvm.
   Web of Science ®Google Scholar
• Cook, R.D. (1994), On the Interpretation of Regression Plots, Journal of the American Statistical Association, 89, 177–189.
   Web of Science ®Google Scholar
• Cook, R.D. (1998), Regression Graphics, New York: Wiley Inter-Science.
   Google Scholar
• Cook, R.D., Lee, H. (1999), Dimension Reduction in Regression With a Binary Response, Journal of the American Statistical Association, 94, 1187–1200.
   Web of Science ®Google Scholar
• Cook, R.D., Weisberg, S. (1991), Discussion of “Sliced Inverse Regression for Dimension Reduction'' by K.-C. Li, Journal of the American Statistical Association, 86, 328–332.
   Web of Science ®Google Scholar
• Fan, J., and Gijbels, I. (1996), Local Polynomial Modelling and its Applications, London: Chapman and Hall.
   Google Scholar
• Ferré, L., (1998), “Determining the Dimension in Sliced Inverse Regression and Related Methods,” Journal of the American Statistical Association, 93, 132–140.
   Web of Science ®Google Scholar
• Fine, S., Scheinberg, K. (2001), Efficient SVM Training Using Low-rank Kernel Representations, Journal of Machine Learning Research, 2, 243–264.
   Web of Science ®Google Scholar
• Frank, A., and Asuncion, A. (2010), ‘‘UCI Machine Learning Repository,” . Available at http://archive.ics.uci.edu/ml
   Google Scholar
• Fukumizu, K., Bach, F.R., Jordan, M.I. (2004), Dimensionality Reduction for Supervised Learning With Reproducing Kernel Hilbert Spaces, Journal of Machine Learning Research, 5, 73–99.
   Web of Science ®Google Scholar
• Fukumizu, K., Bach, F.R., Jordan, M.I. (2009), ‘‘Kernel Dimension Reduction in Regression,” The Annals of Statistics, 37, 1871–1905. doi:10.1214/08-AOS637.
   Web of Science ®Google Scholar
• Fukumizu, K., Gretton, A., Sun, X., and Schölkopf, B. (2008), ‘‘Kernel Measures of Conditional Dependence,” in Advances in Neural Information Processing Systems 20, Cambridge, MA: MIT Press, pp. 489–496.
   Google Scholar
• Gretton, A., Fukumizu, K., Sriperumbudur, B.K. (2009), Discussion of Brownian Distance Covariance, Annals of Applied Statistics, 3, 1285–1294.
   Web of Science ®Google Scholar
• Gretton, A., Fukumizu, K., Teo, C.H., Song, L., Schölkopf, B., and Smola, A. (2008), ‘‘A Kernel Statistical Test of Independence,” in Advances in Neural Information Processing Systems 20, Cambridge, MA: MIT Press, pp. 585–592.
   Google Scholar
• Gretton, A., Herbrich, R., Smola, A.J., Bousquet, O., Schölkopf, B. (2005a), Kernel Methods for Measuring Independence, Journal of Machine Learning Research, 6, 2075–2129.
   Web of Science ®Google Scholar
• Gretton, A., Smola, A.J., Bousquet, O., Herbrich, R., Belitski, A., Augath, M.A., Murayama, Y., Pauls, J., Schölkopf, B., and Logothetis, N.K. (2005b), ‘‘Kernel Constrained Covariance for Dependence Measurement,” in Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, 112–119.
   Google Scholar
• Hofmann, T., Schölkopf, B., and Smola, A.J. (2008), ‘‘Kernel Methods in Machine Learning,” The Annals of Statistics, 36, 1171–1220.
   Web of Science ®Google Scholar
• Hristache, M., Juditsky, A., Polzehl, J., and Spokoiny, V. (2001), ‘‘Structure Adaptive Approach for Dimension Reduction,” The Annals of Statistics, 29, 1537–1566.
   Web of Science ®Google Scholar
• Hsing, T., Ren, H. (2009), An RKHS Formulation of the Inverse Regression Dimension-reduction Problem, The Annals of Statistics, 37, 726–755.
   Web of Science ®Google Scholar
• Li, B., Artemiou, A., Li, L. (2011), Principal Support Vector Machine for Linear and Nonlinear Sufficient Dimension Reduction, The Annals of Statistics, 39, 3182–3210.
   Web of Science ®Google Scholar
• Li, B., Wang, S. (2007), On Directional Regression for Dimension Reduction, Journal of the American Statistical Association, 102, 997–1008.
   Web of Science ®Google Scholar
• Li, B., Zha, H., and Chiaromonte, F. (2005), ‘‘Contour Regression: A General Approach to Dimension Reduction,” The Annals of Statistics, 33, 1580–1616.
   Web of Science ®Google Scholar
• Li, K.-C. (1991), ‘‘Sliced Inverse Regression for Dimension Reduction” (with discussion), Journal of American Statistical Association, 86, 316–342.
   Web of Science ®Google Scholar
• Li, K.-C. (1992), On Principal Hessian Directions for Data Visualization and Dimension Reduction: Another Application of Stein’s Lemma, Journal of American Statistical Association, 87, 1025–1039.
   Web of Science ®Google Scholar
• Liu, S., Liu, Z., Sun, J., Liu, L. (2011), Application of Synergetic Neural Network in Online Writeprint Identification, International Journal of Digital Content Technology and its Applications, 5, 126–135.
   Google Scholar
• Samarov, A.M. (1993), Exploring Regression Structure Using Nonparametric Functional Estimation, Journal of the American Statistical Association, 88, 836–847.
   Web of Science ®Google Scholar
• Schölkopf, B., and Smola, A.J. (2002), Learning With Kernels, Cambridge, MA: MIT Press.
   Google Scholar
• Schott, J.R. (1994), Determining the Dimensionality in Sliced Inverse Regression, Journal of the American Statistical Association, 89, 141–148.
   Web of Science ®Google Scholar
• Smale, S., Zhou, D.-X. (2005), Shannon Sampling. II: Connections to Learning Theory, Applied and Computational Harmonic Analysis, 19, 285–302.
   Web of Science ®Google Scholar
• Smale, S. (2007), Learning Theory Estimates Via Integral Operators and Their Approximation, Constructive Approximation, 26, 153–172.
   Web of Science ®Google Scholar
• Song, L., Huang, J., Smola, A.J., and Fukumizu, K. (2009), ‘‘Hilbert Space Embeddings of Conditional Distributions With Applications to Dynamical Systems,” in Proceedings of the 26th International Conference on Machine Learning (ICML2009), pp. 961–968.
   Google Scholar
• Song, L., Smola, A., Borgwardt, K., and Gretton, A. (2008), ‘‘Colored Maximum Variance Unfolding,” in Advances in Neural Information Processing Systems, Vol. 20, eds. J.C. Platt, D. Koller, Y. Singer, and S. Roweis, Cambridge, MA: MIT Press, pp. 1385–1392.
   Google Scholar
• Sriperumbudur, B.K., Gretton, A., Fukumizu, K., Schölkopf, B., Lanckriet, G. R.G. (2010), Hilbert Space Embeddings and Metrics on Probability Measures, Journal of Machine Learning Research, 11, 1517–1561.
   Web of Science ®Google Scholar
• Steinwart, I., and Christmann, A. (2008), Support Vector Machines, New York: Springer.
   Google Scholar
• Stewart, G.W., and Sun, J.-G. (1990), Matrix Perturbation Theory, New York: Academic Press.
   Google Scholar
• Wahba, G. (1990), Spline Models for Observational Data, . CBMS-NSF Regional Conference Series in Applied Mathematics, Vol. 59, Philadelphia, PA: SIAM.
   Google Scholar
• Widom, H. (1963), Asymptotic Behavior of the Eigenvalues of Certain Integral Equations, Transactions of the American Mathematical Society, 109, 278–295.
   Google Scholar
• Widom, H. (1964), Asymptotic Behavior of the Eigenvalues of Certain Integral Equations. II, Archive for Rational Mechanics and Analysis, 17, 215–229.
   Web of Science ®Google Scholar
• Wu, H.-M. (2008), Kernel Sliced Inverse Regression With Applications to Classification, Journal of Computational and Graphical Statistics, 17, 590–610.
   Web of Science ®Google Scholar
• Xia, Y., Tong, H., Li, W.K., Zhu, L.-X. (2002), An Adaptive Estimation of Dimension Reduction Space, Journal of Royal Statistical Society, Series B, 64, 363–410.
   Google Scholar
• Yin, X., Seymour, L. (2005), Asymptotic Distributions for Dimension Reduction in the SIR-II Method, Statistica Sinica, 15, 1069–1079.
   Web of Science ®Google Scholar
• Zhong, W., Zeng, P., Ma, P., Liu, J.S., and Zhu, Y. (2005), ‘‘RSIR: Regularized Sliced Inverse Regression for Motif Discovery,” Bioinformatics, 21, 4169–4175.
   PubMed Web of Science ®Google Scholar