Penalized Versus Constrained Generalized Eigenvalue Problems

References

• Allen, G. I., Grosenick, L., and Taylor, J. (2014), “A Generalized Least-Square Matrix Decomposition,” Journal of the American Statistical Association, 109, 145–159.
   Web of Science ®Google Scholar
• Allen, G. I., and Tibshirani, R. (2010), “Transposable Regularized Covariance Models With an Application to Missing Data Imputation,” Annals of Applied Statistics, 4, 764–790.
   PubMed Web of Science ®Google Scholar
• Alon, U., Barkai, N., Notterman, D. A., Gish, K., Ybarra, S., Mack, D., and Levine, A. J. (1999), “Broad Patterns of Gene Expression Revealed by Clustering Analysis of Tumor and Normal Colon Tissues Probed by Oligonucleotide Arrays,” Proceedings of the National Academy of Sciences of the United States of America, 96, 6745–6750.
   PubMed Web of Science ®Google Scholar
• Bertsekas, D. P. (1999), Nonlinear Programming, Belmont: Athena Scientific.
   Google Scholar
• Bickel, P. J. J., Ritov, Y., and Tsybakov, A. B. (2009), “Simultaneous Analysis of Lasso and Dantzig Selector,” Annals of Statistics, 37, 1705–1732.
   Web of Science ®Google Scholar
• Bien, J., and Tibshirani, R. (2011), “Sparse Estimation of a Covariance Matrix,” Biometrika, 98, 807–820.
   PubMed Web of Science ®Google Scholar
• Boyd, S. P., and Vandenberghe, L. (2004), Convex Optimization, Cambridge: Cambridge University Press.
   Google Scholar
• Friedman, J. H., Hastie, T., and Tibshirani, R. (2008), “Sparse Inverse Covariance Estimation With the Graphical Lasso,” Biostatistics, 9, 432–441.
   PubMed Web of Science ®Google Scholar
• George, E. I. (2000), “The Variable Selection Problem,” Journal of the American Statistical Association, 95, 1304–1308.
   Web of Science ®Google Scholar
• Hastie, T., Tibshirani, R., and Friedman, J. H. (2009), The Elements of Statistical Learning, New York: Springer.
   Google Scholar
• Jolliffe, I. T., Trendafilov, N. T., and Uddin, M. (2003), “A Modified Principal Component Technique Based on the LASSO,” Journal of Computational and Graphical Statistics, 12, 531–547.
   Web of Science ®Google Scholar
• Mai, Q., Zou, H., and Yuan, M. (2012), “A Direct Approach to Sparse Discriminant Analysis in Ultra-High Dimensions,” Biometrika, 99, 29–42.
   Web of Science ®Google Scholar
• Meinshausen, N., and Bühlmann, P. (2006), “High-Dimensional Graphs and Variable Selection With the Lasso,” Annals of Statistics, 34, 1436–1462.
   Web of Science ®Google Scholar
• Ramaswamy, S., Tamayo, P., Rifkin, R., Mukherjee, S., Yeang, C. H., Angelo, M., Ladd, C., Reich, M., Latulippe, E., Mesirov, J. P., Poggio, T., Gerald, W., Loda, M., Lander, E. S., and Golub, T. R. (2001), “Multiclass Cancer Diagnosis Using Tumor Gene Expression Signatures,” Proceedings of the National Academy of Sciences of the United States of America, 98, 15149–15154.
   PubMed Web of Science ®Google Scholar
• Rothman, A. J. (2012), “Positive Definite Estimators of Large Covariance Matrices,” Biometrika, 99, 733–740.
   Web of Science ®Google Scholar
• Shen, H., and Huang, J. Z. (2008), “Sparse Principal Component Analysis via Regularized Low Rank Matrix Approximation,” Journal of Multivariate Analysis, 99, 1015–1034.
   Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
   Google Scholar
• Van Loan, C. F. (1976), “Generalizing the Singular Value Decomposition,” SIAM Journal on Numerical Analysis, 13, 76–83.
   Web of Science ®Google Scholar
• Wainwright, M. J. (2009), “Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using ℓ1-Constrained Quadratic Programming (Lasso),” IEEE Transactions on Information Theory, 55, 2183–2202.
   Web of Science ®Google Scholar
• Witten, D. M., and Tibshirani, R. (2011), “Penalized Classification Using Fisher’s Linear Discriminant,” Journal of the Royal Statistical Society, Series B, 73, 753–772.
   Google Scholar
• Witten, D. M., Tibshirani, R., and Hastie, T. (2009), “A Penalized Matrix Decomposition, With Applications to Sparse Principal Components and Canonical Correlation Analysis,” Biostatistics, 10, 515–534.
   PubMed Web of Science ®Google Scholar
• Zhao, P., and Yu, B. (2006), “On Model Selection Consistency of Lasso,” The Journal of Machine Learning Research, 7, 2541–2563.
   Web of Science ®Google Scholar
• Zou, H., Hastie, T., and Tibshirani, R. (2006), “Sparse Principal Component Analysis,” Journal of Computational and Graphical Statistics, 15, 265–286.
   Web of Science ®Google Scholar