Dimensionality Reduction and Variable Selection in Multivariate Varying-Coefficient Models With a Large Number of Covariates

References

• Absil, P.-A., Mahony, R., and Sepulchre, R. (2009), Optimization Algorithmson Matrix Manifolds, Princeton, NJ: Princeton University Press.
   Google Scholar
• Beck, A., and Teboulle, M. (2009), “A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems,” SIAM Journal on Imaging Sciences, 2, 183–202.
   Web of Science ®Google Scholar
• Bunea, F., She, Y., and Wegkamp, M. H. (2012), “Joint Variable and Rank Selection for Parsimonious Estimation of High-Dimensional Matrices,” The Annals of Statistics, 40, 2359–2388.
   Web of Science ®Google Scholar
• Burton, P. R., Clayton, D. G., Cardon, L. R., Craddock, N., Deloukas, P., Duncanson, A., Kwiatkowski, D. P., McCarthy, M. I., Ouwehand, W. H., Samani, N. J. et al., (2007), “Genome-Wide Association Study of 14, 000 Cases of Seven CommonDiseases and 3,000 Shared Controls,” Nature, 447, 661–678.
   PubMed Web of Science ®Google Scholar
• Chen, K., Chan, K. S., and Stenseth, N. C. (2012), “Reduced Rank Stochastic Regression With a Sparse Singular Value Decomposition,” Journal of the Royal Statistical Society, Series B, 74, 203–221.
   Google Scholar
• Chen, L., and Huang, J. Z. (2012), “Sparse Reduced-Rank Regression for Simultaneous Dimension Reduction and Variable Selection,” Journal of the American Statistical Association, 107, 1533–1545.
   Web of Science ®Google Scholar
• Dawber, T. R., Meadors, G. F., and Moore Jr, F. E. (1951), “Epidemiological Approaches to Heart Disease: The Framingham Study,” American Journal of Public Health and the Nation’s Health, 41, 279–286.
   PubMed Web of Science ®Google Scholar
• Edelman, A., Arias, T. A., and Smith, S. T. (1998), “The Geometry of Algorithms With Orthogonality Constraints,” SIAM Journal on Matrix Analysis and Applications, 20, 303–353.
   Web of Science ®Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360.
   Web of Science ®Google Scholar
• Fan, J., Ma, Y., and Dai, W. (2014), “Nonparametric Independence Screening in Sparse Ultra-High Dimensional Varying Coefficient Models,” Journal of the American Statistical Association, 109, 1270–1284.
   PubMed Web of Science ®Google Scholar
• Gagliardi, L. (2011), “Regulation of Cortisol Secretion in Humans: Relation to Vasopressin Action at the Adrenals in Macronodular and Micronodular Adrenocortical Tumours; and Well-Being in Addison’s Disease,” Ph.D. dissertation, University of Adelaide.
   Google Scholar
• Gong, P., Zhang, C., Lu, Z., Huang, J. Z., and Ye, J. (2013), “A General Iterative Shrinkage and Thresholding Algorithm for Non-Convex Regularized Optimization Problems,” in Proceedings of the 30th International Conference on Machine Learning (ICML) (Vol. 2), pp. 37–45.
   Google Scholar
• Hastie, T., and Tibshirani, R. (1993), “Varying Coefficient Models,” Journal of the Royal Statistical Society, Series B, 55, 757–796.
   Google Scholar
• Hoover, D. R., Rice, J. A., Wu, C. O., and Yang, L. P. (1998), “Nonparametric Smoothing Estimates of Time-Varying Coefficient Models With Longitudinal Data,” Biometrika, 85, 809–822.
   Web of Science ®Google Scholar
• Huang, J., Breheny, P., and Ma, S. (2012), “A Selective Review of Group Selection in High-Dimensional Models,” Statistical Science, 27, 481–499.
   Web of Science ®Google Scholar
• Huang, J. Z., Wu, C. O., and Zhou, L. (2002), “Varying-Coefficient Models and Basis Function Approximations for the Analysis of Repeated Measurements,” Biometrika, 89, 111–128.
   Web of Science ®Google Scholar
• Jiang, Q., Wang, H., Xia, Y., and Jiang, G. (2013), “On a Principal Varying Coefficient Model,” Journal of the American Statistical Association, 108, 228–236.
   Web of Science ®Google Scholar
• Kurtz, T. W., and Spence, M. A. (1993), “Genetics of Essential Hypertension,” The American Journal of Medicine, 94, 77–84.
   PubMed Web of Science ®Google Scholar
• Lian, H. (2012), “Variable Selection for High-Dimensional Generalized Varying-Coefficient Models,” Statistica Sinica, 22, 1563–1588.
   Web of Science ®Google Scholar
• Liu, J., Li, R., and Wu, R. (2014), “Feature Selection for Varying Coefficient Models With Ultrahigh Dimensional Covariates,” Journal of the American Statistical Association, 109, 266–274.
   PubMed Web of Science ®Google Scholar
• Liu, Y., Aryee, M. J., Padyukov, L., Fallin, M. D., Hesselberg, E., Runarsson, A., Reinius, L., Acevedo, N., Taub, M., Ronninger, M., Shchetynsky, K., Scheynius, A., Kere, J., Alfredsson, L., Klareskog, L., Ekström, T. J., Feinberg, A. P. (2013), “Epigenome-Wide Association Data Implicate DNA Methylation as an Intermediary of Genetic Risk inRheumatoid Arthritis,” Nature Biotechnology, 31, 142–147.
   PubMed Web of Science ®Google Scholar
• Ma, S., Carroll, R. J., Liang, H., and Xu, S. (2015), “Estimation and Inference in Generalized Additive Coefficient Models for Nonlinear Interactions With High-Dimensional Covariates,” The Annals of Statistics, 43, 2102–2131.
   PubMed Web of Science ®Google Scholar
• Ma, X., Xiao, L., and Wong, W. (2014), “Learning Regulatory Programs by Threshold SVD Regression,” Proceedings of the National Academy of Sciences, 111, 15675–15680.
   PubMed Web of Science ®Google Scholar
• Ma, Z., Ma, Z., and Sun, T. (2016), “Adaptive Estimation in Two-way SparseReduced-Rank Regression,” arXiv:1403.1922v2.
   Google Scholar
• Magnus, J. R. and Neudecker, H. (1995), Matrix Differential Calculus WithApplications in Statistics and Econometrics, New York: Wiley.
   Google Scholar
• McElroy, J. J. (2013), “Genetics of Spontaneous Idiopathic Preterm Birth: Exploration of Maternal and Fetal Genomes,” Ph.D. dissertation, Vanderbilt University.
   Google Scholar
• Pausova, Z., Tremblay, J., and Hamet, P. (1999), “Gene-Environment Interactions in Hypertension,” Current Hypertension Reports, 1, 42–50.
   PubMedGoogle Scholar
• Sherry, S. T., Ward, M.-H., Kholodov, M., Baker, J., Phan, L., Smigielski, E. M., and Sirotkin, K. (2001), “dbSNP: The NCBI Database of Genetic Variation,” Nucleic Acids Research, 29, 308–311.
   PubMed Web of Science ®Google Scholar
• Stone, C. J. (1982), “Optimal Global Rates of Convergence for Nonparametric Regression,” The Annals of Statistics, 1040–1053.
   Web of Science ®Google Scholar
• Storlie, C., Bondell, H., Reich, B., and Zhang, H. (2011), “Surface Estimation, Variable Selection, and the Nonparametric Oracle Property,” Statistica Sinica, 21, 679–705.
   PubMed Web of Science ®Google Scholar
• Tabery, J. (2007), “Biometric and Developmental Gene-Environment Interactions: Looking Back, Moving Forward,” Development and Psychopathology, 19, 961–976.
   PubMed Web of Science ®Google Scholar
• Taylor, J. Y., Sun, Y. V., Hunt, S. C., and Kardia, S. L. (2010), “Gene–Environment Interaction for Hypertension Among African American Women Across Generations,” Biological Research for Nursing, 12, 149–155.
   PubMed Web of Science ®Google Scholar
• Wang, Y., Yin, W., and Zeng, J. (2015), “Global Convergence of ADMM in NonconvexNonsmooth Optimization,” arXiv preprint arXiv:1511.06324.
   Google Scholar
• Wei, F., Huang, J., and Li, H. (2011), “Variable Selection and Estimation in High-Dimensioanl Varying-Coefficient Models,” Statistica Sinica, 21, 1515–1540.
   PubMed Web of Science ®Google Scholar
• Xue, L., and Qu, A. (2012), “Variable Selection in High-Dimensional Varying-Coefficient Models With Global Optimality,” The Journal of Machine Learning Research, 13, 1973–1998.
   Web of Science ®Google Scholar
• Yuan, M., and Lin, Y. (2006), “Model Selection and Estimation in Regression With Grouped Variables,” Journal of the Royal Statistical Society, Series B, 68, 49–67.
   Google Scholar
• Yun, S., Tseng, P., and Toh, K.-C. (2011), “A Block Coordinate Gradient Descent Method for Regularized Convex Separable Optimization and Covariance Selection,” Mathematical Programming, 129, 331–355.
   Web of Science ®Google Scholar