4,422
Views
7
CrossRef citations to date
0
Altmetric
Regularized Regression: Implementation and Interpetation

Influence Diagnostics for High-Dimensional Lasso Regression

, , &
Pages 877-890 | Received 21 Aug 2016, Accepted 03 Mar 2019, Published online: 11 Jun 2019

References

  • Atkinson, A. C. (1981), “Two Graphical Displays for Outlying and Influential Observations in Regression,” Biometrika, 68, 13–20. DOI: 10.1093/biomet/68.1.13.
  • Atkinson, A. C. (1984), “Two Books on Regression Diagnostics,” Annals of Statistics, 12, 392–401.
  • Belsley, D. A., Kuh, E., and Welsch, R. E. (1980), Regression Diagnostics: Identifying Influential Data and Sources of Collinearity, New York: Wiley.
  • Candes, E., and Tao, T. (2007), “The Dantzig Selector: Statistical Estimation When p Is Much Larger Than n,” Annals of Statistics, 35, 2313–2351. DOI: 10.1214/009053606000001523.
  • Chen, J., and Chen, Z. (2008), “Extended Bayesian Information Criteria for Model Selection With Large Model Spaces,” Biometrika, 95, 759–771. DOI: 10.1093/biomet/asn034.
  • Chen, X., Wang, Z. J., and McKeown, M. J. (2010), “Asymptotic Analysis of Robust Lassos in the Presence of Noise With Large Variance,” IEEE Transactions on Information Theory, 56, 5131–5149. DOI: 10.1109/TIT.2010.2059770.
  • Chuang, Y. Y., Tran, N. L., Rusk, N., Nakada, M., Berens, M. E., and Symons, M. (2004), “Role of Synaptojanin in Glioma Cell Migration and Invasion,” Cancer Research, 64, 8271–8275. DOI: 10.1158/0008-5472.CAN-04-2097.
  • Cook, R. D. (1977), “Detection of Influential Observation in Linear Regression,” Technometrics, 19, 15–18. DOI: 10.2307/1268249.
  • Cook, R. D. (1979), “Influential Observations in Linear Regression,” Journal of the American Statistical Association, 74, 169–174.
  • Cook, R. D., and Weisburg, S. (1982), Residuals and Influence in Regression, New York: Chapman and Hall.
  • Dasari, V. R., Kaur, K., Velpula, K. K., Gujrati, M., Fassett, D., Klopfenstein, J. D., Dinh, D. H., and Rao, J. S. (2010), “Upregulation of PTEN in Glioma Cells by Cord Blood Mesenchymal Stem Cells Inhibits Migration via Downregulation of the PI3K/Akt Pathway,” PLoS ONE, 5, e10350. DOI: 10.1371/journal.pone.0010350.
  • Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), “Least Angle Regression,” Annals of Statistics, 32, 407–499. DOI: 10.1214/009053604000000067.
  • Frank, L. E., and Friedman, J. H. (1993), “A Statistical View of Some Chemometrics Regression Tools,” Technometrics, 35, 109–135. DOI: 10.1080/00401706.1993.10485033.
  • Gao, X., and Song, P. X.-K. (2010), “Composite Likelihood Bayesian Information Criteria for Model Selection in High-Dimensional Data,” Journal of the American Statistical Association, 105, 1531–1540. DOI: 10.1198/jasa.2010.tm09414.
  • Geert, V., and Geert, M. (2000), “Linear Mixed Models for Longitudinal Data,” in Linear Mixed Models for Longitudinal Data, New York: Springer-Verlag, pp. 240–268.
  • Hawkins, D. M., Bradu, D., and Kass, G. V. (1984), “Location of Several Outliers in Multiple Regression Data Using Elemental Sets,” Technometrics, 26, 197–208. DOI: 10.1080/00401706.1984.10487956.
  • Hesterberg, T., Choi, N. H., Meier, L., and Farley, C. (2008), “Least Angle and l1 Penalized Regression: A Review,” Statistics Surveys, 2, 61–93. DOI: 10.1214/08-SS035.
  • Horvath, S., Zhang, B., Carlson, M., Lu, K. V., Zhu, S., Felciano, R. M., Laurance, M. F., Zhao, W., Shu, Q., Lee, Y., Scheck, A. C., Liau, L. M., Wu, H., Geschwind, D. H., Febbo, P. G., Kornblum, H. I., Cloughesy, T. F., Nelson, S. F., and Mischel, P. S. (2006), “Analysis of Oncogenic Signaling Networks in Glioblastoma Identifies ASPM as a Novel Molecular Target,” Proceedings of National Academy of Sciences of the United States of America, 103, 17402–17407. DOI: 10.1073/pnas.0608396103.
  • Lambert-Lacroix, S., and Zwald, L. (2011), “Robust Regression Through the Huber’s Criterion and Adaptive Lasso Penalty,” Electronic Journal of Statistics, 5, 1015–1053. DOI: 10.1214/11-EJS635.
  • Liu, F., Park, P. J., Lai, W., Maher, E., Chakravarti, A., Durso, L., Jiang, X., Yu, Y., Brosius, A., Thomas, M., Chin, L., Brennan, C., DePinho, R. A., Kohane, I., Carroll, R. S., Black, P. M., and Johnson, M. D. (2006), “A Genome-Wide Screen Reveals Functional Gene Clusters in the Cancer Genome and Identifies EphA2 as a Mitogen in Glioblastoma,” Cancer Research, 66, 10815–10823. DOI: 10.1158/0008-5472.CAN-06-1408.
  • Liu, H., Roeder, K., and Wasserman, L. (2010), “Stability Approach to Regularization Selection (Stars) for High Dimensional Graphical Models,” in Advances in Neural Information Processing Systems, pp. 1432–1440.
  • Loy, A., and Hofmann, H. (2014), “HLMdiag: A Suite of Diagnostics for Hierarchical Linear Models in R,” Journal of Statistical Software, 56, 1–28.
  • Loy, A., and Hofmann, H. (2015), “Are You Normal? The Problem of Confounded Residual Structures in Hierarchical Linear Models,” Journal of Computational and Graphical Statistics, 24, 1191–1209.
  • Loy, A., Hofmann, H., and Cook, D. (2017), “Model Choice and Diagnostics for Linear Mixed-Effects Models Using Statistics on Street Corners,” Journal of Computational and Graphical Statistics, 26, 478–492. DOI: 10.1080/10618600.2017.1330207.
  • Peña, D. (2005), “A New Statistic for Influence in Linear Regression,” Technometrics, 47, 1–12. DOI: 10.1198/004017004000000662.
  • Roberts, S., and Nowak, G. (2014), “Stabilizing the Lasso Against Cross-Validation Variability,” Computational Statistics and Data Analysis, 70, 198–211. DOI: 10.1016/j.csda.2013.09.008.
  • She, Y., and Owen, A. B. (2011), “Outlier Detection Using Nonconvex Penalized Regression,” Journal of the American Statistical Association, 106, 626–639. DOI: 10.1198/jasa.2011.tm10390.
  • Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288. DOI: 10.1111/j.2517-6161.1996.tb02080.x.
  • Tibshirani, R. (2011), “Regression Shrinkage and Selection via the Lasso: A Retrospective,” Journal of the Royal Statistical Society, Series B, 73, 273–282.
  • Wang, S., Nan, B., Rosset, S., and Zhu, J. (2011), “Random Lasso,” Annals of Applied Statistics, 5, 468–485. DOI: 10.1214/10-AOAS377.
  • Wang, T., and Li, Z. (2016), “Outlier Detection in High-Dimensional Regression Model,” Communications in Statistics—Theory and Methods, 46, 6947–6958. DOI: 10.1080/03610926.2016.1140783.
  • Webster, R. J., Giles, K. M., Price, K. J., Zhang, P. M., Mattick, J. S., and Leedman, P. J. (2009), “Regulation of Epidermal Growth Factor Receptor Signaling in Human Cancer Cells by MicroRNA-7,” Journal of Biological Chemistry, 284, 5731–5741. DOI: 10.1074/jbc.M804280200.
  • Zhang, Y., and Shen, X. (2010), “Model Selection Procedure for High-Dimensional Data,” Statistical Analysis and Data Mining: The ASA Data Science Journal, 3, 350–358. DOI: 10.1002/sam.10088.
  • Zhao, J., Leng, C., Li, L., and Wang, H. (2013), “High-Dimensional Influence Measure,” Annals of Statistics, 41, 2639–2667. DOI: 10.1214/13-AOS1165.