A Sharper Computational Tool for Regression

References

• Alfons, A., Croux, C., and Gelper, S. (2013), “Sparse Least Trimmed Squares Regression for Analyzing High-Dimensional Large Data Sets,” The Annals of Applied Statistics, 7, 226–248. DOI: 10.1214/12-AOAS575.
   Web of Science ®Google Scholar
• Alvarez, E. E., and Yohai, V. J. (2012), “M-Estimators for Isotonic Regression,” Journal of Statistical Planning and Inference, 142, 2351–2368. DOI: 10.1016/j.jspi.2012.02.051.
   Web of Science ®Google Scholar
• Barlow, R. E., and Brunk, H. D. (1972), “The Isotonic Regression Problem and its Dual,” Journal of the American Statistical Association, 67, 140–147. DOI: 10.1080/01621459.1972.10481216.
   Web of Science ®Google Scholar
• Bauschke, H. H., and Combettes, P. L. (2011), Convex Analysis and Monotone Operator Theory in Hilbert Spaces (Vol. 408), Cham: Springer.
   Google Scholar
• Blanchet, J., Glynn, P. W., Yan, J., and Zhou, Z. (2019), “Multivariate Distributionally Robust Convex Regression under Absolute Error Loss,” Advances in Neural Information Processing Systems, 32, 11817–11826.
   Google Scholar
• Breheny, P., and Huang, J. (2011), “Coordinate Descent Algorithms for Nonconvex Penalized Regression, with Applications to Biological Feature Selection,” Annals of Applied Statistics, 5, 232–253.
   PubMed Web of Science ®Google Scholar
• Chi, E. C., Zhou, H., and Lange, K. (2014), “Distance Majorization and its Applications,” Mathematical Programming, 146, 409–436. DOI: 10.1007/s10107-013-0697-1.
   PubMed Web of Science ®Google Scholar
• Chi, J. T., and Chi, E. C. (2022), “A User-Friendly Computational Framework for Robust Structured Regression with the L2 Criterion,” Journal of Computational and Graphical Statistics, 1–12. DOI: 10.1080/10618600.2022.2035232.
   Web of Science ®Google Scholar
• de Leeuw, J., Hornik, K., and Mair, P. (2010), “Isotone Optimization in R: Pool-Adjacent-Violators Algorithm (PAVA) and Active Set Methods,” Journal of Statistical Software, 32, 1–24.
   Web of Science ®Google Scholar
• de Leeuw, J., and Lange, K. (2009), “Sharp Quadratic Majorization in One Dimension,” Computational Statistics & Data Analysis, 53, 2471–2484.
   PubMed Web of Science ®Google Scholar
• Hoerl, A. E., and Kennard, R. W. (1970), “Ridge Regression: Biased Estimation for Nonorthogonal Problems,” Technometrics, 12, 55–67. DOI: 10.1080/00401706.1970.10488634.
   Web of Science ®Google Scholar
• Huber, P. J. (1992), “Robust Estimation of a Location Parameter,” in Breakthroughs in Statistics, eds. S. Kotz, and N. L. Johnson, New York: Springer, 492–518.
   Google Scholar
• Keys, K. L., Zhou, H., and Lange, K. (2019), “Proximal Distance Algorithms: Theory and Practice,” The Journal of Machine Learning Research, 20, 2384–2421.
   Web of Science ®Google Scholar
• Landeros, A., Padilla, O. H. M., Zhou, H., and Lange, K. (2020), “Extensions to the Proximal Distance Method of Constrained Optimization,” arXiv preprint arXiv:2009.00801.
   Google Scholar
• Lange, K. (2016), MM Optimization Algorithms, Philadelphia PA: SIAM.
   Google Scholar
• Lange, K., Hunter, D. R., and Yang, I. (2000), “Optimization Transfer using Surrogate Objective Functions,” Journal of Computational and Graphical Statistics, 9, 1–20.
   Web of Science ®Google Scholar
• Liu, X., Chi, J., Lin, L., Lange, K., and Chi, E. (2022), L2E: Robust Structured Regression via the L2 Criterion. R package version 2.0—For new features, see the ’Changelog’ file (in the package source).
   Google Scholar
• Lozano, A. C., Meinshausen, N., and Yang, E. (2016), “Minimum Distance Lasso for Robust High-Dimensional Regression,” Electronic Journal of Statistics, 10, 1296–1340. DOI: 10.1214/16-EJS1136.
   Web of Science ®Google Scholar
• Nguyen, N. H., and Tran, T. D. (2012), “Robust Lasso with Missing and Grossly Corrupted Observations,” IEEE Transactions on Information Theory, 59, 2036–2058. DOI: 10.1109/TIT.2012.2232347.
   Web of Science ®Google Scholar
• R Core Team (2020), R: A Language and Environment for Statistical Computing, Vienna: R Foundation for Statistical Computing. Available at https://www.R-project.org/.
   Google Scholar
• Rousseeuw, P. J. and Leroy, A. M. (2005), Robust Regression and Outlier Detection, New York: Wiley.
   Google Scholar
• Scott, D. W. (1992), Multivariate Density Estimation: Theory, Practice, and Visualization, New York: Wiley.
   Google Scholar
• Scott, D. W. (2001), “Parametric Statistical Modeling by Minimum Integrated Square Error,” Technometrics, 43, 274–285.
   Web of Science ®Google Scholar
• Scott, D. W., and Wang, Z. (2021), “Robust Multiple Regression,” Entropy, 23, 88. DOI: 10.3390/e23010088.
   PubMed Web of Science ®Google Scholar
• Seijo, E., and Sen, B. (2011), “Nonparametric Least Squares Estimation of a Multivariate Convex Regression Function,” The Annals of Statistics, 39, 1633–1657. DOI: 10.1214/10-AOS852.
   Web of Science ®Google Scholar
• She, Y., and Owen, A. B. (2011), “Outlier Detection using Nonconvex Penalized Regression,” Journal of the American Statistical Association, 106, 626–639. DOI: 10.1198/jasa.2011.tm10390.
   Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288. DOI: 10.1111/j.2517-6161.1996.tb02080.x.
   Google Scholar
• Van Ruitenburg, J. (2005), “Algorithms for Parameter Estimation in the Rasch Model,” Measurement and Research Department Reports, 2005-4. CITO, Arnhem.
   Google Scholar
• Vansina, F., and De Greve, J. (1982), “Close Binary Systems Before and After Mass Transfer,” Astrophysics and Space Science, 87, 377–401. DOI: 10.1007/BF00648931.
   Web of Science ®Google Scholar
• Wang, H., Li, G., and Jiang, G. (2007), “Robust Regression Shrinkage and Consistent Variable Selection through the LAD-Lasso,” Journal of Business & Economic Statistics, 25, 347–355.
   Web of Science ®Google Scholar
• Wang, X., Jiang, Y., Huang, M., and Zhang, H. (2013), “Robust Variable Selection with Exponential Squared Loss,” Journal of the American Statistical Association, 108, 632–643. DOI: 10.1080/01621459.2013.766613.
   PubMed Web of Science ®Google Scholar
• Warwick, J., and Jones, M. (2005), “Choosing a Robustness Tuning Parameter,” Journal of Statistical Computation and Simulation, 75, 581–588. DOI: 10.1080/00949650412331299120.
   Web of Science ®Google Scholar
• Xu, J., Lange, K., and Chi, E. (2017), “Generalized Linear Model Regression under Distance-to-Set Penalties,” in Advances in Neural Information Processing Systems.
   Google Scholar
• Yang, E., Lozano, A. C., and Aravkin, A. (2018), “A General Family of Trimmed Estimators for Robust High-Dimensional Data Analysis,” Electronic Journal of Statistics, 12, 3519–3553. DOI: 10.1214/18-EJS1470.
   Web of Science ®Google Scholar
• Zhang, C.-H. (2010), “Nearly Unbiased Variable Selection under Minimax Concave Penalty,” The Annals of Statistics, 38, 894–942. DOI: 10.1214/09-AOS729.
   Web of Science ®Google Scholar