A Unified Algorithm for Penalized Convolution Smoothed Quantile Regression

References

• Beck, A., and Teboulle, M. (2009), “A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems,” SIAM Journal of Imaging Science, 2, 183–202. DOI: 10.1137/080716542.
   Web of Science ®Google Scholar
• Belloni, A., and Chernozhukov, V. (2011), “ℓ1-Penalized Quantile Regression in High-Dimensional Sparse Models,” The Annals of Statistics, 39, 82–130. DOI: 10.1214/10-AOS827.
   Web of Science ®Google Scholar
• Brown, B. M., and Wang, Y. G. (2005), “Standard Errors and Covariance Matrices for Smoothed Rank Estimators,” Biometrika, 92, 149–158. DOI: 10.1093/biomet/92.1.149.
   Web of Science ®Google Scholar
• Bühlmann, P., and van de Geer, S. (2011), Statistics for High-Dimensional Data: Methods, Theory and Applications, Heidelberg: Springer.
   Google Scholar
• Cantril, H. (1965), The Pattern of Human Concerns, New Brunswick: Rutgers University Press.
   Google Scholar
• Choi, T., and Choi, S. (2021), “A Fast Algorithm for the Accelerated Failure Time Model with High-Dimensional Time-to-Event Data,” Journal of Statistical Computation and Simulation, 91, 3385–3403. DOI: 10.1080/00949655.2021.1927034.
   Web of Science ®Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Regularized Likelihood and Its Oracle Properties,” Journal of American Statistical Association, 96, 1348–1360. DOI: 10.1198/016214501753382273.
   Web of Science ®Google Scholar
• Fan, J., Liu, H., Sun, Q., and Zhang, T. (2018), “I-LAMM for Sparse Learning: Simultaneous Control of Algorithmic Complexity and Statistical Error,” The Annals of Statistics, 46, 814–841. DOI: 10.1214/17-AOS1568.
   PubMed Web of Science ®Google Scholar
• Fernandes, M., Guerre, E., and Horta, E. (2021), “Smoothing Quantile Regressions,” Journal of Business & Economic Statistics, 39, 338–357. DOI: 10.1080/07350015.2019.1660177.
   Web of Science ®Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2010), “Regularization Paths for Generalized Linear Models via Coordinate Descent,” Journal of Statistical Software, 33, 1–22.
   PubMed Web of Science ®Google Scholar
• Gu, Y., Fan, J., Kong, L., Ma, S., and Zou, H. (2018), “ADMM for High-Dimensional Sparse Regularized Quantile Regression,” Technometrics, 60, 319–331. DOI: 10.1080/00401706.2017.1345703.
   Web of Science ®Google Scholar
• Hastie, T., Tibshirani, R., and Wainwright, M. (2015), Statistical Learning with Sparsity: The Lasso and Generalizations, Boca Raton, FL: CRC Press.
   Google Scholar
• He, X., Pan, X., Tan, K.M., and Zhou, W.-X. (2023), “Smoothed Quantile Regression with Large-Scale Inference,” Journal of Econometrics, 232, 367–388. DOI: 10.1016/j.jeconom.2021.07.010.
   PubMed Web of Science ®Google Scholar
• He, X., Pan, X., Tan, K.M., and Zhou, W.-X. (2022), Package “conquer”, version 1.3.0. Reference manual: https://cran.r-project.org/web/packages/conquer/conquer.pdf.
   Google Scholar
• Helliwell, J., Layard, R., and Sachs, J. (2013), “World Happiness Report 2013,” Sustainable Development Solutions Network.
   Google Scholar
• Hunter, D.R., and Lange, K. (2004), “A Tutorial on MM Algorithms,” The American Statistician, 58, 30–37. DOI: 10.1198/0003130042836.
   Web of Science ®Google Scholar
• Horowitz, J.L. (1998), “Bootstrap Methods for Median Regression Models,” Econometrica, 66, 1327–1351. DOI: 10.2307/2999619.
   Web of Science ®Google Scholar
• Kato, K. (2011), “Group Lasso for High Dimensional Sparse Quantile Regression Models,” arXiv preprint arXiv:1103.1458.
   Google Scholar
• Koenker, R. (2005), Quantile Regression, Cambridge: Cambridge University Press.
   Google Scholar
• —– (2023), Package “quantreg”, version 5.95. Reference manual: https://cran.r-project.org/web/packages/quantreg/quantreg.pdf.
   Google Scholar
• Koenker, R., and Bassett, G. (1978), “Regression Quantiles,” Econometrica, 46, 33–50. DOI: 10.2307/1913643.
   Web of Science ®Google Scholar
• Koenker, R., Chernozhukov, V., He, X., and Peng, L. (2017), Handbook of Quantile Regression, Boca Raton, FL: CRC Press.
   Google Scholar
• Koenker, R., and Ng, P. (2005), “A Frisch-Newton Algorithm for Sparse Quantile Regression,” Acta Mathematicae Applicatae Sinica, 21, 225–236. DOI: 10.1007/s10255-005-0231-1.
   Google Scholar
• Lange, K., Hunter, D.R., and Yang, I. (2000), “Optimization Transfer Using Surrogate Objective Functions,” Journal of Computational and Graphical Statistics, 9, 1–59. DOI: 10.2307/1390605.
   Web of Science ®Google Scholar
• Li, Y., and Zhu, J. (2008), “ℓ1-norm Quantile Regression,” Journal of Computational and Graphical Statistics, 17, 163–185. DOI: 10.1198/106186008X289155.
   Web of Science ®Google Scholar
• Loh, P. (2017), “Statistical Consistency and Asymptotic Normality for High-Dimensional Robust M-estimators,” The Annals of Statistics, 45, 866–896. DOI: 10.1214/16-AOS1471.
   Web of Science ®Google Scholar
• Pan, X., Sun, Q., and Zhou, W.-X. (2021), “Iteratively Reweighted ℓ1-penalized Robust Regression,” Electronic Journal of Statistics, 25 3287–3348. DOI: 10.1214/21-EJS1862.
   Google Scholar
• Pang, L., Lu, W., and Wang, H. J. (2012), “Variance Estimation in Censored Quantile Regression via Induced Smoothing,” Computational Statistics and Data Analysis, 56, 785–796. DOI: 10.1016/j.csda.2010.10.018.
   PubMed Web of Science ®Google Scholar
• Peng, B., and Wang, L. (2015), “An Iterative Coordinate Descent Algorithm for High-Dimensional Nonconvex Penalized Quantile Regression,” Journal of Computational and Graphical Statistics, 24, 676–694. DOI: 10.1080/10618600.2014.913516.
   Web of Science ®Google Scholar
• Petersen, A., and Witten, D. (2019), “Data-Adaptive Additive Modeling,” Statistics in Medicine, 38, 583–600. DOI: 10.1002/sim.7859.
   PubMed Web of Science ®Google Scholar
• Petersen, A., Witten, D., and Simon, N. (2016), “Fused Lasso Additive Model,” Journal of Computational and Graphical Statistics, 25, 1005–1025. DOI: 10.1080/10618600.2015.1073155.
   PubMed Web of Science ®Google Scholar
• Portnoy, S., and Koenker, R. (1997), “The Gaussian Hare and the Laplacian Tortoise: Computability of Squared-Error versus Absolute-Error Estimators,” Statistical Science, 12, 279–300. DOI: 10.1214/ss/1030037960.
   Web of Science ®Google Scholar
• Sadhanala, V., and Tibshirani, R. (2019), “Additive Models with Trend Filtering,” The Annals of Statistics, 47, 3032–3068. DOI: 10.1214/19-AOS1833.
   Web of Science ®Google Scholar
• Sherwood, B., and Maidman, A. (2020), Package “rqPen”, version 2.2.2. Reference manual: https://cran.r-project.org/web/packages/rqPen/rqPen.pdf.
   Google Scholar
• Simon, N., Friedman, J., Hastie, T., and Tibshirani, R. (2013), “A Sparse-Group Lasso,” Journal of Computational and Graphical Statistics, 22, 231–245. DOI: 10.1080/10618600.2012.681250.
   Web of Science ®Google Scholar
• Tan, K. M., Wang, L., and Zhou, W.-X. (2022), “High-Dimensional Quantile Regression: Convolution Smoothing and Concave Regularization,” Journal of the Royal Statistical Society, Series B, 84, 205–233. DOI: 10.1111/rssb.12485.
   Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288. DOI: 10.1111/j.2517-6161.1996.tb02080.x.
   Google Scholar
• Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., and Knight, K. (2005), “Sparsity and Smoothness via the Fused Lasso,” Journal of the Royal Statistical Society, Series B, 67, 91–108. DOI: 10.1111/j.1467-9868.2005.00490.x.
   Google Scholar
• Tibshirani, R., and Taylor, J. (2011), “The Solution Path of the Generalized Lasso,” The Annals of Statistics, 39, 1335–1371. DOI: 10.1214/11-AOS878.
   Web of Science ®Google Scholar
• United Nations Development Programme. (2012), Human Development Indicators, New York: United Nations Publications.
   Google Scholar
• Wainwright, M. J. (2019), High-Dimensional Statistics: A Non-Asymptotic Viewpoint, Cambridge: Cambridge University Press.
   Google Scholar
• Wang, L., Wu, Y., and Li, R. (2012), “Quantile Regression for Analyzing Heterogeneity in Ultra-High Dimension,” Journal of American Statistical Association, 107, 214–222. DOI: 10.1080/01621459.2012.656014.
   PubMed Web of Science ®Google Scholar
• World Bank Group. (2012), World Development Indicators 2012, Washington, DC: World Bank Publications.
   Google Scholar
• Wu, J., and Witten, D. (2019), “Flexible and Interpretable Models for Survival Data,” Journal of Computational and Graphical Statistics, 28, 954–966. DOI: 10.1080/10618600.2019.1592758.
   PubMed Web of Science ®Google Scholar
• Yi, C., and Huang, J. (2017), “Semismooth Newton Coordinate Descent Algorithm for Elastic-Net Penalized Huber Regression and Quantile Regression,” Journal of Computational and Graphical Statistics, 26, 547–557. DOI: 10.1080/10618600.2016.1256816.
   Web of Science ®Google Scholar
• Yu, L., Lin, N., and Wang, L. (2017), “A Parallel Algorithm for Large-Scale Nonconvex Penalized Quantile Regression,” Journal of Computational and Graphical Statistics, 26, 935–939. DOI: 10.1080/10618600.2017.1328366.
   Web of Science ®Google Scholar
• Yuan, M., and Lin, Y. (2006), “Model Selection and Estimation in Regression with Grouped Variables,” Journal of the Royal Statistical Society, Series B, 68, 49–67. DOI: 10.1111/j.1467-9868.2005.00532.x.
   Google Scholar
• Zhang, C.-H. (2010), “Nearly Unbiased Variable Selection Under Minimax Concave Penalty,” The Annals of Statistics, 38, 894–942. DOI: 10.1214/09-AOS729.
   Web of Science ®Google Scholar
• Zheng, Q., Peng, L., and He, X. (2015), “Globally Adaptive Quantile Regression with Ultra-High Dimensional Data,” The Annals of Statistics, 43, 2225–2258. DOI: 10.1214/15-AOS1340.
   PubMed Web of Science ®Google Scholar
• Zou, H., and Hastie, T. (2005), “Regularization and Variable Selection via the Elastic Net,” Journal of the Royal Statistical Society, Series B, 67, 301–320. DOI: 10.1111/j.1467-9868.2005.00503.x.
   Google Scholar