Honest Confidence Sets for High-Dimensional Regression by Projection and Shrinkage

References

• Arias-Castro, E., Candès, E. J., and Plan, Y. (2011), “Global Testing Under Sparse Alternatives: ANOVA, Multiple Comparisons and the Higher Criticism,” Annals of Statistics, 39, 2533–2556.
   Web of Science ®Google Scholar
• Baraud, Y. (2004), “Confidence Balls in Gaussian Regression,” Annals of Statistics, 32, 528–551.
   Web of Science ®Google Scholar
• Beran, R., and Dümbgen, L. (1998), “Modulation of Estimators and Confidence Sets,” Annals of Statistics, 26, 1826–1856.
   Web of Science ®Google Scholar
• Bühlmann, P., Kalisch, M., and Meier, L. (2014), “High-Dimensional Statistics with a View Toward Applications in Biology,” Annual Review of Statistics and Its Application, 1, 255–278. DOI: 10.1146/annurev-statistics-022513-115545.
   Web of Science ®Google Scholar
• Bickel, P. J., Ritov, Y., and Tsybakov, A. B. (2009), “Simultaneous Analysis of Lasso and Dantzig Selector,” Annals of Statistics, 37, 1705–1732.
   Web of Science ®Google Scholar
• Bradic, J., Fan, J., and Zhu, Y. (2018), “Testability of High-Dimensional Linear Models With Non-Sparse Structures,” arXiv:1802.09117͡.
   Google Scholar
• Bull, A. D., and Nickl, R. (2013), “Adaptive Confidence Sets in L2,” Probability Theory and Related Fields, 156, 889–919.
   Web of Science ®Google Scholar
• Cai, T. T., and Guo, Z. (2017), “Confidence Intervals for High-Dimensional Linear Regression: Minimax Rates and Adaptivity,” Annals of Statistics, 45, 615–646.
   Web of Science ®Google Scholar
• Cai, T. T., and Guo, Z. (2018), “Accuracy Assessment for High-Dimensional Linear Regression,” Annals of Statistics, 46, 1807–1836.
   Web of Science ®Google Scholar
• Cai, T. T., and Guo, Z. (2020), “Semisupervised Inference for Explained Variance in High Dimensional Linear Regression and its Applications,” Journal of the Royal Statistical Society, Series B.
   Google Scholar
• Cai, T. T., and Low, M. G. (2006), “Adaptive Confidence Balls,” Annals of Statistics, 34, 202–228.
   Web of Science ®Google Scholar
• Carpentier, A. (2015), “Implementable Confidence Sets in High Dimensional Regression,” in Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics, Vol. 38 of Proceedings of Machine Learning Research, eds. G. Lebanon and S. V. N. Vishwanathan, San Diego, CA: PMLR, pp. 120–128.
   Google Scholar
• Dezeure, R., Bühlmann, P., Meier, L., and Meinshausen, N. (2015), “High-Dimensional Inference: Confidence Intervals, p-Values and R-Software Hdi,” Statistical Science, 30, 533–558. DOI: 10.1214/15-STS527.
   Web of Science ®Google Scholar
• Dezeure, R., Bühlmann, P., and Zhang, C.-H. (2017), “High-Dimensional Simultaneous Inference With the Bootstrap,” TEST, 26, 685–719.
   Web of Science ®Google Scholar
• Efron, B., and Morris, C. (1973), “Stein’s Estimation Rule and its Competitors–An Empirical Bayes Approach,” Journal of the American Statistical Association, 68, 117–130.
   Web of Science ®Google Scholar
• Ewald, K., and Schneider, U. (2018), “Uniformly Valid Confidence Sets Based on the Lasso,” Electronic Journal of Statistics, 12, 1358–1387. DOI: 10.1214/18-EJS1425.
   Web of Science ®Google Scholar
• Genovese, C. R., and Wasserman, L. (2005), “Confidence Sets for Nonparametric Wavelet Regression,” Annals of Statistics, 33, 698–729.
   Web of Science ®Google Scholar
• Hastie, T., Tibshirani, R., and Wainwright, M. (2015), Statistical Learning with Sparsity: The Lasso and Generalizations, New York: Chapman & Hall/CRC.
   Google Scholar
• Hoffman, M., and Lepski, O. (2002), “Random Rates in Anisotropic Regression” (with discussion), Annals of Statistics, 30, 325–396.
   Web of Science ®Google Scholar
• Ingster, Y. I., Tsybakov, A. B., and Verzelen, N. (2010), “Detection Boundary in Sparse Regression,” Electronic Journal of Statistics, 4, 1476–1526. DOI: 10.1214/10-EJS589.
   Web of Science ®Google Scholar
• Javanmard, A. and Montanari, A. (2014), “Confidence Intervals and Hypothesis Testing for High-Dimensional Regression,” Journal of Machine Learning Research, 15, 2869–2909.
   Web of Science ®Google Scholar
• Juditsky, A., and Lambert-Lacroix, S. (2003), “Nonparametric Confidence Set Estimation,” Mathematical Methods of Statistics, 12, 410–428.
   Google Scholar
• Lei, J., G’Sell, M., Rinaldo, A., Tibshirani, R. J., and Wasserman, L. (2018), “Distribution-Free Predictive Inference for Regression,” Journal of the American Statistical Association, 113, 1094–1111.
   Web of Science ®Google Scholar
• Li, K.-C. (1985), “From Stein’s Unbiased Risk Estimates to the Method of Generalized Cross Validation,” Annals of Statistics, 13, 1352–1377.
   Web of Science ®Google Scholar
• Li, K.-C. (1989), “Honest Confidence Regions for Nonparametric Regression,” Annals of Statistics, 17, 1001–1008.
   Web of Science ®Google Scholar
• Li, S. (2020), “Debiasing the Debiased Lasso With Bootstrap,” Electronic Journal of Statistics, 14, 2298–2337. DOI: 10.1214/20-EJS1713.
   Web of Science ®Google Scholar
• Min, S., and Zhou, Q. (2019), “Constructing Confidence Sets After Lasso Selection by Randomized Estimator Augmentation,” arXiv: 1904.08018͡.
   Google Scholar
• Negahban, S. N., Ravikumar, P., Wainwright, M. J., and Yu, B. (2012), “A Unified Framework for High-Dimensional Analysis of M-Estimators With Decomposable Regularizers,” Statistical Science, 27, 538–557. DOI: 10.1214/12-STS400.
   Web of Science ®Google Scholar
• Nickl, R., and van de Geer, S. (2013), “Confidence Sets in Sparse Regression,” Annals of Statistics, 41, 2852–2876.
   Web of Science ®Google Scholar
• Robins, J., and van der Vaart, A. (2006), “Adaptive Nonparametric Confidence Sets,” Annals of Statistics, 34, 229–253.
   Web of Science ®Google Scholar
• Schneider, U. (2016), “Confidence Sets Based on Thresholding Estimators in High-Dimensional Gaussian Regression Models,” Econometric Reviews, 35, 1412–1455.
   Web of Science ®Google Scholar
• Stein, C. M. (1981), “Estimation of the Mean of a Multivariate Normal Distribution,” The Annals of Statistics, 9, 1135–1151. DOI: 10.1214/aos/1176345632.
   Web of Science ®Google Scholar
• Sun, T., and Zhang, C.-H. (2012), “Scaled Sparse Linear Regression,” Biometrika, 99, 879–898.
   Web of Science ®Google Scholar
• Sun, T., and Zhang, C.-H. (2013), “Sparse Matrix Inversion with Scaled Lasso,” Journal of Machine Learning Research, 14, 3385–3418.
   Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
   Google Scholar
• van de Geer, S., Bühlmann, P., Ritov, Y., and Dezeure, R. (2014), “On Asymptotically Optimal Confidence Regions and Tests for High-Dimensional Models,” Annals of Statistics, 42, 1166–1202.
   Web of Science ®Google Scholar
• Verzelen, N. (2012), “Minimax Risks for Sparse Regressions: Ultra-High Dimensional Phenomenons,” Electronic Journal of Statistics, 6, 38–90. DOI: 10.1214/12-EJS666.
   Web of Science ®Google Scholar
• Zhang, C.-H. (2010), “Nearly Unbiased Variable Selection Under Minimax Concave Penalty,” Annals of Statistics, 38, 894–942.
   Web of Science ®Google Scholar
• Zhang, C.-H., and Huang, J. (2008), “The Sparsity and Bias of the Lasso Selection in High-Dimensional Linear Regression,” Annals of Statistics, 36, 1567–1594.
   Web of Science ®Google Scholar
• Zhang, C.-H., and Zhang, S. S. (2014), “Confidence Intervals for Low Dimensional Parameters in High Dimensional Linear Models,” Journal of the Royal Statistical Society, Series B, 76, 217–242.
   Web of Science ®Google Scholar
• Zhang, X., and Cheng, G. (2017), “Simultaneous Inference for High-Dimensional Linear Models,” Journal of the American Statistical Association, 112, 757–768.
   Web of Science ®Google Scholar
• Zhou, Q. (2014), “Monte Carlo Simulation for Lasso-Type Problems by Estimator Augmentation,” Journal of the American Statistical Association, 109, 1495–1516.
   Web of Science ®Google Scholar
• Zhou, Q., and Min, S. (2017), “Estimator Augmentation With Applications in High-Dimensional Group Inference,” Electronic Journal of Statistics, 11, 3039–3080. DOI: 10.1214/17-EJS1309.
   Web of Science ®Google Scholar