One-Step Estimator Paths for Concave Regularization

References

• Akaike, H. (1973), “Information Theory and the Maximum Likelihood Principle,” in Proceedings of the 2nd International Symposium on Information Theory, eds. B. Petrov and F. Csaki, Budapest: Akademiai Kiado, pp. 267–281.
   Google Scholar
• Armagan, A., Dunson, D. B., and Lee, J. (2013), “Generalized Double Pareto Shrinkage,” Statistica Sinica, 23, 119–143.
   PubMed Web of Science ®Google Scholar
• Bickel, P. J. (1975), “One-Step Huber Estimates in the Linear Model,” Journal of the American Statistical Association, 70, 428–434.
   Web of Science ®Google Scholar
• Bickel, P. J., Ritov, Y., and Tsybakov, A. B. (2009), “Simultaneous Analysis of Lasso and Dantzig Selector,” The Annals of Statistics, 37, 1705–1732.
   Web of Science ®Google Scholar
• Breheny, P., and Huang, J. (2011), “Coordinate Descent Algorithms for Nonconvex Penalized Regression, with Applications to Biological Feature Selection,” The Annals of Applied Statistics, 5, 232–253.
   PubMed Web of Science ®Google Scholar
• Breiman, L. (1996), “Heuristics of Instability and Stabilization in Model Selection,” The Annals of Statistics, 25, 2350–2383.
   Google Scholar
• Bühlmann, P., and van de Geer, S. (2011), Statistics for High-Dimensional Data, New York: Springer.
   Google Scholar
• Candes, E. J., Wakin, M. B., and Boyd, S. P. (2008), “Enhancing Sparsity by Reweighted L1 Minimization,” Journal of Fourier Analysis and Applications, 14, 877–905.
   Web of Science ®Google Scholar
• Cevher, V. (2009), “Learning with Compressible Priors,” in 2009 Neural Information Processing Systems (NIPS).
   Google Scholar
• Efron, B. (2004), “The Estimation of Prediction Error: Covariance Penalties and Cross-Validation,” Journal of the American Statistical Association, 99, 619–632.
   Web of Science ®Google Scholar
• Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), “Least Angle Regression,” Annals of Statistics, 32, 407–499.
   Web of Science ®Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360.
   Web of Science ®Google Scholar
• Fan, J., and Peng, H. (2004), “Nonconcave Penalized Likelihood with a Diverging Number of Parameters,” The Annals of Statistics, 32, 928–961.
   Web of Science ®Google Scholar
• Fan, J., Xue, L., and Zou, H. (2014), “Strong Oracle Optimality of Folded Concave Penalized Estimation,” The Annals of Statistics, 42, 819–849.
   PubMed Web of Science ®Google Scholar
• Flynn, C., Hurvich, C., and Simonoff, J. (2013), “Efficiency for Regularization Parameter Selection in Penalized Likelihood Estimation of Misspecified Models,” Journal of the American Statistical Association, 108, 1031–1043.
   Web of Science ®Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2010), “Regularization Paths for Generalized Linear Models Via Coordinate Descent,” Journal of Statistical Software, 33, 1–22.
   PubMed Web of Science ®Google Scholar
• Friedman, J. H. (2012), “Fast Sparse Regression and Classification,” International Journal of Forecasting, 28, 722–738.
   Web of Science ®Google Scholar
• Gentzkow, M., Shapiro, J., and Taddy, M. (2016), “Measuring Polarization in High-Dimensional Data: Method and Application to Congressional Speech,” NBER Working Paper No. 22423.
   Google Scholar
• Gramacy, R., Jensen, S., and Taddy, M. (2013), “Estimating Player Contribution in Hockey with Regularized Logistic Regression,” Journal of Quantitative Analysis in Sports, 9, 97–111.
   Google Scholar
• Gramacy, R., Taddy, M., and Tian, S. (2015), “Hockey Performance Via Regression,” in The Handbook of Statistical Methods for Design and Analysis in Sports, Boca Raton, FL: CRC Press.
   Google Scholar
• Hoerl, A., and Kennard, R. (1970), “Ridge Regression: Biased Estimation for Nonorthogonal Problems,” Technometrics, 12, 55–67.
   Web of Science ®Google Scholar
• Huang, J., Ma, S., and Zhang, C.-H. (2008), “Adaptive Lasso for Sparse High-Dimensional Regression Models,” Statistica Sinica, 18, 1603–1618.
   Web of Science ®Google Scholar
• Hurvich, C. M., and Tsai, C.-L. (1989), “Regression and Time Series Model Selection in Small Samples,” Biometrika, 76, 297–307.
   Web of Science ®Google Scholar
• Mallows, C. L. (1973), “Some Comments on CP,” Technometrics, 15, 661–675.
   Web of Science ®Google Scholar
• Mazumder, R., Friedman, J. H., and Hastie, T. (2011), “SparseNet: Coordinate Descent With Nonconvex Penalties,” Journal of the American Statistical Association, 106, 1125–1138.
   PubMed Web of Science ®Google Scholar
• Park, T., and Casella, G. (2008), “The Bayesian Lasso,” Journal of the American Statistical Association, 103, 681–686.
   Web of Science ®Google Scholar
• Raskutti, G., Wainwright, M. J., and Yu, B. (2010), “Restricted Eigenvalue Properties for Correlated Gaussian Designs,” The Journal of Machine Learning Research, 11, 2241–2259.
   Web of Science ®Google Scholar
• Schwarz, G. (1978), “Estimating the Dimension of a Model,” The Annals of Statistics, 6, 461–464.
   Web of Science ®Google Scholar
• Stein, C. M. (1981), “Estimation of the Mean of a Multivariate Normal Distribution,” The Annals of Statistics, 9, 1135–1151.
   Web of Science ®Google Scholar
• Taddy, M. (2013), “Multinomial Inverse Regression for Text Analysis,” Journal of the American Statistical Association, 108, 755–770.
   Web of Science ®Google Scholar
• ——— (2015), “Distributed Multinomial Regression,” The Annals of Applied Statistics, 9, 1394–1414.
   Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection Via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
   Google Scholar
• Wainwright, M. J. (2006), “Sharp Thresholds for High-Dimensional and Noisy Recovery of Sparsity,” Department of Statistics, UC Berkeley Technical Report 708.
   Google Scholar
• ——— (2009), “Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using L1-Constrained Quadratic Programming (Lasso),” IEEE Transactions on Information Theory, 55, 2183–2202.
   Web of Science ®Google Scholar
• Wang, L., Kim, Y., and Li, R. (2013), “Calibrating Nonconvex Penalized Regression in Ultra-High Dimension,” The Annals of Statistics, 41, 2505–2536.
   PubMed Web of Science ®Google Scholar
• Zhang, C.-H. (2010a), “Nearly Unbiased Variable Selection Under Minimax Concave Penalty,” Annals of Statistics, 38, 894–942.
   Web of Science ®Google Scholar
• Zhang, T. (2010b), “Analysis of Multi-Stage Convex Relaxation for Sparse Regularization,” The Journal of Machine Learning Research, 11, 1081–1107.
   Web of Science ®Google Scholar
• Zhang, T. (2013), “Multi-Stage Convex Relaxation for Feature Selection,” Bernoulli, 19, 2277–2293.
   Web of Science ®Google Scholar
• Zou, H. (2006), “The Adaptive Lasso and its Oracle Properties,” Journal of the American Statistical Association, 101, 1418–1429.
   Web of Science ®Google Scholar
• Zou, H., and Hastie, T. (2005), “Regularization and Variable Selection Via the Elastic Net,” Journal of the Royal Statistical Society, Series B, 67, 301–320.
   Google Scholar
• Zou, H., Hastie, T., and Tibshirani, R. (2007), “On the Degrees of Freedom of the Lasso,” The Annals of Statistics, 35, 2173–2192.
   Web of Science ®Google Scholar
• Zou, H., and Li, R. (2008), “One-Step Sparse Estimates in Nonconcave Penalized Likelihood Models,” The Annals of Statistics, 36, 1509–1533.
   PubMed Web of Science ®Google Scholar