A Generic Path Algorithm for Regularized Statistical Estimation

REFERENCES

• Balabdaoui, F., Rufibach, K., and Wellner, J.A. (2009), “Limit Distribution Theory for Maximum Likelihood Estimation of a Log-Concave Density,” The Annals of Statistics, 37, 1299–1331.
   PubMed Web of Science ®Google Scholar
• Cule, M., Gramacy, R.B., and Samworth, R. (2009), “LogConcDEAD: An R Package for Maximum Likelihood Estimation of a Multivariate Log-Concave Density,” Journal of Statistical Software, 29, 1–20.
   Google Scholar
• Cule, M., Samworth, R., and Stewart, M. (2010), “Maximum Likelihood Estimation of a Multi-Dimensional Log-Concave Density,” Journal of the Royal Statistical Society, Series B, 72, 545–607.
   Google Scholar
• Dempster, A.P. (1969), Elements of Continuous Multivariate Analysis (Addison-Wesley Series in Behavioral Sciences), Reading, MA: Addison-Wesley.
   Google Scholar
• Donoho, D.L., and Johnstone, I.M. (1994), “Ideal Spatial Adaptation by Wavelet Shrinkage,” Biometrika, 81, 425–455.
   Web of Science ®Google Scholar
• Duembgen, L., Rufibach, K., and Huesler, A. (2007), “Active Set and EM Algorithms for Log-Concave Densities Based on Complete and Censored Data,” Technical Report 61, IMSV, University of Bern, Switzerland.
   Google Scholar
• Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), “Least Angle Regression” (with discussion), The Annals of Statistics, 32, 407–499.
   Web of Science ®Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360.
   Web of Science ®Google Scholar
• Fan, J., Maity, A., Wang, Y., and Wu, Y. (2013), “Parametrically Guided Generalized Additive Models With Application to Merger and Acquisition Data,” Journal of Nonparametric Statistics, 25, 109–128.
   PubMed Web of Science ®Google Scholar
• Fraley, C., and Percival, D. (2010), “Model-Averaged ℓ1 Regularization Using Markov Chain Monte Carlo Model Composition,” . Technical Report 541, Department of Statistics, University of Washington, Seattle, WA.
   Google Scholar
• Frank, I.E., and Friedman, J.H. (1993), “A Statistical View of Some Chemometrics Regression Tools,” Technometrics, 35, 109–135.
   Web of Science ®Google Scholar
• Friedman, J. (2008), “Fast Sparse Regression and Classification,” . available at http://www-stat.stanford.edu/jhf/ftp/GPSpaper.pdf.
   Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2000), “Additive Logistic Regression: A Statistical View of Boosting,” The Annals of Statistics, 28, 337–407.
   Web of Science ®Google Scholar
• (2008), Sparse Inverse Covariance Estimation With the Graphical Lasso,” Biostatistics, 9, 432–441.
   PubMed Web of Science ®Google Scholar
• Ghosh, D., and Yuan, Z. (2009), “An Improved Model Averaging Scheme for Logistic Regression,” Journal of Multivariate Analysis, 100, 1670–1681.
   PubMedGoogle Scholar
• Goodnight, J.H. (1979), “A Tutorial on the Sweep Operator,” The American Statistician, 33, 149–158.
   Web of Science ®Google Scholar
• Hastie, T., Rosset, S., Tibshirani, R., and Zhu, J. (2004), “The Entire Regularization Path for the Support Vector Machine,” Journal of Machine Learning Research, 5, 1391–1415.
   Web of Science ®Google Scholar
• Hastie, T., and Tibshirani, R. (1993), “Varying-Coefficient Models” (with discussion), Journal of the Royal Statistical Society, Series B, 55, 757–796.
   Google Scholar
• Jennrich, R. (1977), “Stepwise Regression,” in Statistical Methods for Digital Computers, New York: Wiley-Interscience, pp. 58–75.
   Google Scholar
• Kim, S.-J., Koh, K., Boyd, S., and Gorinevsky, D. (2009), “l1 Trend Filtering,” SIAM Review, 51, 339–360.
   Web of Science ®Google Scholar
• Lange, K. (2010), Numerical Analysis for Statisticians (Statistics and Computing) (2nd ed.), New York: Springer.
   Google Scholar
• Lawson, C.L., and Hanson, R.J. (1987), Solving Least Squares Problems (Classics in Applied Mathematics), Philadelphia, PA: Society for Industrial Mathematics.
   Google Scholar
• Li, Y., Liu, Y., and Zhu, J. (2007), “Quantile Regression in Reproducing Kernel Hilbert Spaces,” Journal of the American Statistical Association, 102, 255–268.
   Web of Science ®Google Scholar
• Little, R. J.A., and Rubin, D.B. (2002), Statistical Analysis With Missing Data (Wiley Series in Probability and Statistics) (2nd ed.), Hoboken, NJ: Wiley-Interscience.
   Google Scholar
• Magnus, J.R., and Neudecker, H. (1999), Matrix Differential Calculus With Applications in Statistics and Econometrics (Wiley Series in Probability and Statistics), Chichester: Wiley.
   Google Scholar
• Mardia, K.V., Kent, J.T., and Bibby, J.M. (1979), Multivariate Analysis (Probability and Mathematical Statistics: A Series of Monographs and Textbooks), London: Academic Press.
   Google Scholar
• McCullagh, P., and Nelder, J.A. (1983), Generalized Linear Models (Monographs on Statistics and Applied Probability), London: Chapman & Hall.
   Google Scholar
• Negahban, S., Ravikumar, P.D., Wainwright, M.J., and Yu, B. (2012), “A Unified Framework for High-Dimensional Analysis of m-Estimators With Decomposable Regularizers,” Statistical Science, 27, 538–557.
   Web of Science ®Google Scholar
• Osborne, M.R., Presnell, B., and Turlach, B.A. (2000), “A New Approach to Variable Selection in Least Squares Problems,” IMA Journal of Numerical Analysis, 20, 389–403.
   Web of Science ®Google Scholar
• Pal, J.K., Woodroofe, M., and Meyer, M. (2007), “Estimating a Polya frequency Function2,” in Complex Datasets and Inverse Problems, volume 54 of IMS Lecture Notes Monograph Series, Beachwood, OH: Institute of Mathematical Statististics, pp. 239–249.
   Google Scholar
• Park, M.Y., and Hastie, T. (2007), “L1-Regularization Path Algorithm for Generalized Linear Models,” Journal of the Royal Statistical Society, Series B, 69, 659–677.
   Google Scholar
• Robertson, T., Wright, F.T., and Dykstra, R.L. (1988), Order Restricted Statistical Inference (Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics), Chichester: Wiley.
   Google Scholar
• Rosset, S., and Zhu, J. (2007), “Piecewise Linear Regularized Solution Paths,” The Annals of Statistics, 35, 1012–1030.
   Web of Science ®Google Scholar
• Rufibach, K. (2010), “An Active Set Algorithm to Estimate Parameters in Generalized Linear Models With Ordered Predictors,” Computational Statistics & Data Analysis, 54, 1442–1456.
   Google Scholar
• Ruszczyński, A. (2006), Nonlinear Optimization, Princeton, NJ: Princeton University Press.
   Google Scholar
• Scholkopf, B., and Smola, A.J. (2001), Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, Cambridge, MA: MIT Press.
   Google Scholar
• Silvapulle, M.J., and Sen, P.K. (2005), Constrained Statistical Inference: Inequality, Order, and Shape Restrictions (Wiley Series in Probability and Statistics), Hoboken, NJ: Wiley-Interscience.
   Google Scholar
• Soetaert, K., Petzoldt, T., and Setzer, R.W. (2010), “Solving Differential Equations in R: Package deSolve,” Journal of Statistical Software, 33, 1–25.
   PubMed Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
   Google Scholar
• Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., and Knight, K. (2005), “Sparsity and Smoothness via the Fused Lasso,” Journal of the Royal Statistical Society, Series B, 67, 91–108.
   Google Scholar
• Tibshirani, R.J., and Taylor, J. (2011), “The Solution Path of the Generalized Lasso,” The Annals of Statistics, 39, 1335–1371.
   Web of Science ®Google Scholar
• Walther, G. (2002), “Detecting the Presence of Mixing With Multiscale Maximum Likelihood,” Journal of the American Statistical Association, 97, 508–513.
   Web of Science ®Google Scholar
• Walther, G. (2009), “Inference and Modeling With Log-Concave Distributions,” Statistical Science, 24, 319–327.
   Google Scholar
• Wu, Y. (2011), “An Ordinary Differential Equation-Based Solution Path Algorithm,” Journal of Nonparametric Statistics, 23, 185–199.
   PubMed Web of Science ®Google Scholar
• Wu, Y. (2012), “Elastic Net for Coxs Proportional Hazards Model With a Solution Path Algorithm,” Statistica Sinica, 22, 271–294.
   Web of Science ®Google Scholar
• Yuan, M. (2008), “Efficient Computation of ℓ1 Regularized Estimates in Gaussian Graphical Models,” Journal of Computational and Graphical Statistics, 17, 809–826.
   Web of Science ®Google Scholar
• Zhou, H., and Lange, K. (2013), “A Path Algorithm for Constrained Estimation,” Journal of Computational and Graphical Statistics, 22, 261–283.
   PubMed Web of Science ®Google Scholar
• Zou, H., Hastie, T., and Tibshirani, R. (2007), “On the ‘Degrees of Freedom’ of the Lasso,” The Annals of Statistics, 35, 2173–2192.
   Web of Science ®Google Scholar