A unified class of penalties with the capability of producing a differentiable alternative to l₁ norm penalty

References

• Abbruzzo, A., I. Vujačić, E. Wit, and A. M. Mineo. 2014. Generalized information criterion for model selection in penalized graphical models.
   Google Scholar
• Abramowitz, M., and I. Stegun. 2012. Handbook of mathematical functions: With formulas, graphs, and mathematical tables. New York: Dover Publications.
   Google Scholar
• Börjesson, P., and C. Sundberg. 1979. Simple approximations of the error function Q(x) for communications applications. IEEE Transactions on Communications 27 (3):639–43. doi:10.1109/TCOM.1979.1094433.
   Web of Science ®Google Scholar
• Chevillard, S. 2012. The functions erf and erfc computed with arbitrary precision and explicit error bounds. Information and Computation 216:72–95. doi:10.1016/j.ic.2011.09.001.
   Web of Science ®Google Scholar
• Cody, W. J. 1990. Performance evaluation of programs for the error and complementary error functions. ACM Transactions on Mathematical Software 16 (1):29–37. doi:10.1145/77626.77628.
   Web of Science ®Google Scholar
• Fan, J., and R. Li. 2001. Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association 96 (456):1348–60. doi:10.1198/016214501753382273.
   Web of Science ®Google Scholar
• Hebiri, M., and S. van de Geer. 2011. The Smooth-Lasso and other l1+ l2 penalized methods. Electronic Journal of Statistics 5 (0):1184–226. doi:10.1214/11-EJS638.
   Google Scholar
• Hoerl, A. E., and R. W. Kennard. 1970. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12 (1):55–67. doi:10.1080/00401706.1970.10488634.
   Web of Science ®Google Scholar
• Knight, K., and W. Fu. 2000. Asymptotics for lasso-type estimators. The Annals of Statistics 28 (5):1356–78. doi:10.1214/aos/1015957397.
   Web of Science ®Google Scholar
• Koenker, R., and G. Bassett. 1978. Regression quantiles. Econometrica 46 (1):33–50. doi:10.2307/1913643.
   Web of Science ®Google Scholar
• Konishi, S., and G. Kitagawa. 1996. Generalised information criteria in model selection. Biometrika 83 (4):875–90. doi:10.1093/biomet/83.4.875.
   Web of Science ®Google Scholar
• Lee, C. 1992. On Laplace continued fraction for the normal integral. Annals of the Institute of Statistical Mathematics 44 (1):107–20. doi:10.1007/BF00048673.
   Web of Science ®Google Scholar
• Nesterov, Y. 2005. Smooth minimization of non-smooth functions. Mathematical Programming 103 (1):127–52. doi:10.1007/s10107-004-0552-5.
   Web of Science ®Google Scholar
• Olver, F. W., D. W. Lozier, R. F. Boisvert, and C. W. Clark. 2010. NIST handbook of mathematical functions. 1st ed. New York, NY, USA: Cambridge University Press.
   Google Scholar
• Press, W., S. Teukolsky, W. Vetterling, and B. Flannery. 1992. Numerical recipes in C: The art of scientific computing. Cambridge: Cambridge University Press.
   Google Scholar
• Ramirez, C., R. Sanchez, V. Kreinovich, and M. Argaez. 2014. x2+m is the most computationally efficient smooth approximation to |x|: A proof. Journal of Uncertain Systems 8:205–10.
   Google Scholar
• Schmidt, M., G. Fung, and R. Rosales. 2007. Fast optimization methods for l1 regularization: A comparative study and two new approaches. In Machine learning: ECML 2007, J. N. Kok, J. Koronacki, R. L. de Mantaras, S. Matwin, D. Mladenič, and A. Skowron ed. 286–297. New York: Springer.
   Google Scholar
• Stamey, T. A., J. N. Kabalin, J. E. McNeal, I. M. Johnstone, F. Freiha, E. A. Redwine, and N. Yang. 1989. Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate. II: Radical prostatectomy treated patients. The Journal of Urology 141 (5):1076–83. doi:10.1016/S0022-5347(17)41175-X.
   PubMed Web of Science ®Google Scholar
• Tibshirani, R. 1996. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological) 58 (1):267–88. doi:10.1111/j.1467-9868.2005.00490.x.
   Web of Science ®Google Scholar
• Tibshirani, R., M. Saunders, S. Rosset, J. Zhu, and K. Knight. 2005. Sparsity and smoothness via the fused lasso. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67 (1):91–108. doi:10.1111/j.1467-9868.2005.00490.x.
   Web of Science ®Google Scholar
• Vazquez-Leal, H., R. Castaneda-Sheissa, U. Filobello-Nino, A. Sarmiento-Reyes, and J. Orea. 2012. High accurate simple approximation of normal distribution integral. Mathematical Problems in Engineering. doi:10.1155/2012/124029.
   Web of Science ®Google Scholar
• Yuan, M., and Y. Lin. 2006. Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 68 (1):49–67. doi:10.1111/j.1467-9868.2005.00532.x.
   Web of Science ®Google Scholar
• Zou, H., and T. Hastie. 2005. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67 (2):301–20. doi:10.1111/j.1467-9868.2005.00503.x.
   Web of Science ®Google Scholar