Publication Cover
Statistics
A Journal of Theoretical and Applied Statistics
Volume 57, 2023 - Issue 5
118
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Penalized wavelet nonparametric univariate logistic regression for irregular spaced data

, , &
Pages 1037-1060 | Received 21 Mar 2022, Accepted 28 Jul 2023, Published online: 29 Aug 2023

References

  • Antoniadis A, Gijbels I, Nikolova M. Penalized likelihood regression for generalized linear models with non-quadratic penalties. Ann Inst Stat Math. 2011;63(3):585–615. doi: 10.1007/s10463-009-0242-4
  • Amato U, Antoniadis A, De Feis I, et al. Penalized wavelet estimation and robust denoising for irregular spaced data. Comput Stat. 2022;37:1621–1651. doi: 10.1007/s00180-021-01174-4
  • McCullagh P, Nelder J. Generalized linear models. London: Chapman and Hall; 1989.
  • Eubank R. Nonparametric regression and spline smoothing. 2nd ed. New York: CRC Press; 1999. doi: 10.1201/9781482273144
  • Fan J, Gijbels I. Data-driven bandwidth selection in local polynomial fitting: variable bandwidth and spatial adaptation. J Roy Statist Soc Ser B. 1995;57(2):371–394.
  • Fan J, Farmen M, Gijbels I. Local maximum likelihood estimation and inference. J R Stat Soc Ser B. 1998;60:591–608. doi: 10.1111/1467-9868.00142
  • Green P, Silverman B. Nonparametric regression and generalized linear models. London: Chapman and Hall/CRC; 1993. doi: 10.1201/b15710
  • Härdle W. Applied nonparametric regression. Cambridge: Cambridge University Press; 1990. doi: 10.1017/ccol0521382483
  • Antoniadis A. Wavelet methods in statistics: some recent developments and their applications. Stat Surv. 2007;1:16–55. doi: 10.1214/07-ss014
  • Zhao P, Yu B. On model selection consistency of lasso. J Mach Learn Res. 2006;7(90):2541–2567. http://jmlr.org/papers/v7/zhao06a.html
  • Candes EJ, Tao T. Decoding by linear programming. IEEE Trans Inf Theory. 2005;51(12):4203–4215. doi: 10.1109/TIT.2005.858979
  • Zhang CH, Huang J. The sparsity and bias of the lasso selection in high-dimensional linear regression. Ann Stat. 2008;4:1567–1594.
  • Amato U, Antoniadis A, De Feis I, et al. Penalised robust estimators for sparse and high-dimensional linear models. Stat Methods Appl. 2021;30(1):1–48. doi: 10.1007/s10260-020-00511-z
  • Amato U, Antoniadis A, Pensky M. Wavelet kernel penalized estimation for non-equispaced design regression. Stat Comput. 2006;16(1):37–55. doi: 10.1007/s11222-006-5283-4
  • Donoho D, Johnstone I, Kerkyacharian G, et al. Wavelet shrinkage: asymptopia? J R Stat Soc Ser B Methodol. 1995;57(2):301–337. doi: 10.1111/j.2517-6161.1995.tb02032.x
  • Mallat S. A wavelet tour of signal processing. Paris: Elsevier; 2009. doi: 10.1016/b978-0-12-374370-1.x0001-8
  • Antoniadis A, Fan J. Regularization of wavelet approximations. J Am Stat Assoc. 2001;96(455):939–967. doi: 10.1198/016214501753208942
  • Wand M, Ormerod J. Penalized wavelets: embedding wavelets into semiparametric regression. Electron J Stat. 2011;5:1654–1717. doi: 10.1214/11-ejs652
  • Zhang T. Analysis of multi-stage convex relaxation for sparse regularization. J Mach Learn Res. 2010;11:1081–1107. https://jmlr.csail.mit.edu/papers/volume11/zhang10a/zhang10a.pdf
  • Loh P, Wainwright M. Regularized M-estimators with nonconvexity: statistical and algorithmic theory for local optima. J Mach Learn Res. 2015;16:559–616. https://www.jmlr.org/papers/volume16/loh15a/loh15a.pdf.
  • She Y. An iterative algorithm for fitting nonconvex penalized generalized linear models with grouped predictors. Comput Stat Data Anal. 2012;56(10):2976–2990. doi: 10.1016/j.csda.2011.11.013
  • Gong P, Zhang C, Lu Z, et al. A general iterative shrinkage and thresholding algorithm for non-convex regularized optimization problems. In: Dasgupta S, McAllester D editors. Proceedings of the 30th International Conference on Machine Learning, Proceedings of Machine Learning Research Vol 28. Atlanta, Georgia, USA: PMLR; 2013. p. 37–45.
  • Wang Z, Liu H, Zhang T. Optimal computational and statistical rates of convergence for sparse nonconvex learning problems. Ann Stat. 2014;42(6):2164–2201. doi: 10.1214/14-AOS1238http://www.jstor.org/stable/43556491.
  • Loh P. Statistical consistency and asymptotic normality for high-dimensional robust M-estimators. Ann Stat. 2017;45(2):866–896. doi: 10.1214/16-AOS1471
  • Bach F, Jenatton R, Mairal J, et al. Optimization with sparsity-inducing penalties. Found Trends Mach Learn. 2012;4(1):1–106. doi: 10.1561/2200000015
  • Nesterov Y. Gradient methods for minimizing composite functions. Math Program Ser B. 2013;140:125–161. doi: 10.1007/s10107-012-0629-5
  • Antoniadis A, Leblanc F. Nonparametric wavelet regression for binary response. Statistics. 2000;34(3):183–213. doi: 10.1080/02331880008802713
  • Loh PL, Wainwright MJ. Support recovery without incoherence: a case for nonconvex regularization. Ann Stat. 2017;45(6):2455–2482. doi: 10.1214/16-AOS1530
  • Cai T. Adaptive wavelet estimation: A block thresholding and oracle inequality approach. Ann Stat. 1999;27(3):898–924. doi:10.1214/aos/1018031262
  • Hall P, Kerkyacharian G, Picard D. On the minimax optimality of block thresholded wavelet estimators. Stat Sin. 1999;9:33–50.
  • Negahban SN, Ravikumar P, Wainwright MJ, et al. A unified framework for high-dimensional analysis of M-estimators with decomposable regularizers. Stat Sci. 2012;27(4):538–557. doi: 10.1214/12-STS400
  • Autin F. On the performances of a new thresholding procedure using tree structure. Electron J Stat. 2008;2:412–431. doi: 10.1214/08-EJS205
  • Brutti P. Warped wavelet and vertical thresholding. arXiv preprint 0801.3319. 2008.
  • Chesneau C. Wavelet block thresholding for samples with random design: a minimax approach under the lp risk. Electron J Stat. 2007;1:331-–346. doi: 10.1214/07-EJS067
  • Donoho D, Johnstone I. Adapting to unknown smoothness via wavelet shrinkage. J Am Stat Assoc. 1995;90(432):1200–1224. doi: 10.1080/01621459.1995.10476626
  • Eilers P, Marx B. Flexible smoothing with B-splines and penalties. Stat Sci. 1996;11(2):89–121. doi: 10.1214/ss/1038425655
  • Ruppert D, Wand MP, Carroll RJ. Semiparametric regression. Cambridge University Press; 2003. (Cambridge series in statistical and probabilistic mathematics).
  • Mallows CL. Some comments on cp. Technometrics. 1973;15(4):661–675. doi: 10.2307/1267380
  • Li KC. Asymptotic optimality for Cp,CL, cross-validation and generalized cross-validation: discrete index set. Ann Stat. 1987;15(3):958–975. doi: 10.1214/aos/1176350486
  • Ferraty F, Vieu P. Curves discrimination: a nonparametric functional approach. Comp Stat Data Anal. 2003;44(1-2):161–173. doi: 10.1016/S0167-9473(03)00032-X
  • James GM, Hastie TJ. Functional linear discriminant analysis for irregularly sampled curves. J R Stat Soc Ser B. 2001;63(3):533–550. doi: 10.1111/1467-9868.00297

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.