408
Views
4
CrossRef citations to date
0
Altmetric
Articles

Optimal determination of the parameters of some biased estimators using genetic algorithm

ORCID Icon, ORCID Icon & ORCID Icon
Pages 3331-3353 | Received 27 May 2019, Accepted 02 Sep 2019, Published online: 19 Sep 2019

References

  • Hoerl E, Kennard RW. Ridge regression: biased estimation for nonorthogonal problems. Technometrics. 1970;12(1):55–67. doi: 10.1080/00401706.1970.10488634
  • Swindel BF. Good ridge estimators based on prior information. Commun Statist Theor Meth. 1976;A5:1065–1075. doi: 10.1080/03610927608827423
  • Belsley AD, Kuh E, Welsch RE. Regression diagnostics: identifying influential data and sources of collinearity. New York: Wiley; 1980.
  • Myers RH. Classical and modern regression with applications. 2nd ed. Boston: PWS-Kent Publishing Company; 1990.
  • Montgomery DC, Peck EA, Vining GG. Introduction to linear regression analysis. 3rd ed. New York: Wiley; 2001.
  • Liu K. A new class of biased estimate in linear regression. Commun Stat Theory Methods. 1993;22(2):393–402. doi: 10.1080/03610929308831034
  • Akdeniz F, Kaçıranlar S. On the almost unbiased generalized Liu estimator and Unbiased estimation of the Bias and MSE. Commun Stat - Theory Methods. 1995;24(7):1789–1797. doi: 10.1080/03610929508831585
  • Özkale MR, Kaçıranlar S. The restricted and unrestricted two parameter estimators. Comm Statist Theory Methods. 2007;36(15):2707–2725. doi: 10.1080/03610920701386877
  • Hoerl E, Kennard RW, Baldwin KF. Ridge regression: some simulations. Commun Stat. 1975;4(2):105–123. doi: 10.1080/03610927508827232
  • McDonald GC, Galarneau DI. A monte carlo evaluation of some ridge-type estimators. J Amer Statist Assoc. 1975;70:407–416. doi: 10.1080/01621459.1975.10479882
  • Hoerl AE, Kennard RW. Ridge regression: iterative estimation of the biasing parameter. Commun Stat. 1976;A5:77–88. doi: 10.1080/03610927608827333
  • Lawless JF, Wang P. A simulation study of ridge and other regression estimators. Commun Stat - Theory Methods. 1976;5(4):307–323. doi: 10.1080/03610927608827353
  • Hocking RR. The analysis and selection of variables in linear regression. Biometrics. 1976;32:1–50. doi: 10.2307/2529336
  • Dempster AP, Schatzoff M, Wermuth N. A simulation study of alternatives to ordinary least squares. J Am Stat Assoc. 1977;72:77–91. doi: 10.1080/01621459.1977.10479910
  • Wichern D, Churchill G. A comparison of ridge estimators. Technometrics. 1978;20(3):301–311. doi: 10.1080/00401706.1978.10489675
  • Gibbons DG. A simulation study of some ridge estimators. J Am Stat Assoc. 1981;76:131–139. doi: 10.1080/01621459.1981.10477619
  • Nordberg L. A procedure for determination of a good ridge parameter in linear regression. Commun Stat - Simulation Comput. 1982;11(3):285–309. doi: 10.1080/03610918208812264
  • Barbosa HJC, Lavor C, Raupp FM. A GA-simplex hybrid algorithm for global minimization of molecular potential energy function. Ann Oper Res. 2005;138:189–202. doi: 10.1007/s10479-005-2453-2
  • Praga-Alejo RJ, Torres-Treviño LM, Piña-Monarrez MR. Optimal determination of K constant of ridge regression using a simple genetic algorithm. In: Electronics, Robotics and Automotive Mechanics Conference CREMA’08; IEEE Computer Society, Cuernavaca, Morelos, México; 2008.
  • Bansal JC, Deep SK, Katiyar VK. Minimization of molecular potential energy function using particle swarm optimization. Int J Appl Math Mech. 2010;6(9):1–9.
  • Al-Hassan YM. Performance a new ridge regression estimator. J Asso Arab Univ Basic Appl Sci. 2010;9:23–26.
  • Hedar A, Ali AF, Hassan T. Genetic algorithm and tabu search based methods for molecular 3D-structure prediction. Numer Algebra. 2011;1(1):191–209.
  • Ahn JJ, Byun HW, Oh KJ, et al. Using ridge regression with genetic algorithm to enhance real estate appraisal forecasting. Expert Syst Appl. 2012;39:8369–8379. doi: 10.1016/j.eswa.2012.01.183
  • Demirci MA. Ridge Regresyonda Sapma Parametresi k’nın Elde Edilmesinde Genetik Algoritma Yaklaşımı [Graduate Thesis]. 19 Mayıs University; 2014.
  • Uslu VR, Eğrioğlu E, Baş E. Find optimal value for the Shrinkage parameter in Ridge regression via particle Swarm optimization. Am J Intell Syst. 2014;4(4):142–147.
  • Wong KY, Chiu SN. An iterative approach to minimize the mean squared error in ridge regression. Comput Stat. 2015;30:625–639. doi: 10.1007/s00180-015-0557-y
  • Holland JH. Adaptation in natural and artificial systems. Ann Arbor: University of Michigan Press; 1975.
  • Coello CAC. Use of a self-adaptive penalty approach for engineering optimization problems. Comput Ind. 2000;41:113–127. doi: 10.1016/S0166-3615(99)00046-9
  • Coello CAC, Montes EM. Constraint-handling in genetic algorithms through the use of dominance-based tournament selection. Adv Eng Inf. 2002;16:193–203. doi: 10.1016/S1474-0346(02)00011-3
  • Tsai J. Global optimization of nonlinear fractional programming problems in engineering design. Eng Optim. 2005;37(4):399–409. doi: 10.1080/03052150500066737
  • Dimopoulos GG. Mixed-variable engineering optimization based on evolutionary and social metaphors. Comput Methods Appl Mech Eng. 2007;196(4–6):803–817. doi: 10.1016/j.cma.2006.06.010
  • Montes EM, Coello CAC, Reyes JV, et al. Multiple trial vectors in differential evolution for engineering design. Eng Optim. 2007;39(5):567–589. doi: 10.1080/03052150701364022
  • Hefnawy AE, Farag A. A Combined nonlinear programming model and Kibria method for choosing ridge parameter regression. Commun Stat Simulation Comput. 2014;43(6):1442–1470. doi: 10.1080/03610918.2012.735317
  • Longley JW. An appraisal of least squares programs from the point of view of the user. J Am Stat Assoc. 1967;62:819–841. doi: 10.1080/01621459.1967.10500896
  • Marquardt D. Generalized inverses, ridge regression, biased linear estimation, and nonlinear estimation. Technometrics. 1970;12(3):591–612. doi: 10.2307/1267205
  • Liu K. Using Liu-type estimator to combat collinearity. Commun Stat Theory Methods. 2003;32:1009–1020. doi: 10.1081/STA-120019959
  • Mayer LS, Wilke TA. On biased estimation in linear models. Technometrics. 1973;15(3):497–508. doi: 10.1080/00401706.1973.10489076
  • Gruber MHJ. Liu and ridge estimators-a comparison. Commun Statist - Theory Methods. 2012;41(20):3739–3749. doi: 10.1080/03610926.2011.563018
  • Özkale MR. Influence measures in affine combination type regression. J Statist Comput Simul. 2013;40(10):2219–2243.
  • Özkale MR. The relative efficiency of the restricted estimators in linear regression models. J Appl Stat. 2014;41(5):998–1027. doi: 10.1080/02664763.2013.859234
  • Huang J, Yang H. A two-parameter estimator in the negative binomial regression model. J Statist Comput Simul. 2014;84(1):124–134. doi: 10.1080/00949655.2012.696648
  • Özbay N, Kaçıranlar S. The Almon two parameter estimator for the distributed lag models. J Statist Comput Simul. 2017;87(4):834–843. doi: 10.1080/00949655.2016.1229317
  • Özbay N, Kaçıranlar S. Estimation in a linear regression model with stochastic linear restrictions: a new two parameter weighted mixed estimator. J Statist Comput Simul. 2018;88(9):1669–1683. doi: 10.1080/00949655.2018.1442836
  • Özbay N, Toker S. Multicollinearity in simultaneous equations system: evaluation of estimation performance of two-parameter estimator. Comput Appl Math. 2018;37(4):5334–5357. doi: 10.1007/s40314-018-0628-0
  • Chatfield C. Time-series forecasting. New York: Chapman and Hall; 2000.
  • Scrucca L. GA: a package for genetic algorithms in R. J Stat Softw. 2013;53(4):1–37. doi: 10.18637/jss.v053.i04
  • Kibria BMG. Performance of some new ridge regression estimators. Comm Statist Simulation Comput. 2003;32(2):419–435. doi: 10.1081/SAC-120017499

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.