Out-of-Bag Estimation of the Optimal Hyperparameter in SubBag Ensemble Method

References

• Amalral , G. J. A. , Ferreira , M. R. P. ( 2009 ). New bootstrap applications in supervised learning . Communications in Statistics – Simulation and Computation 38 ( 2 ): 416 – 425 .
   Web of Science ®Google Scholar
• Asuncion , A. , Newman , D. ( 2007 ). UCI Machine Learning Repository. http:\\www.ics. uci.edu\ ~mlearn\MLRepository.html. Irvine , CA : University of California, School of Information and Computer Science .
   Google Scholar
• Bernard , S. , Heutte , L. , Adam , S. (2009). Influence of hyperparameters on random forest accuracy. In: Benediktsson , J. A. , Kittler , J. , Roli , F. , eds., Multiple Classifier Systems . Berlin : Springer, pp. 171–180.
   Google Scholar
• Breiman , L. ( 1996a ). Bagging predictors . Machine Learning 24 ( 2 ): 123 – 140 .
   Web of Science ®Google Scholar
• Breiman , L. ( 1996b ). Out-of-bag estimation. Tech. Report, Statistics Department, University of California, Berkely, California .
   Google Scholar
• Breiman , L. ( 2001 ). Random forests . Machine Learning 45 ( 1 ): 5 – 32 .
   Web of Science ®Google Scholar
• Breiman , L. , Friedman , J. , Olshen , R. , Stone , C. ( 1984 ). Classification and Regression Trees . New York : Chapman & Hall, CRC Press .
   Google Scholar
• Bylander , T. ( 2002 ). Estimating generalization error on two-class datasets using out-of-bag estimates . Machine Learning 48 ( 1 ): 287 – 297 .
   Web of Science ®Google Scholar
• Croux , C. , Joossens , K. , Lemmens , A. ( 2007 ). Trimmed bagging . Computational Statistics & Data Analysis 52 ( 1 ): 362 – 368 .
   Web of Science ®Google Scholar
• Dettling , M. ( 2004 ). Bagboosting for tumor classification with gene expression data . Bioinformatics 20 ( 18 ): 3583 – 3593 .
   PubMed Web of Science ®Google Scholar
• Efron , B. , Tibshirani , R. ( 1993 ). An Introduction to the Bootstrap . London : Chapman & Hall/CRC .
   Google Scholar
• Hernández-Lobato , D. , Martínez-Muñoz , G. , Suárez , A. ( 2007 ). Out of bootstrap estimation of generalization error curves in bagging ensembles . In: Yin , H.-J. , Tino , P. , Corchado , E. , Byrne , W. , Yao , X. , eds., Intelligent Data Engineering and Automated Learning – IDEAL . Berlin : Springer , pp. 47 – 56 .
   Google Scholar
• Ho , T. K. ( 1998 ). The random subspace method for constructing decision forests . IEEE Transactions on Pattern Analysis and Machine Intelligence 20 ( 8 ): 832 – 844 .
   Web of Science ®Google Scholar
• Hothorn , T. , Lausen , B. ( 2003 ). Double-bagging: combining classifiers by bootstrap aggregation . Pattern Recognition 36 ( 6 ): 1303 – 1309 .
   Web of Science ®Google Scholar
• Hothorn , T. , Lausen , B. ( 2005 ). Bundling classifiers by bagging trees . Computational Statistics & Data Analysis 49 ( 4 ): 1068 – 1078 .
   Web of Science ®Google Scholar
• Kuncheva , L. I. ( 2004 ). Combining Pattern Classifiers: Methods and Algorithms. Wiley-Interscience .
   Google Scholar
• Lawrence , R. , Bunn , A. , Powell , S. , Zambon , M. ( 2004 ). Classification of remotely sensed imagery using stochastic gradient boosting as a refinement of classification tree analysis . Remote Sensing of Environment 90 ( 3 ): 331 – 336 .
   Web of Science ®Google Scholar
• Martínez-Muñoz , G. , Suárez , A. ( 2010 ). Out-of-bag estimation of the optimal sample size in bagging . Pattern Recognition 43 ( 1 ): 143 – 152 .
   Web of Science ®Google Scholar
• Panov , P. , Džeroski , S. ( 2007 ). Combining bagging and random subspaces to create better ensembles . In: Berthold , M. R. , Shawe-Taylor , J. , Lavrač , N. , eds., Advances in Intelligent Data Analysis VII . Berlin : Springer , pp. 118 – 129 .
   Google Scholar
• Polikar , R. ( 2006 ). Ensemble based systems in decision making . IEEE Circuits and Systems Magazine 6 ( 3 ): 21 – 45 .
   Google Scholar
• Polikar , R. , Topalis , A. , Parikh , D. , Green , D. , Frymiare , J. , Kounios , J. , Clark , C. M. ( 2008 ). An ensemble based data fusion approach for early diagnosis of alzheimer's disease . Information Fusion 9 ( 1 ): 83 – 95 .
   Web of Science ®Google Scholar
• Rao , S. , Tibshirani , R. ( 1996 ). The out-of-bootstrap method for model averaging and selection. Techinical Report, University of Toronto, Toronto, Canada .
   Google Scholar
• Rokach , L. ( 2009 ). Taxonomy for characterizing ensemble methods in classification tasks: a review and annotated bibliography . Computational Statistics & Data Analysis 53 ( 12 ): 4046 – 4072 .
   Web of Science ®Google Scholar
• Tibshirani , R. ( 1996 ). Bias, variance and prediction error for classification rules. Technical Report, Department of Preventive Medicine and Biostatistics, Department of Statistics, University of Toronto, Canada .
   Google Scholar
• Webb , G. I. ( 2000 ). Multiboosting: a technique for combining boosting and wagging . Machine Learning 40 ( 2 ): 159 – 196 .
   Web of Science ®Google Scholar
• Wolpert , D. H. , Macready , W. G. (1996). Combining stacking with bagging to improve a learning algorithm. Technical Report, Santa Fe Institute, Santa Fe, New Mexico.
   Google Scholar
• Wolpert , D. H. , Macready , W. G. ( 1999 ). An efficient method to estimate bagging's generalization error . Machine Learning 35 ( 1 ): 41 – 55 .
   Web of Science ®Google Scholar
• Zhang , C. X. , Zhang , J. S. ( 2009 ). A novel method for constructing ensemble classifiers . Statistics and Computing 19 ( 3 ): 317 – 327 .
   Web of Science ®Google Scholar
• Zhang , C. X. , Zhang , J. S. , Zhang , G. Y. ( 2009 ). Using boosting to prune double-bagging ensembles . Computational Statistics & Data Analysis 53 ( 4 ): 1218 – 1231 .
   Web of Science ®Google Scholar