Pruning optimum-path forest ensembles using metaheuristic optimization for land-cover classification

References

• Abe, B., A. Gidudu, and T. Marwal. 2010. “Investigating the Effects of Ensemble Classification on Remotely Sensed Data for Land Cover Mapping.” In Geoscience and Remote Sensing Symposium (IGARSS), 2010 IEEE International, 2832–2835.
   Google Scholar
• Al-Ani, A., and M. Deriche. 2002. “A New Technique for Combining Multiple Classifiers Using the Dempster-Shafer Theory of Evidence.” Journal of Artificial Intelligence Research 17 (1): 333–361.
   Google Scholar
• Allène, C., J.-Y. Audibert, M. Couprie, and R. Keriven. 2010. “Some Links between Extremum Spanning Forests, Watersheds and Min-Cuts.” Image and Vision Computing 28 (10): 1460–1471. doi:10.1016/j.imavis.2009.06.017.
   Web of Science ®Google Scholar
• Andrews, D. F. 1972. “Plots of High-Dimensional Data.” Biometrics 28: 1. doi:10.2307/2528964.
   Web of Science ®Google Scholar
• Bauer, E., and R. Kohavi. 1999. “An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants.” Machine Learning 36 (1–2): 105–139. doi:10.1023/A:1007515423169.
   Web of Science ®Google Scholar
• Breiman, L. 1996. “Bagging Predictors.” Machine Learning 24 (2): 123–140. doi:10.1007/BF00058655.
   Web of Science ®Google Scholar
• Breiman, L. 1998. “Arcing Classifiers.” Annals of Statistics 26 (3): 801–824.
   Web of Science ®Google Scholar
• Caruana, R., and A. Niculescu-Mizil. 2006. “An Empirical Comparison of Supervised Learning Algorithms.” In Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, Pennsylvania, USA. ICML ’06, 161–168. New York, NY: ACM.
   Google Scholar
• Chandrashekar, G., and F. Sahin. 2014. A Survey on Feature Selection Methods. Computers & Electrical Engineering 40 (1): 16–28. 40th-year commemorative issue. doi:10.1016/j.compeleceng.2013.11.024.
   Web of Science ®Google Scholar
• Chang, C.-C., and C.-J. Lin. 2016. “LIBSVM Data: Classification, Regression, and Multi-Label.” Accessed 29 June. https://www.csie.ntu.edu.tw/cjlin/libsvmtools/datasets/.
   Google Scholar
• Coletta, L. F. S., E. R. Hruschka, A. Acharya, and J. Ghosh. 2015. “Using Metaheuristics to Optimize the Combination of Classifier and Cluster Ensembles.” Integrated Computer-Aided Engineering 22 (3): 229–242. doi:10.3233/ICA-150485.
   Web of Science ®Google Scholar
• Diao, R., and Q. Shen. 2011. “Fuzzy-Rough Classifier Ensemble Selection.” IEEE International Conference on Fuzzy Systems 1516–1522.
   Google Scholar
• Dietterich, T. 2000. “Ensemble Methods in Machine Learning.” In Multiple Classifier Systems, Vol. 1857 of Lecture Notes in Computer Science, edited by Josef Kittler and Fabio Roli, 1–15. London, UK: Springer-Verlag.
   Google Scholar
• Geem, Z. W. 2009. Music-Inspired Harmony Search Algorithm: Theory and Applications. 1st ed. Berlin Heidelberg: Springer-Verlag.
   Google Scholar
• Ho, T. K. 1998. “The Random Subspace Method for Constructing Decision Forests.” IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (8): 832–844. doi:10.1109/34.709601.
   Web of Science ®Google Scholar
• Jia, L., Y. Wang, and L. Fan. 2014. “Multiobjective Bilevel Optimization for Production-Distribution Planning Problems Using Hybrid Genetic Algorithm.” Integrated Computer-Aided Engineering 21 (1): 77–90.
   Web of Science ®Google Scholar
• Jodavi, M., M. Abadi, and E. Parhizkar. 2015. “JSObfusDetector: A Binary PSO-based One-Class Classifier Ensemble to Detect Obfuscated JavaScript Code.” International Symposium on Artificial Intelligence and Signal Processing 21: 322–327.
   Google Scholar
• Joly, M. M., T. Verstraete, and G. Paniagua. 2014. “Integrated Multifidelity, Multidisciplinary Evolutionary Design Optimization of Counterrotating Compressors.” Integrative Computer-Aided Engineering 21 (3): 249–261.
   Web of Science ®Google Scholar
• Kennedy, J., and R. C. Eberhart. 2001. Swarm Intelligence. M. Kaufman.
   Google Scholar
• Koziol, J. A., and W. Hacke. 1991. “A Bivariate Version of Andrews Plots.” IEEE Transactions on Biomedical Engineering 38 (12): 1271–1274. doi:10.1109/10.137294.
   PubMed Web of Science ®Google Scholar
• Krawczyk, B. 2015. “One-Class Classifier Ensemble Pruning and Weighting with Firefly Algorithm.” Neurocomputing 150 (Part B): 490–500. doi:10.1016/j.neucom.2014.07.068.
   Web of Science ®Google Scholar
• Kuncheva, L. I. 2002. “A Theoretical Study on Six Classifier Fusion Strategies.” IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (2): 281–286. doi:10.1109/34.982906.
   Web of Science ®Google Scholar
• Kuncheva, L. I. 2004. Combining Pattern Classifiers: Methods and Algorithms. New Jersey: Wiley-Interscience.
   Google Scholar
• Kuncheva, L. I., M. Skurichina, and R. P. W. Duin. 2002. “An Experimental Study on Diversity for Bagging and Boosting with Linear Classifiers.” Information Fusion 3 (4): 245–258. doi:10.1016/S1566-2535(02)00093-3.
   Google Scholar
• Langdon, W. B., S. J. Barrett, and B. F. Buxton. 2002. “Combining Decision Trees and Neural Networks for Drug Discovery.” In Genetic Programming, Vol. 2278 of Lecture Notes in Computer Science, edited by J. A. Foster, E. Lutton, J. Miller, C. Ryan, and A. Tettamanzi, 60–70. Germany: Springer Berlin Heidelberg.
   Google Scholar
• Larkins, R., and M. Mayo. 2008. “Adaptive Feature Thresholding for Off-Line Signature Verification.” In Image and Vision Computing New Zealand, 2008. IVCNZ 2008. 23rd International Conference, 1–6. Piscataway, NJ: IEEE.
   Google Scholar
• Lee, B., S. Choi, B. Oh, J. Yang, and S. Park. 2013. “A New Ensemble Learning Algorithm Using Regional Classifiers.” International Journal on Artificial Intelligence Tools 22 (04): 1350025. doi:10.1142/S0218213013500255.
   Web of Science ®Google Scholar
• Lee, D.-S., and S. N. Srihari. 1995. “A Theory of Classifier Combination: The Neural Network Approach.” Proceedings of the Third International Conference on Document Analysis and Recognition 1: 42–45.
   Google Scholar
• Li, B., Q. Lin, Q.-H. M. Max, and Y. Fan. 2009. “Using Ensemble Classifier for Small Bowel Ulcer Detection in Wireless Capsule Endoscopy Images.” IEEE International Conference on Robotics and Biomimetics 2326–2331.
   Google Scholar
• Li, C.-F., and J.-Y. Yin. 2013. Variational Bayesian Independent Component Analysis-Support Vector Machine for Remote Sensing Classification. Computers & Electrical Engineering 39 (3): 717–726. Special issue on Image and Video ProcessingSpecial issue on Recent Trends in Communications and Signal Processing. doi:10.1016/j.compeleceng.2012.10.004.
   Web of Science ®Google Scholar
• Lichman, M. 2013. “UCI Machine Learning Repository.” Accessed 21 April.  http://archive.ics.uci.edu/ml.
   Google Scholar
• Macas, M., B. Gabrys, D. Ruta, and L. Lhotska. 2007. “Particle Swarm Optimization of Multiple Classifier Systems.” In Computational and Ambient Intelligence, Vol. 4507 of Lecture Notes in Computer Science, edited by F. Sandoval, A. Prieto, J. Cabestany, and G. Manuel, 333–340. Berlin, Heidelberg: Springer Berlin Heidelberg.
   Google Scholar
• Mao, S., L. C. Jiao, L. Xiong, and S. Gou. 2011. “Greedy Optimization Classifiers Ensemble Based on Diversity.” Pattern Recognition 44 (6): 1245–1261. doi:10.1016/j.patcog.2010.11.007.
   Web of Science ®Google Scholar
• Markatopoulou, F., G. Tsoumakas, and I. Vlahavas. 2010. “Instance-Based Ensemble Pruning via Multi-Label Classification.” 22nd IEEE International Conference on Tools with Artificial Intelligence 1: 401–408.
   Google Scholar
• Martínez-Muñoz, G., D. Hernández-Lobato, and A. Suárez. 2009. “An Analysis of Ensemble Pruning Techniques Based on Ordered Aggregation.” IEEE Tpami 31 (2): 245–259. doi:10.1109/TPAMI.2008.78.
   Web of Science ®Google Scholar
• Mendoza, L. F., M. Vellasco, and K. Figueiredo. 2014. “Intelligent Multiagent Coordination Based on Reinforcement Hierarchical Neuro-Fuzzy Models.” International Journal of Neural Systems 24 (08): 1450031. doi:10.1142/S0129065714500312.
   PubMed Web of Science ®Google Scholar
• Nabavi-Kerizi, S. H., M. Abadi, and E. Kabir. 2010. “A PSO-based Weighting Method for Linear Combination of Neural Networks.” Computers & Electrical Engineering 36 (5): 886–894. doi:10.1016/j.compeleceng.2008.04.006.
   Web of Science ®Google Scholar
• Nemenyi, P. 1963. Distribution-Free Multiple Comparisons. Princeton University.
   Google Scholar
• Osaku, D., R. Y. M. Nakamura, L. A. M. Pereira, R. J. Pisani, A. L. M. Levada, F. A. M. Cappabianco, A. X. Falcão, and J. P. Papa. 2015. “Improving Land Cover Classification through Contextual-Based Optimum-Path Forest.” Information Sciences 324: 60–87. doi:10.1016/j.ins.2015.06.020.
   Web of Science ®Google Scholar
• Osaku, D., D. R. Pereira, A. L. M. Levada, and J. P. Papa. 2016. “Fine-Tuning Contextual-Based Optimum-Path Forest for Land-Cover Classification.” IEEE Geoscience and Remote Sensing Letters 13 (5): 735–739. doi:10.1109/LGRS.2016.2541458.
   Web of Science ®Google Scholar
• Papa, J. P., S. E. N. Fernandes, and A. X. Falcão. 2016. “Optimum-Path Forest Based on K-Connectivity: Theory and Applications.” Pattern Recognition Letters 86: 117–126.
   Google Scholar
• Papa, J. P., and A. X. Falcão. 2008. “A New Variant of the Optimum-Path Forest Classifier.” In Proceedings of the 4th International Symposium on Advances in Visual Computing, Lecture Notes in Computer Science, 935–944. Springer Berlin Heidelberg.
   Google Scholar
• Papa, J. P., A. X. Falcão, V. H. C. Albuquerque, and J. M. R. S. Tavares. 2012. “Efficient Supervised Optimum-Path Forest Classification for Large Datasets.” Pattern Recognition 45 (1): 512–520. doi:10.1016/j.patcog.2011.07.013.
   Web of Science ®Google Scholar
• Papa, J. P., A. X. Falcão, and C. T. N. Suzuki. 2009. “Supervised Pattern Classification Based on Optimum-Path Forest.” International Journal of Imaging Systems and Technology 19 (2): 120–131. doi:10.1002/ima.v19:2.
   Web of Science ®Google Scholar
• Papa, J. P., G. H. Rosa, D. Rodrigues, and X.-S. Yang. 2017. “LibOPT: An Open-Source Platform for Fast Prototyping Soft Optimization Techniques.” ArXiv e-prints.
   Google Scholar
• Papa, J. P., C. T. N. Suzuki, and A. X. Falcão. 2009. “LibOPF: A Library for the Design of Optimum-Path Forest Classifiers.” Accessed 21 April. https://github.com/jppbsi/LibOPF.
   Google Scholar
• Pisani, R. J. 2016. “Remote Sensing Datasets.” Accessed 21 April. http://wwwp.fc.unesp.br/papa/recogna/remote_sensing.html.
   Google Scholar
• Pisani, R. J., R. Y. M. Nakamura, P. S. Riedel, C. R. L. Zimback, A. X. Falcão, and J. P. Papa. 2014. “Toward Satellite-Based Land Cover Classification Through Optimum-Path Forest.” IEEE Transactions on Geoscience and Remote Sensing 52 (10): 6075–6085. doi:10.1109/TGRS.2013.2294762.
   Web of Science ®Google Scholar
• Ponti, M. P., and J. P. Papa. 2011. “Improving Accuracy and Speed of Optimum-Path Forest Classifier Using Combination of Disjoint Training Subsets.” In Multiple Classifier Systems, Vol. 6713 of Lecture Notes in Computer Science, edited by Sansone C., J. Kittler and F. Roli, 237–248.
   Google Scholar
• Ponti, M. P., J. P. Papa, and A. L. M. Levada. 2011. “A Markov Random Field Model for Combining Optimum-Path Forest Classifiers Using Decision Graphs and Game Strategy Approach.” In Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, Vol. 7042 of Lecture Notes in Computer Science, edited by San Martin C. and S. W. Kim, 581–590.
   Google Scholar
• Quinlan, J. R. 1996. “Bagging, Boosting, and C4.S.” In Proceedings of the Thirteenth National Conference on Artificial Intelligence - Volume 1, 725–730. Portland, Oregon: AAAI Press.
   Google Scholar
• Rätsch, G., T. Onoda, and K.-R. Müller. 2001. “Soft Margins for AdaBoost.” Machine Learning 42 (3): 287–320. doi:10.1023/A:1007618119488.
   Web of Science ®Google Scholar
• Romay, M. G. 2016. “Hyperspectral Remote Sensing Scenes.” Accessed 21 April. http://www.ehu.eus/ccwintco/index.php?title=Hyperspectral_Remote_Sensing_Scenes.
   Google Scholar
• Sheen, S. S., V. Aishwarya, R. Anitha, S. V. Raghavan, and S. M. Bhaskar. 2012. Hybrid Artificial Intelligent Systems: 7th International Conference, HAIS 2012, Salamanca, Spain, March 28-30th, 2012. Proceedings, Part II. Chap. Ensemble Pruning Using Harmony Search, 13–24. Berlin, Heidelberg: Springer Berlin Heidelberg.
   Google Scholar
• Sonnenburg, S. 2016. “Machine Learning Data Set Repository.” Accessed 21 April. http://mldata.org.
   Google Scholar
• Tinoco, S. L. J. L., H. G. Santos, D. Menotti, A. B. Santos, and J. A. Dos Santos. 2013. “Ensemble of Classifiers for Remote Sensed Hyperspectral Land Cover Analysis: An Approach Based on Linear Programming and Weighted Linear Combination.” In 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS, 4082–4085. Piscataway, NJ: IEEE.
   Google Scholar
• Wilcoxon, F. 1945. “Individual Comparisons by Ranking Methods.” Biometrics Bulletin 1 (6): 80–83. doi:10.2307/3001968.
   Google Scholar
• Xu, L., A. Krzyzak, and C. Y. Suen. 1992. “Methods of Combining Multiple Classifiers and Their Applications to Handwriting Recognition.” IEEE Transactions on Systems, Man, and Cybernetics 22 (3): 418–435. doi:10.1109/21.155943.
   Web of Science ®Google Scholar
• Yang, X. S. 2010. “Firefly Algorithm, Stochastic Test Functions and Design Optimisation.” International Journal of Bio-Inspired Computation 2 (2): 78–84. doi:10.1504/IJBIC.2010.032124.
   Web of Science ®Google Scholar
• Yang, X. S., and S. Deb. 2010. “Engineering Optimisation by Cuckoo Search.” International Journal of Mathematical Modelling and Numerical Optimisation 1: 330–343. doi:10.1504/IJMMNO.2010.035430.
   Google Scholar
• Zhou, Z.-H., J. Wu, and W. Tang. 2002. “Ensembling Neural Networks: Many Could be Better than All.” Artificial Intelligence 137 (1–2): 239–263. doi:10.1016/S0004-3702(02)00190-X.
   Web of Science ®Google Scholar