288
Views
1
CrossRef citations to date
0
Altmetric
Article

Effect of data preprocessing on ensemble learning for classification in disease diagnosis

ORCID Icon, ORCID Icon & ORCID Icon
Pages 1657-1677 | Received 04 Feb 2021, Accepted 09 Mar 2022, Published online: 24 Mar 2022
 

Abstract

In recent years, supervised machine learning methods have increased attention to extracting clinically relevant information from complex health data. Ensemble learning methods enable the establishment of more successful models by training multiple learners jointly to solve the same problem. Herein, we aimed to compare the performance of classification algorithms after data preprocessing to problems such as missing data, class noise, and class imbalance that may be encountered in the datasets used to make an accurate disease diagnosis. To this end, we used random forest and weighted subspace random forest as bagging algorithms while additive logistic regression and gradient boosted machines algorithms were used as boosting algorithms. The performance and running time of the algorithms were also calculated. Our findings indicated that the performance of algorithms increased after data preprocessing and the performance of boosting algorithms yielded higher results than the bagging algorithms. We also observed that the boosting algorithms were the longest-running ones. In conclusion, complementing existing studies, our work highlights the importance and effect of using multiple data preprocessing methods together.

MATHEMATICAL SUBJECT CLASSIFICATION:

Additional information

Funding

This study is supported by Ege University Scientific Research Projects Coordination Unit. Project Number: TKB-2019-20199. The initial results of the study was presented at the 5th International Researchers, Statisticians and Young Statisticians Congress (IRSYSC2019) at October 2019 in Aydın, Turkey.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.