Forecasting conflict using a diverse machine-learning ensemble: Ensemble averaging with multiple tree-based algorithms and variance promoting data configurations

References

• Atger, F. 1999. “The Skill of Ensemble Prediction Systems.” Monthly Weather Review 127 (9): 1941–53. doi:10.1175/1520-0493(1999)127<1941:TSOEPS>2.0.CO;2
   Web of Science ®Google Scholar
• Bell, C. 2016. The Rulers, Elections, and Irregular Governance Dataset (REIGN). Broomfield, CO: OEF Research.
   Google Scholar
• Bian, Y., and H. Chen. 2019. “When Does Diversity Help Generalization in Classification Ensembles?” IEEE Transactions on Cybernetics 1–17. Advance online publication.
   Google Scholar
• Breiman, L. 1996. “Bagging Predictors.” Machine Learning 24 (2): 123–40. doi:10.1007/BF00058655
   Web of Science ®Google Scholar
• Breiman, L. 2001. “Random Forests.” Machine Learning 45 (1): 5–32. doi:10.1023/A:1010933404324
   Web of Science ®Google Scholar
• Chen, T., and C. Guestrin. 2016. “XGBoost: A Scalable Tree Boosting System.” In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery, 785–94. New York: Association for Computing Machinery. doi:10.1145/2939672.2939785
   Google Scholar
• Clemen, R.T. 1989. “Combining Forecasts: A Review and Annotated Bibliography.” International Journal of Forecasting 5 (4): 559–83. doi:10.1016/0169-2070(89)90012-5
   Web of Science ®Google Scholar
• Colaresi, M., and Z. Mahmood. 2017. “Do the Robot: Lessons from Machine Learning to Improve Conflict Forecasting.” Journal of Peace Research 54 (2): 193–214. doi:10.1177/0022343316682065
   Web of Science ®Google Scholar
• Cutler, A., R. Cutler, and J.R. Stevens. 2012. “Random Forests.” In Ensemble Machine Learning, edited by C. Zhang and Y. Ma, 157–75. Boston: Springer.
   Google Scholar
• Dietterich, T. G. 2000. “Ensemble Methods in Machine Learning.” Paper presented at the International Workshop on Multiple Classifier Systems, Cagliari, Italy, June 21–23. doi:10.1007/3-540-45014-9_1
   Google Scholar
• Eck, K., and L. Hultman. 2007. “One-sided Violence against Civilians in War: Insights from New Fatality Data.” Journal of Peace Research 44 (2): 233–46. doi:10.1177/0022343307075124
   Web of Science ®Google Scholar
• Ettensperger, F. 2020. “Comparing Supervised Learning Algorithms and Artificial Neural Networks for Conflict Prediction: Performance and Applicability of Deep Learning in the Field.” Quality & Quantity 54 (2): 567–601. doi:10.1007/s11135-019-00882-w
   Google Scholar
• Friedman, J.H. 1999. Stochastic Gradient Boosting. Stanford Statistics. Stanford.
   Google Scholar
• Gashler, M., C. Giraud-Carrier, and T. Martinez. 2008. “Decision Tree Ensemble: Small Heterogeneous is Better than Large Homogeneous.” Paper presented at the Seventh International Conference on Machine Learning and Applications, San Diego, December 11–13.
   Google Scholar
• Gleditsch, N.P., P. Wallensteen, M. Eriksson, M. Sollenberg, and H. Strand. 2002. “Armed Conflict 1946-2001: A New Dataset.” Journal of Peace Research 39 (5): 615–37. doi:10.1177/0022343302039005007.
   Web of Science ®Google Scholar
• Gupta, S., and P. C. Wilton. 1988. “Combination of Economic Forecasts: An Odds-Matrix Approach.” Journal of Business and Economic Statistics 6(3):373–79.
   Web of Science ®Google Scholar
• Hastie, T., R. Tibshirani, and J. H. Friedman. 2009. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed. New York: Springer.
   Google Scholar
• He, T. 2020. Package “Xgboost” - Extreme Gradient Boosting.
   Google Scholar
• Hegre, H., P. Vesco, and M. Colaresi. 2022. “Lessons from an Escalation Prediction Competition.” International Interactions 48 (4).
   Web of Science ®Google Scholar
• Hegre, H., M. Croicu, K. Eck, and S. Högbladh. 2020. “Introducing the UCDP Candidate Events Dataset.” Research & Politics 7 (3): 1–8. doi:10.1177/2053168020935257
   Web of Science ®Google Scholar
• Ho, T. K. 1995. “Random Decision Forests.” In Proceedings of the Third International Conference on Document Analysis and Recognition, Vol. 1, 278–82. Los Alamitos: IEEE Computer Society Press.
   Google Scholar
• International Monetary Fund (IMF). 2020. World Economic Outlook: A Long and Difficult Ascent. Washington, DC: International Monatary Fund.
   Google Scholar
• Ishwaran, H., and U. Kogalur. 2020. Package ‘Randomforestsrc’ - Fast Unified Random Forests for Survival, Regression, and Classification (RF-SRC).
   Google Scholar
• James, G., D. Witten, T. Hastie, and R. Tibshirani. 2013. An Introduction to Statistical Learning. New York: Springer.
   Google Scholar
• Li, P., C. J. C. Burges, and Q. Wu. 2007. “McRank: Learning to Rank Using Multiple Classification and Gradient Boosting.” In Proceedings of the 20th International Conference on Neural Information Processing Systems, edited by J. C. Platt, D. Koller, Y. Singer, and S. T. Roweis, 897–904. Red Hook, NY: Curan Associates Inc.
   Google Scholar
• Mashhoori, A., and M.Z. Jahromi. 2013. “Block-wise Two-directional 2DPCA with Ensemble Learning for Face Recognition.” Neurocomputing 108:111–17. doi: 10.1016/j.neucom.2012.12.005.
   Web of Science ®Google Scholar
• Mason, L., J. Baxter, P. Bartlett, and M. Frean. 1999. “Boosting Algorithms as Gradient Descent.” In Proceedings of the 12th International Conference on Neural Information Processing Systems, edited by S. A. Solla, T. K. Leen, and K. Muller,512–18. Cambridge, MA: MIT Press.
   Google Scholar
• Molteni, F., R. Buizza, T.N. Palmer, and T. Petroliagis. 1996. “The ECMWF Ensemble Prediction System: Methodology and Validation.” Quarterly Journal of the Royal Meteorological Society 122 (529): 73–119. doi:10.1002/qj.49712252905
   Web of Science ®Google Scholar
• Muchlinski, D., D. Siroky, J. He, and M. Kocher. 2016. “Comparing Random Forest with Logistic Regression for Predicting Class-Imbalanced Civil War Onset Data.” Political Analysis 24 (1): 87–103. doi:10.1093/pan/mpv024
   Web of Science ®Google Scholar
• Naftaly, U., N. Intrator, and D. Horn. 1997. “Optimal Ensemble Averaging of Neural Networks.” Network: Computation in Neural Systems 8 (3): 283–96. doi:10.1088/0954-898X_8_3_004
   Web of Science ®Google Scholar
• Opitz, D., and R. Maclin. 1999. “Popular Ensemble Methods: An Empirical Study.” Journal of Artificial Intelligence Research 11(1):169–98. doi: 10.1613/jair.614.
   Google Scholar
• Palmer, T.N. 2000. “Predicting Uncertainty in Forecasts of Weather and Climate.” Reports on Progress in Physics 63 (2): 71–116. doi:10.1088/0034-4885/63/2/201
   Web of Science ®Google Scholar
• Rokach, L. 2010. Pattern Classification Using Ensemble Methods, Series in Machine Perception and Artificial Intelligence. Singapore: World Scientific Pub. Co.
   Google Scholar
• Sollich, P., and A. Krogh. 1996. “Learning with Ensembles: How Overfitting can be Useful.” In Advances in Neural Information Processing Systems 8: Proceedings of the 1995 Conference, edited by D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, 190–96. Cambridge, MA: MIT Press.
   Google Scholar
• Sundberg, R., and E. Melander. 2013. “Introducing the UCDP Georeferenced Event Dataset.” Journal of Peace Research 50(4): 523–32.
   Web of Science ®Google Scholar
• Sundberg, R., K. Eck, and J. Kreutz. 2012. “Introducing the UCDP Non-state Conflict Dataset.” Journal of Peace Research 49 (2): 351–62. doi:10.1177/0022343311431598
   Web of Science ®Google Scholar
• V-Dem Institute. 2020. Autocratization Surges - Resistance Grows. Democracy Report 2020. Göteborg: V-Dem Institute.
   Google Scholar
• Vesco, P., H. Hegre, M. Colaresi, R. B. Jansen, A. Lo, G. Reisch, and N. B. Weidmann. 2022. “United They Stand: Findings from an Escalation Prediction Competition.” International Interactions 48 (4). doi:10.1080/03050629.2022.2029856
   Web of Science ®Google Scholar
• ViEWS. 2020. ViEWS Prediction Competition. Preliminary evaluation for the scoring committee. Department of Peace and Conflict Research, Uppsala University.
   Google Scholar
• Ward, M.D., B. Greenhill, and K. Bakke. 2010. “The Perils of Policy by P-value: Predicting Civil Conflicts.” Journal of Peace Research 47 (4): 363–75. doi:10.1177/0022343309356491
   Web of Science ®Google Scholar
• WorldBank. 2019. World Development Indicators. Washington, DC: World Bank.
   Google Scholar
• Zhou, Z.-H. 2012. Ensemble Methods: Foundations and Algorithms. Boca Raton, FL: Taylor & Francis.
   Google Scholar