The use of machine learning “black boxes” explanation systems to improve the quality of school education

References

• Abaei, M. M., Arzaghi, E., Abbassi, R., Garaniya, V., & Penesis, I. (2017). Developing a novel risk-based methodology for multi-criteria decision making in marine renewable energy applications. Renewable Energy, 102, 341–19. https://doi.org/10.1016/j.renene.2016.10.054
   Web of Science ®Google Scholar
• Symagulov, A. (2019). Appendix 1 Features of the regression model. https://osf.io/zugdb
   Google Scholar
• Baykasoglu, A., & Durmusoglu, Z. D. (2014). A hybrid MCDM for private primary school assessment using DEMATEL based on ANP and fuzzy cognitive map. International Journal of Computational Intelligence Systems, 7(4), 615–635. https://doi.org/10.1080/18756891.2014.960220
   Web of Science ®Google Scholar
• Beggrow, E. P., Ha, M., Nehm, R. H., Pearl, D., & Boone, W. J. (2014). Assessing scientific practices using machine-learning methods: How closely do they match clinical interview performance? Journal of Science Education and Technology, 23(1), 160–182. https://doi.org/10.1007/s10956-013-9461-9
   Web of Science ®Google Scholar
• Biran, O., & Cotton, C. (2017, August). Explanation and justification in machine learning: A survey. In IJCAI-17 Workshop on Explainable AI (XAI), 8(1), 8-13.
   Google Scholar
• Borg, I., Groenen, P. J. F., & Jo., J. E. M. (2003). Modern multidimensional scaling: Theory and applications. Journal of Educational Measurement, 40(3), 277–280. https://doi.org/10.1111/j.1745-3984.2003.tb01108.x
   Web of Science ®Google Scholar
• Brans, J. P., & Vincke, P. (1985). Note—A preference ranking organisation method: (The PROMETHEE method for multiple criteria decision-making). Management Science, 31(6), 647–656. https://doi.org/10.1287/mnsc.31.6.647
   Web of Science ®Google Scholar
• Charabi, Y., & Gastli, A. (2011). PV site suitability analysis using GIS-based spatial fuzzy multi-criteria evaluation. Renewable Energy, 36(9), 2554–2561. https://doi.org/10.1016/j.renene.2010.10.037
   Web of Science ®Google Scholar
• Koehrsen, W. (2018). A Complete Machine Learning Walk-Through in Python: Part Three Interpreting a machine learning model and presenting results. https://towardsdatascience.com/a-complete-machine-learning-walk-through-in-python-part-three-388834e8804b
   Google Scholar
• Figueira, J., Mousseau, V., & Roy, B. (2005). ELECTRE methods. In Multiple criteria decision analysis: State of the art surveys (pp. 133–153).
   Google Scholar
• Hansen, P., & Ombler, F. (2008). A new method for scoring additive multi-attribute value models using pairwise rankings of alternatives. Journal of Multi-Criteria Decision Analysis, 15(3–4), 87–107. https://doi.org/10.1002/mcda.428
   Google Scholar
• UNESCO. (n.d.). The Incheon Declaration and Framework for Action for the Fourth Sustainable Development Goal. https://en.unesco.org/gem-report/sdg-goal–4
   Google Scholar
• Kabak, M., & Dağdeviren, M. (2014). A hybrid MCDM approach to assess the sustainability of students’ preferences for university selection. Technological and Economic Development of Economy, 20(3), 391–418. https://doi.org/10.3846/20294913.2014.883340
   Web of Science ®Google Scholar
• Köne, A. Ç., & Büke, T. (2007). An analytical network process (ANP) evaluation of alternative fuels for electricity generation in Turkey. Energy Policy, 35(10), 5220–5228. https://doi.org/10.1016/j.enpol.2007.05.014
   Web of Science ®Google Scholar
• Lai, Y. J., Liu, T. Y., & Hwang, C. L. (1994). Topsis for MODM. European Journal of Operational Research, 76(3), 486–500. https://doi.org/10.1016/0377-2217(94)90282-8
   Web of Science ®Google Scholar
• Ribeiro, M. (2019). Lime. Retrieved October 19, 2019, from https://github.com/marcotcr/lime
   Google Scholar
• Ribeiro, M., Singh, S., Guestrin, C. (2019). Local Interpretable Model-Agnostic Explanations (LIME): An Introduction. https://www.oreilly.com/learning/introduction-to-local-interpretable-model-agnostic-explanations-lime
   Google Scholar
• Lundberg, S. M., & Lee, S. I. (2017). A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems, 4765–4774.
   Google Scholar
• Maaten, L. V. D., & Hinton, G. (2008). Visualizing data using t-SNE. Journal of Machine Learning Research, 9(Nov), 2579–2605.
   Google Scholar
• Mardani, A., Jusoh, A., Zavadskas, E. K., Cavallaro, F., & Khalifah, Z. (2015). Sustainable and renewable energy: An overview of the application of multiple criteria decision making techniques and approaches. Sustainability, 7(10), 13947–13984. https://doi.org/10.3390/su71013947
   Web of Science ®Google Scholar
• Muhamedyev, R. (2015). Machine learning methods: An overview. Computer Modelling & New Technologies, 19(6), 14–29.
   Google Scholar
• Mukhamediev, R. I., Mustakayev, R., Yakunin, K., Kiseleva, S., & Gopejenko, V. (2019). Multi-criteria spatial decision making supportsystem for renewable energy development in Kazakhstan. IEEE Access, 7, 122275–122288. https://doi.org/10.1109/ACCESS.2019.2937627
   Web of Science ®Google Scholar
• eGov. (n.d.). National ranking of the best universities of Kazakhstan.  https://egov.kz/cms/en/articles/2Fbestuniinkz30
   Google Scholar
• Ogor, E. N. (2007, September). Student academic performance monitoring and evaluation using data mining techniques Electronics, robotics and automotive mechanics conference (CERMA 2007) (pp. 354–359). IEEE.
   Google Scholar
• Ola, A., & Pallaniappan, S. (2013). A data mining model for evaluation of instructors’ performance in higher institutions of learning using machine learning algorithms. International Journal of Conceptions on Computing and Information Technology, 1(1).
   Google Scholar
• Univision. (2019). Passing points for a scholarship for specialties for 2018.  (in Russian).  Retrieved October 10, 2019, from  https://univision.kz/prohodnye-bally-na-grant-2018.html
   Google Scholar
• Symonds, Q. (2019). QS EECA international rating.  Retrieved October 10, 2019, from https://www.topuniversities.com/university-rankings/eeca-rankings/2018
   Google Scholar
• Ribeiro, M. T., Singh, S., & Guestrin, C. (2016, August). “ Why should i trust you?” Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining (pp. 1135–1144).
   Google Scholar
• Ribiero, M. T., Singh, S., & Guestrin, C. (2016). Local interpretable model-agnostic explanations an introduction. O’Reilly.
   Google Scholar
• Roweis, S. T., & Saul, L. K. (2000). Nonlinear dimensionality reduction by locally linear embedding. science, 290(5500), 2323–2326. https://doi.org/10.1126/science.290.5500.2323
   PubMed Web of Science ®Google Scholar
• Saati, T. L., & Andreychikova, O. N. (2015). Ob izmerenii neosyazayemogo. Podkhod k otnositel’nym izmereniyam na osnove glavnogo sobstvennogo vektora matritsy parnykh sravneniy. Cloud of Science, 2 (1), 5–39. (in Russian).
   Google Scholar
• Schölkopf, B., Smola, A., & Müller, K. R. (1998). Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10(5), 1299–1319. https://doi.org/10.1162/089976698300017467
   Web of Science ®Google Scholar
• Scikit-learn. (2019). Scikit-learn: machine learning in Python. https://scikit-learn.org
   Google Scholar
• Scott, J., Ho, W., Dey, P. K., & Talluri, S. (2015). A decision support system for supplier selection and order allocation in stochastic, multi-stakeholder and multi-criteria environments. International Journal of Production Economics, 166, 226–237. https://doi.org/10.1016/j.ijpe.2014.11.008
   Web of Science ®Google Scholar
• Lundberg, S. (2019). Shap. https://github.com/slundberg/shap.
   Google Scholar
• Singh, S., & Lal, S. P. (2013, December). Educational courseware evaluation using machine learning techniques. In 2013 IEEE conference on e-learning, e-Management and e-Services (pp. 73–78). IEEE.
   Google Scholar
• Tenenbaum, J. B., De Silva, V., & Langford, J. C. (2000). A global geometric framework for nonlinear dimensionality reduction. science, 290(5500), 2319–2323. https://doi.org/10.1126/science.290.5500.2319
   PubMed Web of Science ®Google Scholar
• Symagulov, A. (2019). Top specialties list 2018. https://osf.io/gyv5a
   Google Scholar
• Hulstaert, L. (2018). Understanding Model Predictions with LIME. https://www.datacamp.com/community/tutorials/understanding-model-predictions-lime
   Google Scholar
• Yager, R. R. (1988). On ordered weighted averaging aggregation operators in multicriteria decisionmaking. IEEE Transactions on systems Man, and Cybernetics, 18(1), 183–190. https://doi.org/10.1109/21.87068
   Web of Science ®Google Scholar