Unfolding the Drivers of Student Success in Answering Multiple-Choice Questions About Microsoft Excel

References

• Al Rawahi, F. K., Khan, S. A., & Huq, A. (2006). Microsoft EXCEL in the mathematics classroom: A case study. In Seán M. Stewart, Janet E. Olearski, & Douglas Thompson (Eds.), Proceedings of the Second Middle East Teachers of Science, Mathematics and Computing Conference (METSMaC) (pp. 131–134). Abu Dhabi, United Arab Emirates: The Petroleum Institute.
   Google Scholar
• Bai, H. (2009). Assigning students in cooperative and individual learning environments according to cognitive styles: Achievement and perceptions in computer technology learning. Journal on School Educational Technology, 5(1), 7–16. doi:10.26634/jsch.5.1.228
   Google Scholar
• Barreto, H. (2015). Why Excel? The Journal of Economic Education, 46(3), 300–309. doi:10.1080/00220485.2015.1029177
   Web of Science ®Google Scholar
• Boland, R. J., Lester, N. A., & Williams, E. (2010). Writing multiple-choice questions. Academic Psychiatry, 34(4), 310–316. doi:10.1176/appi.ap.34.4.310
   PubMed Web of Science ®Google Scholar
• Brown, G. A., Bull, J., & Pendlebury, M. (2013). Assessing student learning in higher education. London, UK: Routledge.
   Google Scholar
• Browne, A., Hudson, B., Whitley, D., Ford, M., Picton, P., & Kazemian, H. (2003). Knowledge extraction from neural networks. Proceedings of the 29th Annual Conference of the IEEE Industrial Electronics Society (pp. 1909–1913). Roanoke, VA: IEEE.
   Google Scholar
• Burton, R. F. (2001). Quantifying the effects of chance in multiple choice and true/false tests: Question selection and guessing of answers. Assessment & Evaluation in Higher Education, 26(1), 41–50. doi:10.1080/02602930020022273
   Google Scholar
• Burton, R. F. (2005). Multiple‐choice and true/false tests: Myths and misapprehensions. Assessment & Evaluation in Higher Education, 30(1), 65–72.
   Google Scholar
• Cortez, P. (2010). Data mining with neural networks and support vector machines using the R/rminer tool. In P. Perner (Ed.), Advances in data mining: Applications and theoretical aspects (pp. 572–583). Berlin, Heidelberg: Springer.
   Google Scholar
• Cortez, P., & Embrechts, M. J. (2011). Opening black box data mining models using sensitivity analysis. Proceedings of the IEEE Symposium on Computational Intelligence and Data Mining, DM 2011 (part of the IEEE Symposium Series on Computational Intelligence) (pp. 341–348). Paris, France. doi:10.1109/CIDM.2011.5949423
   Google Scholar
• Cortez, P., & Embrechts, M. J. (2013). Using sensitivity analysis and visualization techniques to open black box data mining models. Information Sciences, 225, 1–17. doi:10.1016/j.ins.2012.10.039
   Web of Science ®Google Scholar
• Cortez, P., & Silva, A. (2008). Using data mining to predict secondary school student performance. In A. Brito & J. Teixeira (Eds.), Proceedings of 5th Annual Future Business Technology Conference (pp. 5–12). Porto.
   Google Scholar
• Costa, J. M., & Miranda, G. L. (2017). Desenvolvimento e validação de uma prova de avaliação das competências iniciais de programação [Development and validation of an assessment instrument of the initial programming skills]. RISTI - Revista Ibérica de Sistemas e Tecnologias de Informação, 25, 66–81. doi:10.17013/risti.25.66-81
   Google Scholar
• Dochy, F., Janssens, S., & Struyven, K. (2005). Students’ perceptions about evaluation and assessment in higher education: A review 1. Assessment & Evaluation in Higher Education, 30(4), 325–341. doi:10.1080/02602930500099102
   Google Scholar
• Froncek, B., Hirschfeld, G., & Thielsch, M. T. (2014). Characteristics of effective exams – Development and validation of an instrument for evaluating written exams. Studies in Educational Evaluation, 43, 79–87. doi:10.1016/j.stueduc.2014.01.003
   Web of Science ®Google Scholar
• Frydenberg, M. (2013). Flipping Excel. Information Systems Education Journal, 11(1), 63–73.
   Google Scholar
• Freedle, R., & Kostin, I. (1996). The prediction of TOEFL listening comprehension item difficulty for minitalk passages: Implications for construct validity. ETS Research Report Series, 1996(2), i–61. doi:10.1002/j.2333-8504.1996.tb01707.x
   Google Scholar
• Gharibyan, H. (2005). Assessing students’ knowledge: Oral exams vs. written tests. ACM SIGCSE Bulletin, 37(3), 143–147. doi:10.1145/1151954.1067487
   Google Scholar
• Guerreiro, J., & Moro, S. (2017). Are Yelp’s tips helpful in building influential consumers? Tourism Management Perspectives, 24, 151–154. doi:10.1016/j.tmp.2017.08.006
   Web of Science ®Google Scholar
• Haykin, S. S. (2009). Neural networks and learning machines (Vol. 3). Upper Saddle River, NJ, USA: Pearson.
   Google Scholar
• Kemmer, G., & Keller, S. (2010). Nonlinear least-squares data fitting in Excel spreadsheets. Nature Protocols, 5(2), 267–281. doi:10.1038/nprot.2009.182
   PubMed Web of Science ®Google Scholar
• Korn, M., & Levitz, J. (2013, January 1). Online courses look for a business model. The Wall Street Journal, B8.
   Google Scholar
• Lingard, J., Minasian‐Batmanian, L., Vella, G., Cathers, I., & Gonzalez, C. (2009). Do students with well‐aligned perceptions of question difficulty perform better? Assessment & Evaluation in Higher Education, 34(6), 603–619. doi:10.1080/02602930802287249
   Web of Science ®Google Scholar
• Linn, R. L., Baker, E. L., & Dunbar, S. B. (1991). Complex, performance-based assessment: Expectations and validation criteria. Educational Researcher, 20(8), 15–21. doi:10.3102/0013189X020008015
   Google Scholar
• Loh, W. Y. (2011). Classification and regression trees. WIREs Data Mining and Knowledge Discovery, 1(1), 14–23. doi:10.1002/widm.8
   Web of Science ®Google Scholar
• Maresca, M. (2016). The spreadsheet space: Eliminating the boundaries of data cross-referencing. Computer Magazine, 49(9), 78–85. doi:10.1109/MC.2016.272
   Web of Science ®Google Scholar
• Margaryan, A., Bianco, M., & Littlejohn, A. (2015). Instructional quality of massive open online courses (MOOCs). Computers & Education, 80, 77–83. doi:10.1016/j.compedu.2014.08.005
   Web of Science ®Google Scholar
• Martiniello, M. (2009). Linguistic complexity, schematic representations, and differential item functioning for English language learners in math tests. Educational Assessment, 14(3–4), 160–179. doi:10.1080/10627190903422906
   Google Scholar
• McCoubrie, P. (2004). Improving the fairness of multiple-choice questions: A literature review. Medical Teacher, 26(8), 709–712. doi:10.1080/01421590400013495
   PubMed Web of Science ®Google Scholar
• Miranda, M. J. (1985). Docimologia em Perspectiva [Docimology in perspective]. Revista da Faculdade de Educação, 8(1), 39–69.
   Google Scholar
• Monk, D. (2005). Using data mining for e-learning decision making. The Electronic Journal of e-Learning, 3(1), 41–54.
   Google Scholar
• Moro, S., Cortez, P., & Rita, P. (2014). A data-driven approach to predict the success of bank telemarketing. Decision Support Systems, 62, 22–31. doi:10.1016/j.dss.2014.03.001
   Web of Science ®Google Scholar
• Moro, S., Cortez, P., & Rita, P. (2015). Using customer lifetime value and neural networks to improve the prediction of bank deposit subscription in telemarketing campaigns. Neural Computing and Applications, 26(1), 131–139. doi:10.1007/s00521-014-1703-0
   Web of Science ®Google Scholar
• Moro, S., Rita, P., & Vala, B. (2016). Predicting social media performance metrics and evaluation of the impact on brand building: A data mining approach. Journal of Business Research, 69(9), 3341–3351. doi:10.1016/j.jbusres.2016.02.010
   Web of Science ®Google Scholar
• Moro, S., Cortez, P., & Rita, P. (2017a). A framework for increasing the value of predictive data-driven models by enriching problem domain characterization with novel features. Neural Computing and Applications, 28(6), 1515–1523. doi:10.1007/s00521-015-2157-8
   Web of Science ®Google Scholar
• Moro, S., Rita, P., & Coelho, J. (2017b). Stripping customers’ feedback on hotels through data mining: The case of Las Vegas strip. Tourism Management Perspectives, 23, 41–52. doi:10.1016/j.tmp.2017.04.003
   Web of Science ®Google Scholar
• Naghibi, S. A., Pourghasemi, H. R., & Abbaspour, K. (2018). A comparison between ten advanced and soft computing models for groundwater qanat potential assessment in Iran using R and GIS. Theoretical and Applied Climatology, 131(3–4), 967–984. doi:10.1007/s00704-016-2022-4
   Web of Science ®Google Scholar
• Pinto, A. C. (2001). Factores relevantes na avaliação escolar por perguntas de escolha múltipla [Relevant factors in school evaluation by multiple-choice questions]. Psicologia, Educação e Cultura, 5(1), 23–44.
   Google Scholar
• Resnick, L. B., & Resnick, D. P. (1992). Assessing the thinking curriculum: New tools for educational reform. In B. R. Gifford & M. C. O’Connor (Eds.), Evaluation in education and human services. Changing assessments: Alternative views of aptitude, achievement and instruction (pp. 37–75). Berlin, Heidelberg, Germany: Springer. doi:10.1007/978-94-011-2968-8_3
   Google Scholar
• Rish, I. (2001). An empirical study of the naive Bayes classifier. IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, 3(22), 41–46.
   Google Scholar
• Roediger III, H. L., & Marsh, E. J. (2005). The positive and negative consequences of multiple-choice testing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(5), 1155–1159. doi:10.1037/0278-7393.31.5.1155
   PubMed Web of Science ®Google Scholar
• Romero, C., & Ventura, S. (2007). Educational data mining: A survey from 1995 to 2005. Expert Systems with Applications, 33(1), 135–146. doi:10.1016/j.eswa.2006.04.005
   Web of Science ®Google Scholar
• Romero, C., & Ventura, S. (2010). Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 40(6), 601–618. doi:10.1109/TSMCC.2010.2053532
   Web of Science ®Google Scholar
• Sartes, L., & Souza-Formigoni, M. L. (2013). Avanços na Psicometria: Da Teoria Clássica dos Testes à Teoria de Resposta ao Item [Advances in psychometry: From classical theory of tests to item response theory]. Psicologia: Reflexão e Crítica, 26(2), 241–250. doi:10.1590/S0102-79722013000200004
   Google Scholar
• Sathya, R., & Abraham, A. (2013). Comparison of supervised and unsupervised learning algorithms for pattern classification. International Journal of Advanced Research in Artificial Intelligence, 2(2), 34–38. doi:10.14569/IJARAI.2013.020206
   Google Scholar
• Scouller, K. (1998). The influence of assessment method on students’ learning approaches: Multiple choice question examination versus assignment essay. Higher Education, 35(4), 453–472.
   Web of Science ®Google Scholar
• Sharda, R., Delen, D., & Turban, E. (2013). Business intelligence: A managerial perspective on analytics. Upper Saddle River, NJ: Prentice Hall.
   Google Scholar
• Sitzmann, T., Ely, K., Bell, B. S., & Bauer, K. N. (2010). The effects of technical difficulties on learning and attrition during online training. Journal of Experimental Psychology: Applied, 16(3), 281–292. doi:10.1037/a0019968
   PubMed Web of Science ®Google Scholar
• Stiller, J., Hartmann, S., Mathesius, S., Straube, P., Tiemann, R., Nordmeier, V., … Upmeier zu Belzen, A. (2016). Assessing scientific reasoning: A comprehensive evaluation of item features that affect item difficulty. Assessment & Evaluation in Higher Education, 41(5), 721–732. doi:10.1080/02602938.2016.1164830
   Web of Science ®Google Scholar
• Swallow, V., Newton, J., & Van Lottum, C. (2003). How to manage and display qualitative data using ‘Framework’ and Microsoft® Excel. Journal of Clinical Nursing, 12(4), 610–612. doi:10.1046/j.1365-2702.2003.00728.x
   PubMed Web of Science ®Google Scholar
• Tarrant, M., & Ware, J. (2008). Impact of item‐writing flaws in multiple‐choice questions on student achievement in high‐stakes nursing assessments. Medical Education, 42(2), 198–206. doi:10.1111/j.1365-2923.2007.02957.x
   PubMed Web of Science ®Google Scholar
• Tsai, S. L., Tsai, W. W., Chai, S. K., Sung, W. H., Doong, J. L., & Fung, C. P. (2004). Evaluation of computer-assisted multimedia instruction in intravenous injection. International Journal of Nursing Studies, 41(2), 191–198. doi:10.1016/S0020-7489(03)00130-5
   PubMed Web of Science ®Google Scholar
• Tyszkiewicz, J. (2010). Spreadsheet as a relational database engine. In A. Elmagarmid (Ed.), Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data (pp. 195–206). Indianapolis, IN: ACM. doi:10.1145/1807167.1807191
   Google Scholar
• Waldman, M., & Ulema, M. (2008). Automated measurement and analysis of effectiveness of teaching selected Excel topics in an introductory IS class. Journal of Computing Sciences in Colleges, 23(5), 73–82.
   Google Scholar
• Yan, T., & Tourangeau, R. (2008). Fast times and easy questions: The effects of age, experience and question complexity on web survey response times. Applied Cognitive Psychology, 22(1), 51–68.
   Web of Science ®Google Scholar
• Zlatović, M., Balaban, I., & Kermek, D. (2015). Using online assessments to stimulate learning strategies and achievement of learning goals. Computers & Education, 91, 32–45. doi:10.1016/j.compedu.2015.09.012
   Web of Science ®Google Scholar