Developing a performance evaluation matrix to enhance the learner satisfaction of an e-learning system

References

• Adkins, S. S. (2014). The 2013–2018 worldwide digital English language learning market (Ambient Insight Premium Report). Retrieved from http://www.ambientinsight.com/AIStore/SearchResult.aspx?CategoryID=17
   Google Scholar
• Adkins, S. S. (2015). The 2014–2019 Asia mobile learning market (Ambient Insight). Retrieved from http://www.ambientinsight.com/Resources/Documents/AmbientInsight-2014-2019-Asia-Mobile-Learning-Market-Overview.pdf
   Google Scholar
• All, A., Nuñez Castellar, E. P., & Van Looy, J. (2015). Towards a conceptual framework for assessing the effectiveness of digital game-based learning. Computers & Education, 88, 29–37. doi:10.1016/j.compedu.2015.04.012
   Web of Science ®Google Scholar
• Allen, I. E., & Seaman, J. (2013). Changing Course: Ten Years of Tracking Online Education in the United States. Babson Survey Research Group and Quahog Research Group, LLC. Retrieved from http://www.onlinelearningsurvey.com/reports/changingcourse.pdf
   Google Scholar
• Althaus, S. L. (1997). Computer-mediated communication in the university classroom: An experiment with on-line discussions. Communication Education, 46(3), 158–174. doi:10.1080/03634529709379088
   Web of Science ®Google Scholar
• Benson, E. P. (2004). Online learning: A means to enhance professional development. Critical Care Nurse, 24(1), 60–63.
   PubMedGoogle Scholar
• Bollen, K. A., & Brab, K. H. (1981). Person’s R and coarsely categorized measures. American Sociological Review, 46(2), 232–239. doi:10.2307/2094981
   Web of Science ®Google Scholar
• Bouhnik, D., & Marcus, T. (2006). Interaction in distance-learning courses. Journal of the American Society for Information Science and Technology, 57(3), 299–305. doi:10.1002/asi.20277
   Web of Science ®Google Scholar
• Bradley, R. A., Katti, S. K., & Coons, I. J. (1962). Optimal scaling for ordered categories. Psychometrika, 27(4), 355–374. doi:10.1007/BF02289644
   Web of Science ®Google Scholar
• Chen, K. S., & Chen, H. T. (2014). Applying importance-performance analysis with simple regression model and priority indices to assess hotels’ service performance. Journal of Testing and Evaluation, 42(2), 455–466.
   Web of Science ®Google Scholar
• Chen, K. S., Chen, H. T., & Lin, C. L. (2012). Applying a revised SQPM in the define step of six sigma and a case study. Total Quality Management & Business Excellence, 23(3-4), 309–324. doi:10.1080/14783363.2011.593851
   Web of Science ®Google Scholar
• Chen, K. S., & Chen, T. W. (2008). Application of fuzzy relative quality Performance matrix on the improvement of critical to quality problems. Proceedings of 5th international conference on fuzzy systems and knowledge discovery (FSKD’08) (pp. 356–360), Shandong, China.
   Google Scholar
• Chen, K. S., Wang, K. J., & Chang, T. C. (2015) A novel approach based on performance influence for evaluating criteria of service quality. Journal of Testing and Evaluation, 43(1), 191–200. doi: 10.1520/JTE20130259
   Web of Science ®Google Scholar
• Chen, S. H. (2009). Establishment of a performance-evaluation model for service quality in the banking industry. The Service Industries Journal, 29(2), 235–247. doi: 10.1080/02642060802295034
   Web of Science ®Google Scholar
• Chiang, C., Lee, C. C., & Tzeng, G. H. (2009). A non-additive model for the evaluation of portal website service quality. Journal of the Chinese Institute of Industrial Engineers, 26(5), 355–366. doi:10.1080/10170660909509150
   Google Scholar
• Chiou, W. C., Lin, C. C., & Perng, C. (2011). A strategic website evaluation of online travel agencies. Tourism Management, 32(6), 1463–1473. doi:10.1016/j.tourman.2010.12.007
   Web of Science ®Google Scholar
• Cole, M. T., Shelley, D. J., & Swartz, L. B. (2014). Online instruction, e-learning, and student satisfaction: A three year study. International Review of Research in Open and Distance Learning, 15(6), 111–131.
   Web of Science ®Google Scholar
• Connolly, T. M., MacArthur, E., Stansfield, M., & McLellan, E. (2007). A quasi-experimental study of three online learning courses in computing. Computers & Education, 49(2), 345–359. doi:10.1016/j.compedu.2005.09.001
   Web of Science ®Google Scholar
• Cronin, J. J.Jr., & Taylor, S. A. (1992). Measuring service quality: A reexamination and extension. Journal of Marketing, 56(3), 55–68. doi:10.2307/1252296
   Web of Science ®Google Scholar
• Deng, W. (2007). Using a revised importance-performance analysis approach: The case of Taiwanese hot springs tourism. Tourism Management, 28(5), 1274–1284. doi:10.1016/j.tourman.2006.07.010
   Web of Science ®Google Scholar
• DeVellis, R. F. (2003). Scale development: Theory and applications (2nd ed.). Newbury Park, CA: Sage.
   Google Scholar
• Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. doi:10.2307/3151312
   Web of Science ®Google Scholar
• Garrison, D. R., Anderson, T., & Archer, W. (1999). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2-3), 87–105. doi:10.1016/S1096-7516(00)00016-6
   Google Scholar
• Golec, A., & Taskin, H. (2007). Novel methodologies and a comparative study for manufacturing systems performance evaluations. Information Sciences, 177(23), 5253–5274. doi:10.1016/j.ins.2007.06.024
   Web of Science ®Google Scholar
• Herrera, F., Lopez, E., Mendana, C., & Rodriguez, M. A. (2001). A linguistic decision model for personnel management solved with a linguistic biobjective genetic algorithm. Fuzzy Sets and Systems, 118(1), 47–64. doi: 10.1016/S0165-0114(98)00373-X
   Web of Science ®Google Scholar
• Hew, K. F., & Cheung, W. S. (2013). Audio-based versus text-based asynchronous online discussion: Two case studies. Instructional Science, 41(2), 365–380. doi:10.1007/s11251-012-9232-7
   Web of Science ®Google Scholar
• Hossain, M. J., & Ahmed, S. M. Z. (2013). Developing a service performance assessment system to improve service quality of academic libraries. Business Information Review, 30(4), 210–221. doi:10.1177/0266382113512404
   Google Scholar
• Hsu, T. H., Chu, K. M., & Chan, H. C. (2001). A study on fuzzy linguistic scale. Journal of Business Administration, 51, 27–51.
   Google Scholar
• Hu, H. Y., Lee, Y. C., & Yen, T. M. (2010). Service quality gaps analysis based on fuzzy linguistic SERVQUAL with a case study in hospital out-patient services. The TQM Journal, 22(5), 499–515. doi: 10.1108/17542731011072847
   Google Scholar
• Hung, J. L., & Zhang, K. (2012). Examining mobile learning trends 2003-2008: A categorical meta-trend analysis using text mining techniques. Journal of Computer in Higher Education, 24(1), 1–17. doi:10.1007/s12528-011-9044-9
   Web of Science ®Google Scholar
• Hung, Y. H., Huang, M. L., & Chen, K. S. (2003). Service quality evaluation by service quality performance matrix. Total Quality Management and Business Excellence, 14(1), 79–89. doi:10.1080/14783360309706
   Web of Science ®Google Scholar
• Hwang, G. J., & Tsai, C. C. (2011). Research trend in mobile and ubiquitous learning: A review of publications in selected journal from 2001 to 2010. British Journal of Education Technology, 42(4), E65–E70. doi:10.1111/j.1467-8535.2011.01183.x
   Web of Science ®Google Scholar
• Kekkonen-Moneta, S., & Moneta, G. B. (2002). E-learning in Hong Kong: Comparing learning outcomes in online multimedia and lecture versions of an introductory computing course. British Journal of Educational Technology, 33(4), 423–433. doi:10.1111/1467-8535.00279
   Web of Science ®Google Scholar
• Kinney, N. E. (2001). A guide to design and testing in online psychology courses. Psychology Learning & Teaching, 1(1), 16–20. doi:10.2304/plat.2001.1.1.16
   Google Scholar
• Kuo, Y. C., Walker, A. E., Schroder, K. E. E., & Belland, B. R. (2014). Interaction, internet self-efficacy, and self-regulated learning as predictors of student satisfaction in online education courses. Internet and Higher Education, 20, 35–50. doi:10.1016/j.iheduc.2013.10.001
   Web of Science ®Google Scholar
• Lai, F., Luo, R., Zhang, L., Huang, X., & Rozelle, S. (2015). Does computer-assisted learning improve learning outcomes? Evidence from a randomized experiment in migrant schools in Beijing. Economics of Education Review, 47, 34–48. doi:10.1016/j.econedurev.2015.03.005
   Web of Science ®Google Scholar
• Lambert, D. M., & Sharma, A. (1990). A customer-based competitive analysis for logistics decisions. International Journal of Physical Distribution and Logistics Management, 20(1), 17–24. doi:10.1108/EUM0000000000350
   Google Scholar
• Liaw, S. S. (2008). Investigating students’ perceived satisfaction, behavioral intention, and effectiveness of e-learning: A case study of the blackboard system. Computers & Education, 51(2), 864–873. doi:10.1016/j.compedu.2007.09.005
   Web of Science ®Google Scholar
• Lin, S. L., & Wang, C. S. (2015). Integration of FAHP and association rule to establish the evaluation mechanism for e-learning platform. Journal of Management & Systems, 22(1), 125–147.
   Google Scholar
• Liou, T. S., & Chen, C. W. (2006). Subjective appraisal of service quality using fuzzy linguistic assessment. International Journal of Quality & Reliability Management, 23(8), 928–943. doi:10.1108/02656710610688149
   Google Scholar
• Liu, X., Magjuka, R. J., Bonk, C. J., & Lee, S. (2007). Does sense of community matter? An examination of participants’ perceptions of building learning communities in online courses. Quarterly Review of Distance Education, 8(1), 9–24.
   Google Scholar
• Lock, J. V. (2002). Laying the groundwork for the development of learning communities within online courses. Quarterly Review of Distance Education, 3(4), 395–408.
   Google Scholar
• Lorenzetti, J. P. (2005). How elearning is changing higher education: A new look. Distance Education Report, 9(15), 4–7.
   Google Scholar
• Lubiano, M. A., De La Rosa De Sáa, S., Montenegro, M., Sinova, B., & Gil, M. Á. (2016). Descriptive analysis of responses to items in questionnaires. Why not using a fuzzy rating scale?Information Sciences, 360, 131–148. doi: 10.1016/j.ins.2016.04.029
   Web of Science ®Google Scholar
• Luo, J., Ba, S., & Zhang, H. (2012). The effectiveness of online shopping characteristics and well-designed websites on satisfaction. MIS Quarterly, 36(4), 1131–1144. A9.
   Web of Science ®Google Scholar
• Marković, S., & Janković, S. R. (2013). Exploring the relationship between service quality and customer satisfaction in Croatian hotel industry. Tourism and Hospitality Management, 19(2), 149–164.
   Google Scholar
• Martínez-Caro, E., Cegarra-Navarro, J. G., & Cepeda-Carrión, G. (2015). An application of the performance-evaluation model for e-learning quality in higher education. Total Quality Management and Business Excellence, 26(5-6), 632–647. doi:10.1080/14783363.2013.867607
   Web of Science ®Google Scholar
• Moore, M. G., & Kearsley, G. (1996). Distance education: A systems view. New York, NY: Wadsworth.
   Google Scholar
• Nagel, L., & Kotzé, T. G. (2010). Supersizing e-learning: What a CoI survey reveals about teaching presence in a large online class. The Internet and Higher Education, 13(1-2), 45–51. doi:10.1016/j.iheduc.2009.12.001
   Web of Science ®Google Scholar
• Najmul Islam, A. K. M. (2014). Sources of satisfaction and dissatisfaction with a learning management system in post-adoption stage: A critical incident technique approach. Computers in Human Behavior, 30, 249–261. doi:10.1016/j.chb.2013.09.010
   Web of Science ®Google Scholar
• Najmul Islam, A. K. M. (2016). E-learning system use and its outcomes: Moderating role of perceived compatibility. Telematics and Informatics, 33(1), 48–55. doi:10.1016/j.tele.2015.06.010
   Web of Science ®Google Scholar
• Olsson, U., Drasgow, F., & Dorans, N. J. (1982). The ployserical correlation coefficient. Psychometrika, 47(3), 337–347. doi:10.1007/BF02294164
   Web of Science ®Google Scholar
• Ozkan, S., & Koseler, R. (2009). Multi-dimensional students’ evaluation of e-learning systems in the higher education context: An empirical investigation. Computers & Education, 53(4), 1285–1296. doi:10.1016/j.compedu.2009.06.011
   Web of Science ®Google Scholar
• Paechter, M., & Maier, B. (2010). Online or face-to-face? Students’ experiences and preferences in e-learning. Internet and Higher Education, 13(4), 292–297. doi:10.1016/j.iheduc.2010.09.004
   Web of Science ®Google Scholar
• Piccoli, G., Ahmad, R., & Ives, B. (2001). Web-based virtual learning environments: A research framework and a preliminary assessment of effectiveness in basic IT skills training. MIS Quarterly, 25(4), 401–426. doi:10.2307/3250989
   Web of Science ®Google Scholar
• Rosenberg, M. J. (2001). E-Learning: Strategies for delivering knowledge in the digital age. New York, NY: McGraw-Hill.
   Google Scholar
• Ryu, K., Lee, H. R., & Kim, W. G. (2012). The influence of the quality of the physical environment, food, and service on restaurant image, customer perceived value, customer satisfaction, and behavioral intentions. International Journal of Contemporary Hospitality Management, 24(2), 200–223. doi:10.1108/09596111211206141
   Web of Science ®Google Scholar
• Shee, D. Y., & Wang, Y. S. (2008). Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications. Computers & Education, 50(3), 894–905. doi:10.1016/j.compedu.2006.09.005
   Web of Science ®Google Scholar
• Snyder, M. M. (2009). Instructional-design theory to guide the creation of online learning communities for adults. TechTrend, 53(1), 48–56.
   Google Scholar
• Šumak, B., Heričko, M., & Pušnik, M. (2011). A meta-analysis of e-learning technology acceptance: The role of user types and e-learning technology types. Computers in Human Behavior, 27(6), 2067–2077. doi:10.1016/j.chb.2011.08.005
   Web of Science ®Google Scholar
• Sun, P. C., Tsai, R. J., Finger, G., Chen, Y. Y., & Yeh, D. (2008). What drives a successful e-learning? An empirical investigation of the critical factors influencing learner satisfaction. Computers & Education, 50(4), 1183–1202. doi:10.1016/j.compedu.2006.11.007
   Web of Science ®Google Scholar
• Wang, K. J., Chang, T. C., & Chen, K. S. (2015). Determining critical service quality from the view of performance influence. Total Quality Management & Business Excellence, 26(3-4), 368–384. doi:10.1080/14783363.2013.835635
   Web of Science ®Google Scholar
• Wang, Y. S. (2003). Assessment of learner satisfaction with asynchronous electronic learning systems. Information & Management, 41(1), 75–86. doi:10.1016/S0378-7206(03)00028-4
   Web of Science ®Google Scholar
• Wu, B., & Chen, M. (1999). Use of fuzzy statistical technique in change periods detection of nonlinear time series. Applied Mathematics and Computation, 99(2-3), 241–254. doi:10.1016/S0096-3003(98)00011-3
   Web of Science ®Google Scholar
• Wu, J. C. T., Tsai, H. T., Shih, M. H., & Fu, H. H. (2010). Government performance evaluation using a balanced scorecard with a fuzzy linguistic scale. The Service Industries Journal, 30(3), 449–462. doi:10.1080/02642060802248017
   Web of Science ®Google Scholar
• Wu, W. H., Jim Wu, Y. C., Chen, C. Y., Kao, H. Y., Lin, C. H., & Huang, S. H. (2012). Review of trends from mobile learning studies: A meta-analysis. Computers & Education, 59(2), 817–827. doi:10.1016/j.compedu.2012.03.016
   Web of Science ®Google Scholar
• Yuan, J., & Kim, C. (2014). Guidelines for facilitating the development of learning communities in online courses. Journal of Computer Assisted Learning, 30(3), 220–232. doi:10.1111/jcal.12042
   Web of Science ®Google Scholar
• Yukselturk, E., & Yildirim, Z. (2008). Investigation of interaction, online support, course structure and flexibility as the contributing factors to students’ satisfaction in an online certificate program. Educational Technology & Society, 11(4), 51–65.
   Web of Science ®Google Scholar
• Zacharis, N. Z. (2015). A multivariate approach to predicting student outcomes in web-enabled blended learning courses. Internet and Higher Education, 27, 44–53. doi:10.1016/j.iheduc.2015.05.002
   Web of Science ®Google Scholar
• Zadeh, L. A. (1975). The concept of a linguistic variable and its application to approximate reasoning-I. Information Science, 8(3), 199–249. doi:10.1016/0020-0255(75)90036-5
   Web of Science ®Google Scholar