The role of technology-facilitated peer assessment and supporting strategies: a meta-analysis

References

• Askew, S. 2004. Feedback for Learning. New York: Routledge.
   Google Scholar
• Barak, M., and Y. J. Dori. 2009. “Enhancing Higher Order Thinking Skills among Inservice Science Teachers via Embedded Assessment.” Journal of Science Teacher Education 20(5): 459–474. doi:10.1007/s10972-009-9141-z.
   Google Scholar
• Bloxham, S., and A. West. 2004. “Understanding the Rules of the Game: Making Peer Assessment as a Medium for Developing Students’ Conceptions of Assessment.” Assessment & Evaluation in Higher Education 29(6): 721–733. doi:10.1080/0260293042000227254.
   Google Scholar
• Borenstein, M., L. V. Hedges, J. P. T. Higgins, and H. R. Rothstein. 2011. Introduction to Meta-Analysis. Chichester, UK: Wiley.
   Google Scholar
• Cheng, K. H., J. C. Liang, and C. C. Tsai. 2015. “Examining the Role of Feedback Messages in Undergraduate Students’ Writing Performance during an Online Peer Assessment Activity.” The Internet and Higher Education 25: 78–84. doi:10.1016/j.iheduc.2015.02.001.
   Web of Science ®Google Scholar
• Cohen, J. 1992. “A Power Primer.” Psychological Bulletin 3(2): 155–159. doi:10.1037/0033-2909.112.1.155.
   Web of Science ®Google Scholar
• Falchikov, N., and J. Goldfinch. 2000. “Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks.” Review of Educational Research 70(3): 287–322. doi:10.3102/00346543070003287.
   Web of Science ®Google Scholar
• Gielen, M., and B. D. Wever. 2015. “Scripting the Role of Assessor and Assessee in Peer Assessment in a Wiki Environment: Impact on Peer Feedback Quality and Product Improvement.” Computers & Education 88: 370–386. doi:10.1016/j.compedu.2015.07.012.
   Web of Science ®Google Scholar
• Hsia, L. H., I. Huang, and G. J. Hwang. 2016. “Effects of Different Online Peer-Feedback Approaches on Students' Performance Skills, Motivation and Self-Efficacy in a Dance Course.” Computers & Education 96: 55–71. doi:10.1016/j.compedu.2016.02.004.
   Web of Science ®Google Scholar
• Kim, M. 2009. “The Impact of an Elaborated Assessee's Role in Peer Assessment.” Assessment and Evaluation in Higher Education 34(1): 105–114. doi:10.1080/02602930801955960.
   Web of Science ®Google Scholar
• Lai, C. L., and G. J. Hwang. 2015. “An Interactive Peer-Assessment Criteria Development Approach to Improving Students' Art Design Performance Using Handheld Devices.” Computers & Education 85: 149–159. doi:10.1016/j.compedu.2015.02.011.
   Web of Science ®Google Scholar
• Li, H., Y. Xiong, C. V. Hunter, X. Guo, and R. Tywoniw. 2019. “Does Peer Assessment Promote Student Learning? a Meta-Analysis.” Assessment & Evaluation in Higher Education 1–19. doi:10.1080/02602938.2019.1620679.
   Web of Science ®Google Scholar
• Li, H., Y. Xiong, X. Zang, L. M. Kornhaber, Y. Lyu, K. S. Chung, and H. K. Suen. 2016. “Peer Assessment in the Digital Age: A Meta-Analysis Comparing Peer and Teacher Ratings.” Assessment & Evaluation in Higher Education 41(2): 245–264. doi: 10.1080/02602938.2014.999746.
   Web of Science ®Google Scholar
• Li, L. 2017. “The Role of Anonymity in Peer Assessment.” Assessment & Evaluation in Higher Education 42(4): 645–656. doi:10.1080/02602938.2016.1174766.
   Web of Science ®Google Scholar
• Lin, G. Y. 2018. “Anonymous versus Identified Peer Assessment via a Facebook-Based Learning Application: Effects on Quality of Peer Feedback, Perceived Learning, Perceived Fairness, and Attitude toward the System.” Computers & Education 116: 81–92. doi:10.1016/j.compedu.2017.08.010.
   Web of Science ®Google Scholar
• Lipsey, M. W., and D. B. Wilson. 2001. Practical Meta-Analysis. Thousand Oaks, CA: Sage.
   Google Scholar
• Liu, X., and L. Li. 2014. “Assessment Training Effects on Student Assessment Skills and Task Performance in a Technology-Facilitated Peer Assessment.” Assessment & Evaluation in Higher Education 39(3): 275–292. doi:10.1080/02602938.2013.823540.
   Web of Science ®Google Scholar
• McMahon, T. 2010. “Combining Peer-Assessment with Negotiated Learning Activities on a Day-Release Undergraduate-Level Certificate Course (ECTS Level 3).” Assessment & Evaluation in Higher Education 35(2): 223–239. doi:10.1080/02602930902795919.
   Web of Science ®Google Scholar
• Orwin, R. G. 1983. “A Fail-Safe N for Effect Size in Meta-Analysis.” Journal of Educational and Behavioral Statistics 8: 157–159. doi:10.3102/10769986008002157.
   Google Scholar
• Roscoe, R. D., and M. T. Chi. 2008. “Tutor Learning: The Role of Explaining and Responding to Questions.” Instructional Science 36(4): 321–350. doi:10.1007/s11251-007-9034-5.
   Web of Science ®Google Scholar
• Rosenthal, R. 1979. “The File Drawer Problem and Tolerance for Null Results.” Psychological Bulletin 86(3): 638–641. doi:10.1037/0033-2909.86.3.638.
   Web of Science ®Google Scholar
• Schmid, R. F., R. M. Bernard, E. Borokhovski, R. Tamim, P. C. Abrami, C. A. Wade, M. A. Surkes, and G. Lowerison. 2009. “Technology’s Effect on Achievement in Higher Education: A Stage I Meta-Analysis of Classroom Applications.” Journal of Computing in Higher Education 21(2): 95–109. doi:10.1007/s12528-009-9021-8.
   Google Scholar
• Topping, K. 1998. “Peer Assessment between Students in Colleges and Universities.” Review of Educational Research 68(3): 249–276. doi: 10.2307/1170598.
   Web of Science ®Google Scholar
• Topping, K. 2005. “Trends in Peer Learning.” Educational Psychology 25(6): 631–645. doi:10.1080/01443410500345172.
   Google Scholar
• Tsai, Y. C., and M. T. Chuang. 2013. “Fostering Revision of Argumentative Writing through Structured Peer Assessment.” Perceptual and Motor Skills 116(1): 210–221. doi:10.2466/10.23.PMS.116.1.210-221.
   PubMed Web of Science ®Google Scholar
• Wang, H. C., Y. J. Hsieh, and W. F. Chen. 2016. “The Effect of Online Peer Assessment in Engineering Education: A Quasi-Experimental Study.” International Journal of Engineering Education 32(1): 199–208.
   Web of Science ®Google Scholar
• Zheng, L. 2016. “The Effectiveness of Self-Regulated Learning Scaffolds on Academic Performance in Computer-Based Learning Environments: A Meta-Analysis.” Asia Pacific Education Review 17(2): 187–202. doi:10.1007/s12564-016-9426-9.
   Web of Science ®Google Scholar

• AbuSeileek, A., and A. Abualsha'r. 2014. “Using Peer Computer-Mediated Corrective Feedback to Support EFL Learners' Writing.” Language Learning & Technology 18(1): 76–95. doi:10.125/44355.
   Web of Science ®Google Scholar
• Azari, M. H. 2017. “Effect of Weblog-Based Process Approach on EFL Learners' Writing Performance and Autonomy.” Computer Assisted Language Learning 30(6): 529–551. doi:10.1080/09588221.2017.1329214.
   Web of Science ®Google Scholar
• Balgopal, M. M., A. M. A. Casper, A. M. Wallace, P. J. Laybourn, and E. Brisch. 2018. “Writing Matters: Writing-to-Learn Activities Increase Undergraduate Performance in Cell Biology.” BioScience 68(6): 445–454. doi:10.1093/biosci/biy042.
   Web of Science ®Google Scholar
• Cevik, Y. D., T. Haşlaman, and S. Çelik. 2015. “The Effect of Peer Assessment on Problem Solving Skills of Prospective Teachers Supported by Online Learning Activities.” Studies in Educational Evaluation 44: 23–35. doi:10.1016/j.stueduc.2014.12.002.
   Web of Science ®Google Scholar
• Chang, S. H., T. C. Wu, Y. K. Kuo, and L. C. You. 2012. “Project-Based Learning with an Online Peer Assessment System in a Photonics Instruction for Enhancing Led Design Skills.” Turkish Online Journal of Educational Technology-TOJET 11(4): 236–246.
   Google Scholar
• Chang, S. H., L. C. Yu, Y. K. Kuo, Y. T. Mai, and J. D. Chen. 2015. “Applying Online Peer Assessment with Total Quality Management to Elevate Project-Based Learning Performance.” Journal of Baltic Science Education 14(3): 379–390.
   Web of Science ®Google Scholar
• Cho, K., and C. Macarthur. 2011. “Learning by Reviewing.” Journal of Educational Psychology 103(1): 73–84. doi:10.1037/a0021950.
   Web of Science ®Google Scholar
• Ciftci, H., and Z. Kocoglu. 2012. “Effects of Peer e-Feedback on Turkish EFL Students' Writing Performance.” Journal of Educational Computing Research 46(1): 61–84. doi:10.2190/EC.46.1.c.
   Web of Science ®Google Scholar
• Gouli, E., A. Gogoulou, and M. Grigoriadou. 2008. “Supporting Self-, Peer-, and Collaborative-Assessment in e-Learning: The Case of the Peer and Collaborative Assessment Environment (Pecasse).” Journal of Interactive Learning Research 19(4): 615–647.
   Google Scholar
• Ha, H. W. M., and P. Storey. 2006. “Knowing and Doing in the ESL Writing Class.” Language Awareness 15: 283–300. doi:10.21677/la365/0.
   Google Scholar
• Hartberg, Y., A. B. Gunersel, N. Simpson, and V. Balester. 2008. “Development of Student Writing in Biochemistry Using Calibrated Peer Review.” Journal of the Scholarship of Teaching and Learning 2(1): 29–44.
   Google Scholar
• Hsia, L. H., I. Huang, and G. J. Hwang. 2016. “A Web-Based Peer-Assessment Approach to Improving Junior High School Students' Performance, Self-Efficacy and Motivation in Performing Arts Courses.” British Journal of Educational Technology 47(4): 618–632. doi:10.1111/bjet.12248.
   Web of Science ®Google Scholar
• Hsia, L. H., I. Huang, and G. J. Hwang. 2016. “Effects of Different Online Peer-Feedback Approaches on Students' Performance Skills, Motivation and Self-eEfficacy in a Dance Course.” Computers & Education 96: 55–71. doi:10.1016/j.compedu.2016.02.004.
   Web of Science ®Google Scholar
• Hsu, T. C., and A. C. K. Hsu. 2016. “Effects of a Peer Assessment System Based on a Grid-Based Knowledge Classification Approach on Computer Skills Training.” Journal of Educational Technology & Society 19(4): 100–111. doi:10.2307/jeductechsoci.19.4.100.
   Web of Science ®Google Scholar
• Hummel, H. G., F. Paas, and R. Koper. 2006. “Effects of Cueing and Collaboration on the Acquisition of Complex Legal Skills.” British Journal of Educational Psychology 76(3): 613–631. doi:10.1348/000709905X85629.
   PubMed Web of Science ®Google Scholar
• Hung, H. C., and S. S. C. Young. 2015. “The Effectiveness of Adopting E-Readers to Facilitate EFL Students' Process-Based Academic Writing.” Educational Technology & Society 18(1): 250–263. doi:10.2307/jeductechsoci.18.1.250.
   Web of Science ®Google Scholar
• Hwang, G. J., C. M. Hung, and N. S. Chen. 2014. “Improving Learning Achievements, Motivations and Problem-Solving Skills through a Peer Assessment-Based Game Development Approach.” Educational Technology Research and Development 62(2): 129–145. doi:10.1007/s11423-013-9320-7.
   Web of Science ®Google Scholar
• Jaime, A., J. M. Blanco, C. Domínguez, A. Sánchez, J. Heras, and I. Usandizaga. 2016. “Spiral and Project-Based Learning with Peer Assessment in a Computer Science Project Management Course.” Journal of Science Education and Technology 25(3): 439–449. . doi:10.1007/s10956-016-9604-x.
   Web of Science ®Google Scholar
• Jhangiani, R. S. 2016. “The Impact of Participating in a Peer Assessment Activity on Subsequent Academic Performance.” Teaching of Psychology 43(3): 180–186. doi:10.1177/0098628316649312.
   Web of Science ®Google Scholar
• Lai, C. L., and G. J. Hwang. 2015. “An Interactive Peer-Assessment Criteria Development Approach to Improving Students' Art Design Performance Using Handheld Devices.” Computers & Education 85: 149–159. doi:10.1016/j.compedu.2015.02.011.
   Web of Science ®Google Scholar
• Lee, C. I., Y. F. Yang, and S. Y. Mai. 2016. “The Impact of a Scaffolded Assessment Intervention on Students' Academic Achievement in Web-Based Peer Assessment Activities.” International Journal of Distance Education Technologies 14(4): 41–54. . doi:10.4018/IJDET.2016100104.
   Web of Science ®Google Scholar
• Liu, C. C., S. Y. Tao, and J. N. Nee. 2008. “Bridging the Gap between Students and Computers: Supporting Activity Awareness for Network Collaborative Learning with GSM Network.” Behaviour & Information Technology 27(2): 127–137. . doi:10.1080/01449290601054772.
   Web of Science ®Google Scholar
• Mellati, M., and M. Khademi. 2014. “Peer Evaluation in CMC Learning Environment and Writing Skill.” International Journal of Applied Linguistics and English Literature 3(5): 220–228. doi:10.7575/aiac.ijalel.v.3n.5p.220.
   Google Scholar
• Novakovich, J. 2016. “Fostering Critical Thinking and Reflection through Blog-Mediated Peer Feedback.” Journal of Computer Assisted Learning 32(1): 16–30. doi:10.1111/jcal.12114.
   Web of Science ®Google Scholar
• Novakovich, J., and E. Cramer Long. 2013. “Digital Performance Learning: Utilizing a Course Weblog for Mediating Communication.” Journal of Educational Technology & Society 16(4): 231–241.
   Web of Science ®Google Scholar
• Papadopoulos, P. M., S. N. Demetriadis, and A. Weinberger. 2013. “Make It Explicit!’: Improving Collaboration through Increase of Script Coercion.” Journal of Computer Assisted Learning 29(4): 383–398. doi:10.1111/jcal.12014.
   Web of Science ®Google Scholar
• Papadopoulos, P. M., T. D. Lagkas, and S. N. Demetriadis. 2012. “How to Improve the Peer Review Method: Free-Selection vs Assigned-Pair Protocol Evaluated in a Computer Networking Course.” Computers & Education 59(2): 182–195. . doi:10.1016/j.compedu.2012.01.005.
   Web of Science ®Google Scholar
• Pelaez, N. J. 2002. “Problem-Based Writing with Peer Review Improves Academic Performance in Physiology.” Advances in Physiology Education 26(3): 174–184. doi:10.1152/advan.00041.2001.
   PubMed Web of Science ®Google Scholar
• Sung, Y. T., K. E. Chang, T. H. Chang, and W. C. Yu. 2010. “How Many Heads Are Better than One? The Reliability and Validity of Teenagers' Self- and Peer Assessments.” Journal of Adolescence 33(1): 135–145. doi:10.1016/j.adolescence.2009.04.004.
   PubMed Web of Science ®Google Scholar
• Tsai, Y. C., and M. T. Chuang. 2013. “Fostering Revision of Argumentative Writing through Structured Peer Assessment.” Perceptual and Motor Skills 116(1): 210–221. doi:10.2466/10.23.PMS.116.1.210-221.
   PubMed Web of Science ®Google Scholar
• Wang, H. C., Y. J. Hsieh, and W. F. Chen. 2016. “The Effect of Online Peer Assessment in Engineering Education: A Quasi-Experimental Study.” International Journal of Engineering Education 32(1): 199–208.
   Web of Science ®Google Scholar
• Wang, X. M., G. J. Hwang, Z. Y. Liang, and H. Y. Wang. 2017. “Effect of Weblog-Based Process Approach on EFL Learners’ Writing Performance and Autonomy Thinking Awareness and Attitudes towards Programming: An Online Peer-Assessment Attempt.” Journal of Educational Technology & Society 20(4): 58–68. doi:10.1080/09588221.2017.1329214.
   Web of Science ®Google Scholar
• Xiao, Y., and R. Lucking. 2008. “The Impact of Two Types of Peer Assessment on Students' Performance and Satisfaction within a Wiki Environment.” Internet & Higher Education 11(3): 186–193. doi:10.1016/j.iheduc.2008.06.005.
   Web of Science ®Google Scholar
• Xie, Y., F. Ke, and P. Sharma. 2008. “The Effect of Peer Feedback for Blogging on College Students' Reflective Learning Processes.” Internet & Higher Education 11(1): 18–25. doi:10.1016/j.iheduc.2007.11.001.
   Web of Science ®Google Scholar
• Yang, Y. F. 2016. “Transforming and Constructing Academic Knowledge through Online Peer Feedback in Summary Writing.” Computer Assisted Language Learning 29(4): 683–620. doi:10.1080/09588221.2015.1016440.
   Web of Science ®Google Scholar
• Yu, F. Y. 2012. “Any Effects of Different Levels of Online User Identity Revelation?” Journal of Educational Technology & Society 15(1): 64–77.
   Web of Science ®Google Scholar
• Yuan, J., and C. M. Kim. 2018. “The Effects of Autonomy Support on Student Engagement in Peer Assessment.” Educational Technology Research and Development 66(1): 25–52. doi:10.1007/s11423-017-9538-x.
   Web of Science ®Google Scholar