Why peer evaluations in student teams don’t tell us what we think they do

References

• Almond, R. J. (2009). Group assessment: Comparing group and individual undergraduate module marks. Assessment and Evaluation in Higher Education, 34, 141–148. doi:10.1080/02602930801956083
   Web of Science ®Google Scholar
• Ashenafi, M. M. (2017). Peer-assessment in high education – twenty-first century practices, challenges and the way forward. Assessment and Evaluation in Higher Education, 42, 226–251. doi:10.1080/02602938.2015.1100711
   Web of Science ®Google Scholar
• Ashraf, M. (2004). A critical look at the use of group projects as a pedagogical tool. Journal of Education for Business, 79, 213–216. doi:10.3200/JOEB.79.4.213-216
   Google Scholar
• Beer, A., & Watson, D. (2008). Personality judgement at zero acquaintance: Agreement, assumed similarity, and implicit similarity. Journal of Personality Assessment, 90, 250–260. doi:10.1080/00223890701884970
   PubMed Web of Science ®Google Scholar
• Bettenhausen, K. L., & Fedor, D. B. (1997). Peer and upward appraisals: A comparison of their benefits and problems. Group & Organization Management, 22, 236–263. doi:10.1177/1059601197222006
   Web of Science ®Google Scholar
• Borman, W. C., White, L. A., & Dorsey, D. W. (1995). Effects of ratee task performance and interpersonal factors on supervisor and peer performance ratings. Journal of Applied Psychology, 80, 168–177. doi:10.1037/0021-9010.80.1.168
   Web of Science ®Google Scholar
• Borrego, M., Karlin, J., McNair, L. D., & Beddoes, K. (2013). Teaching effectiveness theory from Industrial and Organizational Psychology Applied to engineering student project teams: A research review. Journal of Engineering Education, 102, 472–512. doi:10.1002/jee.20023
   Web of Science ®Google Scholar
• Bouzidi, L., & Jaillet, A. (2009). Can online peer assessment be trusted? Educational Technology and Society, 12(4), 257–268. Retrieved from http://www.j-ets.net/ETS/index.html
   Google Scholar
• Brindley, C., & Scoffield, S. (1998). Peer assessment in undergraduate programs. Teaching in Higher Education, 3, 79–89. doi:10.1080/1356215980030106
   Google Scholar
• Brooks, C. M., & Ammons, J. L. (2003). Free riding in group projects and effects of timing, frequency, and specificity of criteria in peer assessments. Journal of Education for Business, 78, 268–272. doi:10.1080/08832320309598613
   Google Scholar
• Brutus, S., & Donia, M. B. L. (2010). Improving the effectiveness of students in groups with a centralized peer evaluation system. Academy of Management Learning & Education, 9, 652–662. doi:10.5465/AMLE.2010.56659882
   Web of Science ®Google Scholar
• Brutus, S., Donia, M. B. L., & Ronen, S. (2013). Can business students learn to evaluate better? Evidence from repeated exposure to a peer-evaluation system. Academy of Management Learning & Education, 12, 18–31. doi:10.5465/amle.2010.0204
   Web of Science ®Google Scholar
• Cho, K., Schunn, C. D., & Wilson, R. W. (2006). Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives. Journal of Educational Psychology, 98, 891–901. doi:10.1037/0022-0663.98.4.891
   Web of Science ®Google Scholar
• Christensen, P. N., & Kashy, D. A. (2012). Using the social relations model to understand interpersonal perception and behavior. In H. Cooper, Camic, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology (Vol.3, pp. 429). Washington, DC: American Psychological Association. doi:10.1037/13621-021
   Google Scholar
• Conway, J. M. (1996). Analysis and design of multitrait-multirater performance appraisal studies. Journal of Management, 22, 139–162. doi:10.1177/014920639602200106
   Web of Science ®Google Scholar
• Conway, J. M., Lombardo, K., & Sanders, K. C. (2001). A meta-analysis of incremental validity and nomological networks for subordinate and peer ratings. Human Performance, 14, 267–303. doi:10.1207/S15327043HUP1404_1
   Web of Science ®Google Scholar
• Cooley, C. H. (1902). Human nature and the social order. New York, NY: Charles Scribner's Sons
   Google Scholar
• Cranmer, S. (2006). Enhancing graduate employability: Best intentions and mixed outcomes. Studies in Higher Education, 31, 169–184. doi:10.1080/03075070600572041
   Web of Science ®Google Scholar
• Crutchfield, T. N., & Klamon, K. (2014). Assessing the dimensions and outcomes of an effective teammate. Journal of Education for Business, 89, 285–291. doi:10.1080/08832323.2014.885873
   Google Scholar
• de Vries, R. E. (2010). Lots of target variance: An update of SRM using the HEXACO Personality Inventory. European Journal of Personality, 24, 169–188. doi:10.1002/per.764
   Web of Science ®Google Scholar
• Duffrin, M. W. (2006). Integrating problem-based learning in an introductory college science course. Journal of Food Science Education, 2, 2–6. doi:10.1111/j.1541-4329.2003.tb00017.x
   Google Scholar
• Eastwick, P. W., & Finkel, E. J. (2009). Reciprocity of Liking. In H. T. Reis & S. Sprecher (Eds.), Encyclopedia of human relationships (pp. 1333–1336). Thousand Oaks, CA: Sage. doi:10.4135/9781412958479
   Google Scholar
• Falchikov, N., & Goldfinch, J. (2000). Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks. Review of Educational Research, 70, 287–322. doi:10.3102/00346543070003287
   Web of Science ®Google Scholar
• Fellenz, M. R. (2006). Toward fairness in assessing student group work: A protocol for peer evaluation of individual contributions. Journal of Management Education, 30, 570–591. doi:10.1177/1052562906286713
   Google Scholar
• Frank, M., Lavy, I., & Elata, D. (2003). Implementing the project-based learning approach in an academic engineering course. International Journal of Technology and Design Education, 13, 273–288. doi:10.1023/A:1026192113732
   Web of Science ®Google Scholar
• Friedman, B. A., Cox, P. L., & Maher, L. E. (2007). An expectancy theory motivation approach to peer assessment. Journal of Management Education, 32(5), 580–612. doi:10.1177/1052562907310641
   Google Scholar
• Funder, D. C., & Colvin, C. R. (1988). Friends and strangers: Acquaintanceship, agreement, and the accuracy of personality judgement. Journal of Personality and Social Psychology, 55, 149–158. doi:10.1037/0022-3514.55.1.149
   PubMed Web of Science ®Google Scholar
• Funder, D. C., Kolar, D. C., & Blackman, M. C. (1995). Agreement among judges of personality: Interpersonal relations, similarity, and acquaintanceship. Journal of Personality & Social Psychology, 69, 656–672. doi:10.1037/0022-3514.69.4.656
   PubMed Web of Science ®Google Scholar
• Gersick, C. J. G. (1988). Time and transition in work teams: Toward a new model of group development. Academy of Management Journal, 31, 9–41. doi:10.2307/256496
   Web of Science ®Google Scholar
• Gottschall, H., & García-Bayonas, M. (2008). Student attitudes towards group work among undergraduates in business administration, education and mathematics. Educational Research Quarterly, 32, 3–28. Retrieved from https://www.ebsco.com/products/research-databases/eric
   Google Scholar
• Greguras, G. J., & Robie, C. (1998). A new look at within-source interrater reliability of 360-degree feedback ratings. Journal of Applied Psychology, 83, 960–968. doi:10.1037/0021-9010.83.6.960
   Web of Science ®Google Scholar
• Greguras, G. J., Robie, C., & Born, M. (2001). Applying the social relations model to self and peer evaluations. Journal of Management Development, 20, 508–525. doi:10.1108/02621710110399792
   Google Scholar
• Hall, D., & Buzwell, S. (2013). The problem of free-riding in group projects: Looking beyond social loafing as reason for non-contribution. Active Learning in Higher Education, 14, 37–49. doi:10.1177/1469787412467123
   Web of Science ®Google Scholar
• Hansen, R. S. (2006). Benefits and problems with student teams: Suggestions for improving team projects. Journal of Education for Business, 82, 11–19. doi:10.3200/JOEB.82.1.11-19
   Google Scholar
• Hughes, I. E., & Large, B. J. (1993). Staff and peer-group assessment of oral communication skills. Studies in Higher Education, 18, 379–385. doi:10.1080/03075079312331382281
   Web of Science ®Google Scholar
• Johnson, T., Top, E., & Yukselturk, E. (2011). Team shared mental model as a contributing factor to team performance and students’ course satisfaction in blended courses. Computers in Human Behavior, 27, 2330–2338. doi:10.1016/j.chb.2011.07.012
   Web of Science ®Google Scholar
• Kenny, D. A. (1994). Interpersonal perception: A social relations analysis. New York, NY, US: Guilford Press.
   Google Scholar
• Kenny, D. A., & Acitelli, L. K. (2001). Accuracy and bias in the perception of the partner in a close relationship. Journal of Personality and Social Psychology, 80, 439–448. doi:10.1037/0022-3514.80.3.439
   PubMed Web of Science ®Google Scholar
• Kenny, D. A., & DePaulo, B. M. (1993). Do people know how others view them? An empirical and theoretical account. Psychological Bulletin, 114, 145–161. doi:10.1037/0033-2909.114.1.145
   PubMed Web of Science ®Google Scholar
• Kenny, D. A., & West, T. V. (2010). Similarity and agreement in self- and other perception: A meta-analysis. Personality and Social Psychology Review, 14, 196–213. 10.1177/1088868309353414
   PubMed Web of Science ®Google Scholar
• Lance, C. E. (1994). Test of a latent structure of performance ratings derived from Wherry's (1952) theory of ratings. Journal of Management, 20, 757–771. doi:10.1177/014920639402000404
   Web of Science ®Google Scholar
• Letzring, T. D., Wells, S. M., & Funder, D. C. (2006). Information quantity and quality effect the realistic accuracy of personality judgement. Journal of Personality and Social Psychology, 91, 111–123. doi:10.1037/0022-3514.91.1.111
   PubMed Web of Science ®Google Scholar
• Levesque, M. J. (1997). Meta-accuracy among acquainted individuals: A social relations analysis of interpersonal perception and metaperception. Journal of Personality and Social Psychology, 72, 66–74. doi:10.1037/0022-3514.72.1.66
   PubMed Web of Science ®Google Scholar
• Li, L., Liu, X., & Steckelberg, A. L. (2010). Assessor or assessee: How student learning improves by giving and receiving peer feedback. British Journal of Educational Technology, 41, 525–536. doi:10.1111/j.1467-8535.2009.00968.x
   Web of Science ®Google Scholar
• Liu, X., & Li, L. (2014). Assessment training effects on student assessment skills and task performance in a technology-facilitated peer assessment.” Assessment & Evaluation in Higher Education, 39, 275–292. doi:10.1080/02602938.2013.823540
   Web of Science ®Google Scholar
• Loignon, A. C., Woehr, D. J., Thomas, J. S., Loughry, M. L., Ohland, M. W., & Ferguson, D. M. (2017). Facilitating peer evaluation in team contexts: The impact of frame-of-reference rater training. Academy of Management Learning & Education, 16, 562–578. doi:10.5465/amle.2016.0163
   Web of Science ®Google Scholar
• Loughry, M. L., Ohland, M. L., & Moore, D. D. (2007). Development of a theory-based assessment of team member effectiveness. Educational and Psychological Measurement, 67, 505–524. doi:10.1177/001316440-6292085
   Web of Science ®Google Scholar
• Marks, M. A., Burke, C. S., Sabella, M. J., & Zaccaro, S. J. (2002). The impact of cross-training on team effectiveness. The Journal of Applied Psychology, 87, 3–13. doi:10.1037/0021-9010.87.1.3
   PubMed Web of Science ®Google Scholar
• Mead, G. H. (1925). The genesis of the self and social control. International Journal of Ethics, 35, 251–277. doi:10.1086/intejethi.35.3.2377274
   Google Scholar
• Morton, J. B., & Macbeth, W. (1977). Correlations between staff, peer and self assessments of fourth-year students in surgery. Medical Education, 11, 167–170. doi:10.1111/j.1365-2923.1977.tb00586.x
   PubMed Web of Science ®Google Scholar
• O’Neil, H. F., Allred, K., & Baker, E. L. (1997). Review of workforce readiness theoretical frameworks. In H. F. O’Neil (Ed.), Workforce readiness: Competencies and readiness (pp. 3–25). Mahwah, NJ: Lawrence Erlbaum
   Google Scholar
• Ohl, T., & Cates, W. (2006). The nature of groups: Implications for learning design. Journal of Interactive Learning Research, 17, 71–89. Retrieved from http://www.aace.org/pubs/jilr/
   Google Scholar
• Ohland, M. W., Loughry, M. L., Woehr, D. J., Bullard, L. G., Felder, R. M., Finelli, C. J., … Schmucker, D. G. (2012). The comprehensive assessment of team member effectiveness: Development of a behaviorally anchored rating scale for self- and peer evaluation. Academy of Management Learning & Education, 11, 609–630. doi:10.5465/amle.2010.0177
   Web of Science ®Google Scholar
• Orpen, C. (1982). Student versus lecturer assessment of learning: A research note. Higher Education, 11, 567–572. doi:10.1007/bf00194421
   Web of Science ®Google Scholar
• Paulhus, D. L., & Reynolds, S. (1995). Enhancing target variance in personality impressions: Highlighting the person in person perception. Journal of Personality and Social Psychology, 69, 1233–1242. doi:10.1037/0022-3514.69.6.1233
   PubMed Web of Science ®Google Scholar
• Pettigrew, T. F. (1998). Intergroup contact theory. Annual Review of Psychology, 49, 65+. doi:10.1146/annurev.psych.49.1.65
   PubMed Web of Science ®Google Scholar
• Pfaff, E., & Huddleston, P. (2003). Does it matter if I hate teamwork? What impacts student attitudes toward teamwork? Journal of Marketing Education, 25, 37–45. doi:10.1177/0273475302250571
   Google Scholar
• Pope, N. (2001). An examination of the use of peer rating for formative assessment in the context of the theory of consumption values. Assessment & Evaluation in Higher Education, 26, 235–246. doi:10.1080/02602930120052396
   Google Scholar
• Ross, L., Greene, D., & House, P. (1977). The false consensus effect: An egocentric bias in social perception and attribution processes. Journal of Experimental Social Psychology, 13, 279–301. doi:10.1016/0022-1031(77)90049-X
   Web of Science ®Google Scholar
• Rushton, C., Ramsey, P., & Rada, R. (1993). Peer assessment in a collaborative hypermedia environment: A case study. Journal of Computer-Based Instruction, 20, 75–80. Retrieved from https://www.ebsco.com/products/research-databases/inspec
   Web of Science ®Google Scholar
• Schönbrodt, F. D., Back, M. D., & Schmukle, S. C. (2012). Tripler: An R package for social relations analyses based on round-robin designs. Behavior Research Methods, 44, 455–470. doi:10.3758/s13428-011-0150-4
   PubMed Web of Science ®Google Scholar
• Scullen, E. S., Mount, M. K., & Goff, M. (2000). Understanding the latent structure of job performance ratings. The Journal of Applied Psychology, 85, 956–970. doi:10.1037/0021-9010.85.6.956
   PubMed Web of Science ®Google Scholar
• Shore, T. H., Shore, L. M., & Thornton, G. C. III (1992). Construct validity of self-and peer evaluations of performance dimensions in an assessment center. Journal of Applied Psychology, 77, 42–54. doi:10.1037/0021-9010.77.1.42
   Web of Science ®Google Scholar
• Speyer, R., Pilz, W., Van Der Kruis, J., & Brunings, J. W. (2011). Reliability and validity of student peer assessment in medical education: A systematic review. Medical Teacher, 33, e572–e585. doi:10.3109/0142159X.2011.610835
   PubMed Web of Science ®Google Scholar
• Topping, K. J. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68, 249–276. doi:10.3102/00346543068003249
   Web of Science ®Google Scholar
• Topping, K. J., Smith, E. F., Swanson, I., & Elliot, A. (2000). Formative peer assessment of academic writing between postgraduate students. Assessment & Evaluation in Higher Education, 25, 149–169. doi:10.1080/713611428
   Web of Science ®Google Scholar
• Towns, M. H., Kreke, K., & Fields, A. (2000). An action research project: Student perspectives on small group learning in chemistry. Journal of Chemical Education, 77, 111–115. doi:10.1021/ed077p111
   Web of Science ®Google Scholar
• Trempy, J. E., Skinner, M. M., & Siebold, W. A. (2002). Learning microbiology through cooperation: Designing cooperative learning activities that promote interdependence, interaction, and accountability. Journal of Microbiology & Biology Education, 3, 26–36. doi:10.1128/154288102X14285807693547
   Google Scholar
• Tuckman, B. W., & Jensen, M. A. (1977). Stages of small-group development revisited. Group & Organization Studies, 2, 419–427. doi:10.1177/105960117700200404
   Google Scholar
• Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557–574. doi:10.1037/0021-9010.81.5.557
   Web of Science ®Google Scholar
• Watson, D., Hubbard, B., & Wiese, D. (2000). Self-other agreement in personality and affectivity: The role of acquaintanceship, trait visibility, and assumed similarity. Journal of Personality and Social Psychology, 78, 546–558. doi:10.1037/0022-3514.78.3.546
   PubMed Web of Science ®Google Scholar
• Willey, K., & Freeman, M. (2006). Improving teamwork and engagement: The case for self and peer assessment. Australian Journal of Engineering Education, 2, 1–19. Retrieved from http://www.aaee.net.au/index.php/aaee-journal
   Google Scholar
• Yazici, H. J. (2005). A study of collaborative learning style and team learning performance. Education and Training, 47, 216–229. doi:10.1108/00400910510592257
   Google Scholar
• Zedeck, S., & Goldstein, I. L. (2000). The relationship between I/O psychology and public policy: A commentary. In J. F. Kehoe (Ed.), Managing selection in changing organizations (pp. 371–396). San Francisco, CA: Jossey-Bass.
   Google Scholar