Creation and Validation of the Performance Appraisal Motivation Scale (PAMS)

References

• Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179–211. doi:10.1016/0749-5978(91)90020-T
   Web of Science ®Google Scholar
• Anderson, J. C., & Gerbing, D. W. (1991). Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. Journal of Applied Psychology, 76, 732–740. doi:10.1037/0021-9010.76.5.732
   Web of Science ®Google Scholar
• Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191–215. doi:10.1037/0033-295X.84.2.191
   PubMed Web of Science ®Google Scholar
• Bernardin, H. J., & Villanova, P. (2005). Research streams in rater self-efficacy. Group & Organization Management, 30, 61–88. doi:10.1177/1059601104267675
   Web of Science ®Google Scholar
• Berry, C. M., Sackett, P. R., & Wiemann, S. (2007). A review of recent developments in integrity test research. Personnel Psychology, 60, 271–301. doi:10.1111/j.1744-6570.2007.00074.x
   Web of Science ®Google Scholar
• Binning, J. F., & Barrett, G. V. (1989). Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases. Journal of Applied Psychology, 74, 478–494. doi:10.1037/0021-9010.74.3.478
   Web of Science ®Google Scholar
• Blanton, H., & Jaccard, J. (2006). Arbitrary metrics in psychology. American Psychologist, 61, 27–41. doi:10.1037/0003-066X.61.1.27
   PubMed Web of Science ®Google Scholar
• Cheung, J. H., Burns, D. K., Sinclair, R. R., & Sliter, M. (2017). Amazon Mechanical Turk in organizational psychology: An evaluation and practical recommendations. Journal of Business and Psychology, 32, 347–361. doi:10.1007/s10869-016-9458-5
   Web of Science ®Google Scholar
• Cleveland, J. N., & Murphy, K. R. (1992). Analyzing performance appraisal as goal-directed behavior. Research in Personnel and Human Resources Management, 10, 121–185.
   Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Costa, P. T., & McCrae, R. R. (1992). Four ways five factors are basic. Personality and Individual Differences, 13, 653–665. doi:10.1016/0191-8869(92)90236-I
   Web of Science ®Google Scholar
• Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302. doi:10.1037/h0040957
   PubMed Web of Science ®Google Scholar
• Dahling, J. J., Whitaker, B. G., & Levy, P. E. (2009). The development and validation of a new Machiavellianism scale. Journal of Management, 35, 219–257. doi:10.1177/0149206308318618
   Web of Science ®Google Scholar
• Davey, L. M., Bobocel, D. R., Hing, L. S. S., & Zanna, M. P. (1999). Preference for the Merit Principle Scale: An individual difference measure of distributive justice preferences. Social Justice Research, 12, 223–240. doi:10.1023/A:1022148418210
   Google Scholar
• DeNisi, A. S., Cafferty, T. P., & Meglino, B. M. (1984). A cognitive view of the performance appraisal process: A model and research propositions. Organizational Behavior and Human Performance, 33, 360–396. doi:10.1016/0030-5073(84)90029-1
   Web of Science ®Google Scholar
• DeNisi, A. S., & Murphy, K. R. (2017). Performance appraisal and performance management: 100 years of progress? Journal of Applied Psychology, 102, 421–433. doi:10.1037/apl0000085
   PubMed Web of Science ®Google Scholar
• DeNisi, A. S., & Peters, L. H. (1996). Organization of information in memory and the performance appraisal process: Evidence from the field. Journal of Applied Psychology, 81, 717–737. doi:10.1037/0021-9010.81.6.717
   PubMed Web of Science ®Google Scholar
• DeNisi, A. S., & Sonesh, S. (2011). The appraisal and management of performance at work. APA Handbook of Industrial and Organizational Psychology, 2, 255–279.
   Google Scholar
• Donovan, J. J., Bateman, T., & Heggestad, E. D. (2013). Individual differences in work motivation: Current directions and future needs. In N. D. Christiansen & R. P. Tett (Eds.), Handbook of personality at work (pp. 101–128). New York, NY: Routledge.
   Google Scholar
• Furnham, A., & Chamorro-Premuzic, T. (2004). Estimating one’s own personality and intelligence scores. British Journal of Psychology, 95, 149–160. doi:10.1348/000712604773952395
   PubMed Web of Science ®Google Scholar
• Furr, M. R. (2018). Psychometrics: An introduction (3rd ed.). Thousand Oaks, CA: SAGE Publications.
   Google Scholar
• Goldberg, L. R. (1999). A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models. In I. Mervielde, I. Deary, F. De Fruyt, & F. Ostendorf (Eds.), Personality psychology in Europe (Vol. 7, pp. 7–28). Tilburg, The Netherlands: Tilburg University Press.
   Google Scholar
• Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. C. (2006). The international personality item pool and the future of public-domain personality measures. Journal of Research in Personality, 40, 84–96. doi:10.1016/j.jrp.2005.08.007
   Web of Science ®Google Scholar
• Gorman, C. A., & Rentsch, J. R. (2016). Retention of assessment center rater training. Journal of Personnel Psychology, 16, 1–11. doi:10.1027/1866-5888/a000167
   Web of Science ®Google Scholar
• Harari, M. B., & Rudolph, C. W. (2017). The effect of rater accountability on performance ratings: A meta-analytic review. Human Resource Management Review, 27, 121–133. doi:10.1016/j.hrmr.2016.09.007
   Web of Science ®Google Scholar
• Harari, M. B., Rudolph, C. W., & Laginess, A. J. (2015). Does rater personality matter? A meta‐analysis of rater Big Five–performance rating relationships. Journal of Occupational and Organizational Psychology, 88, 387–414. doi:10.1111/joop.12086
   Web of Science ®Google Scholar
• Harris, M. M. (1994). Rater motivation in the performance appraisal context: A theoretical framework. Journal of Management, 20, 735–756. doi:10.1177/014920639402000403
   Web of Science ®Google Scholar
• Hedge, J. W., & Teachout, M. S. (2000). Exploring the concept of acceptability as a criterion for evaluating performance measures. Group & Organization Management, 25, 22–44. doi:10.1177/1059601100251003
   Web of Science ®Google Scholar
• Heft, L. L. (1999). Performance evaluation: The effects of rating purpose, accountability, and multiple rater status on rating leniency, effort, and rater reactions ( Available from ProQuest Dissertations & Theses A&I).
   Google Scholar
• Heggestad, E. D., Scheaf, D. J., Banks, G. C., Hausfeld, M. M., Tonidandel, S., & Williams, E. B. (2019). Scale adaption in organizational science research: A review and best-practice recommendations. Journal of Management, 45, 2596–2627. doi:10.1177/0149206319850280
   Web of Science ®Google Scholar
• Hinkin, T. R., & Tracey, J. B. (1999). An analysis of variance approach to content validation. Organizational Research Methods, 2, 175–186. doi:10.1177/109442819922004
   Web of Science ®Google Scholar
• Huff, C., & Tingley, D. (2015). “Who are these people?”: Evaluating the demographic characteristics and political preferences of MTurk survey respondents. Research and Politics, 2, 1–12. doi:10.1177/2053168015604648
   Web of Science ®Google Scholar
• Jawahar, I. M., & Williams, C. R. (1997). Where all the children are above average: The performance appraisal purpose effect. Personnel Psychology, 50, 905–925. doi:10.1111/j.1744-6570.1997.tb01487.x
   Web of Science ®Google Scholar
• Jones, D. N., & Paulhus, D. L. (2009). Machiavellianism. In M. R. Leary & R. H. Hoyle (Eds.), Handbook of individual differences in social behavior (pp. 93–108). New York, NY: Guilford.
   Google Scholar
• Kerst, M. (1993). Rating goals as a function of appraisal purpose and ratee performance level ( Unpublished Master’s Thesis). Fort Collins: Colorado State University.
   Google Scholar
• Kinicki, A. J., Jacobson, K. J., Peterson, S. J., & Prussia, G. E. (2013). Development and validation of a performance management behavior questionnaire. Personnel Psychology, 66, 1–45. doi:10.1111/peps.12013
   Web of Science ®Google Scholar
• Klimoski, R., & Inks, L. (1990). Accountability forces in performance appraisal. Organizational Behavior and Human Decision Processes, 45, 194–208. doi:10.1016/0749-5978(90)90011-W
   Web of Science ®Google Scholar
• Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284. doi:10.1037/0033-2909.119.2.254
   Web of Science ®Google Scholar
• Kluger, A. N., & Nir, D. (2010). The feedforward interview. Human Resource Management Review, 20, 235–246. doi:10.1016/j.hrmr.2009.08.002
   Web of Science ®Google Scholar
• Kozlowski, S. W., Chao, G. T., & Morrison, R. F. (1998). Games raters play: Politics, strategies, and impression management in performance appraisal. In J. W. Smither (Ed.), Performance appraisal: State of the art in practice (pp. 163–205). San Francisco, CA: Jossey-Bass.
   Google Scholar
• Landers, R. N., & Behrend, T. S. (2015). An inconvenient truth: Arbitrary distinctions between organizational, Mechanical Turk, and other convenience samples. Industrial & Organizational Psychology, 8, 142–164. doi:10.1017/iop.2015.13
   Google Scholar
• Landy, F. J., & Farr, J. L. (1980). Performance rating. Psychological Bulletin, 87, 72–107. doi:10.1037/0033-2909.87.1.72
   Web of Science ®Google Scholar
• Latané, B. (1981). The psychology of social impact. American Psychologist, 36, 343–356. doi:10.1037/0003-066X.36.4.343
   Web of Science ®Google Scholar
• Levy, P. E., & Williams, J. R. (2004). The social context of performance appraisal: A review and framework for the future. Journal of Management, 30, 881–905. doi:10.1016/j.jm.2004.06.005
   Web of Science ®Google Scholar
• Longenecker, C. O., Sims, J. H., & Gioia, D. A. (1987). Behind the mask: The politics of employee appraisal. Academy of Management Perspectives, 1, 183–193. doi:10.5465/ame.1987.4275731
   Google Scholar
• Mabe, P. A., & West, S. G. (1982). Validity of self-evaluation of ability: A review and meta-analysis. Journal of Applied Psychology, 67, 280–296. doi:10.1037/0021-9010.67.3.280
   Web of Science ®Google Scholar
• Mason, W., & Suri, S. (2012). Conducting behavioral research on Amazon’s Mechanical Turk. Behavior Research Methods, 44, 1–23. doi:10.3758/s13428-011-0124-6
   PubMed Web of Science ®Google Scholar
• McGregor, D. (1957). An uneasy look at performance appraisal. Harvard Business Review, 35, 89–94.
   Web of Science ®Google Scholar
• Mero, N. P., Guidice, R. M., & Brownlee, A. L. (2007). Accountability in a performance appraisal context: The effect of audience and form of accounting on rater response and behavior. Journal of Management, 33, 223–252. doi:10.1177/0149206306297633
   Web of Science ®Google Scholar
• Mero, N. P., & Motowidlo, S. J. (1995). Effects of rater accountability on the accuracy and the favorability of performance ratings. Journal of Applied Psychology, 80, 517–524. doi:10.1037/0021-9010.80.4.517
   Web of Science ®Google Scholar
• Murphy, K. R., & Cleveland, J. N. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA: SAGE Publications.
   Google Scholar
• Murphy, K. R., Cleveland, J. N., & Hanscom, M. E. (2018). Performance appraisal and management. Thousand Oaks, CA: SAGE Publications.
   Google Scholar
• Murphy, K. R., Cleveland, J. N., Skattebo, A. L., & Kinney, T. B. (2004). Raters who pursue different goals give different ratings. Journal of Applied Psychology, 89, 158–164. doi:10.1037/0021-9010.89.1.158
   PubMed Web of Science ®Google Scholar
• Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of personality and social-psychological attitudes (pp. 17–59). San Diego, CA: Academic Press.
   Google Scholar
• Pulakos, E. D., Hanson, R. M., Arad, S., & Moye, N. (2015). Performance management can be fixed: An on-the-job experiential learning approach for complex behavior change. Industrial and Organizational Psychology, 8, 51–76. doi:10.1017/iop.2014.2
   Google Scholar
• Pulakos, E. D., & O’Leary, R. S. (2011). Why is performance management broken? Industrial and Organizational Psychology, 4, 146–164. doi:10.1111/j.1754-9434.2011.01315.x
   Google Scholar
• Roch, S. G., Woehr, D. J., Mishra, V., & Kieszczynska, U. (2012). Rater training revisited: An updated meta‐analytic review of frame‐of‐reference training. Journal of Occupational and Organizational Psychology, 85, 370–395. doi:10.1111/j.2044-8325.2011.02045.x
   Web of Science ®Google Scholar
• Rosen, C. C., Kacmar, K. M., Harris, K. J., Gavin, M. B., & Hochwarter, W. A. (2017). Workplace politics and performance appraisal: A two-study, multilevel field investigation. Journal of Leadership & Organizational Studies, 24, 20–38. doi:10.1177/1548051816661480
   Web of Science ®Google Scholar
• Salgado, J. F. (2002). The Big Five personality dimensions and counterproductive behaviors. International Journal of Selection and Assessment, 10, 117–125. doi:10.1111/1468-2389.00198
   Web of Science ®Google Scholar
• Son Hing, L. S., Bobocel, D. R., Zanna, M. P., Garcia, D. M., Gee, S. S., & Orazietti, K. (2011). The merit of meritocracy. Journal of Personality and Social Psychology, 101, 433–450. doi:10.1037/a0024618
   PubMed Web of Science ®Google Scholar
• Speer, A. B., Tenbrink, A. P., & Schwendeman, M. G. (2019). Let’s talk it out: The effects of calibration meetings on the accuracy of performance ratings. Human Performance, 32, 107–128. Online Advance. doi:10.1080/08959285.2019.1609477
   Web of Science ®Google Scholar
• Spence, J. R., & Keeping, L. (2011). Conscious rating distortion in performance appraisal: A review, commentary, and proposed framework for research. Human Resource Management Review, 21, 85–95. doi:10.1016/j.hrmr.2010.09.013
   Web of Science ®Google Scholar
• Spence, J. R., & Keeping, L. M. (2010). The impact of non‐performance information on ratings of job performance: A policy‐capturing approach. Journal of Organizational Behavior, 31, 587–608. doi:10.1002/job.648
   Web of Science ®Google Scholar
• Spence, J. R., & Keeping, L. M. (2013). The road to performance is paved with intentions: A framework for understanding managers’ intentions when rating employee performance. Organizational Psychology Review, 3, 360–383. doi:10.1177/2041386613485969
   Web of Science ®Google Scholar
• Steelman, L. A., Levy, P. E., & Snell, A. F. (2004). The feedback environment scale: Construct definition, measurement, and validation. Educational and Psychological Measurement, 64, 165–184. doi:10.1177/0013164403258440
   Web of Science ®Google Scholar
• Taylor, M. S., Renard, M. K., & Tracy, K. B. (1998). Managers’ reactions to procedurally just performance management systems. Academy of Management Journal, 5, 568–579.
   Google Scholar
• Tziner, A., Latham, G. P., Price, B. S., & Haccoun, R. (1996). Development and validation of a questionnaire for measuring perceived political considerations in performance appraisal. Journal of Organizational Behavior, 17, 179–190. doi:10.1002/(SICI)1099-1379(199603)17:2<179::AID-JOB740>3.0.CO;2-Z
   Web of Science ®Google Scholar
• Tziner, A., & Murphy, K. R. (1999). Additional evidence of attitudinal influences in performance appraisal. Journal of Business and Psychology, 13, 407–419. doi:10.1023/A:1022982501606
   Web of Science ®Google Scholar
• Van Eerde, W., & Thierry, H. (1996). Vroom’s expectancy models and work-related criteria: A meta-analysis. Journal of Applied Psychology, 81, 575–586. doi:10.1037/0021-9010.81.5.575
   Web of Science ®Google Scholar
• Vecchio, R. P. (1998). Leader-member exchange, objective performance, employment duration, and supervisor ratings: Testing for moderation and mediation. Journal of Business and Psychology, 12, 327–341. doi:10.1023/A:1025027514081
   Web of Science ®Google Scholar
• Villanova, P., Bernardin, H. J., Dahmus, S. A., & Sims, R. L. (1993). Rater leniency and performance appraisal discomfort. Educational and Psychological Measurement, 53, 789–799. doi:10.1177/0013164493053003023
   Web of Science ®Google Scholar
• Vroom, V. H. (1964). Work and motivation. New York, NY: Wiley.
   Google Scholar
• Wang, X. M., Wong, K. F. E., & Kwong, J. Y. (2010). The roles of rater goals and ratee performance levels in the distortion of performance ratings. Journal of Applied Psychology, 95, 546–561. doi:10.1037/a0018866
   PubMed Web of Science ®Google Scholar
• Whisler, T. (1958). Performance appraisal and the organization man. Journal of Business, 31, 19–27. doi:10.1086/294167
   Google Scholar
• Woehr, D. J., & Huffcutt, A. I. (1994). Rater training for performance appraisal: A quantitative review. Journal of Occupational and Organizational Psychology, 67, 189–205. doi:10.1111/j.2044-8325.1994.tb00562.x
   Web of Science ®Google Scholar
• Wong, K. F. E., & Kwong, J. Y. (2007). Effects of rater goals on rating patterns: Evidence from an experimental field study. Journal of Applied Psychology, 92, 577–585. doi:10.1037/0021-9010.92.2.577
   PubMed Web of Science ®Google Scholar