1,916
Views
27
CrossRef citations to date
0
Altmetric
Original Articles

“I don't see me like you see me, but is that a problem?” Cultural influences on rating discrepancy in 360-degree feedback instruments

, , &
Pages 259-278 | Published online: 12 Mar 2009

References

  • Atwater , L. E. and Brett , J. F. 2005 . Antecedents and consequences of reactions to developmental 360° feedback . Journal of Vocational Behavior , 66 : 532 – 548 .
  • Atwater , L. E. , Ostroff , C. , Yammarino , F. J. and Fleenor , J. W. 1998 . Self-other agreement: Does it really matter? . Personnel Psychology , 51 ( 3 ) : 577 – 598 .
  • Atwater , L. , Waldman , D. , Ostroff , C. , Robie , C. and Johnson , K. M. 2005 . Self-other agreement: Comparing its relationship with performance in the US and Europe . International Journal of Selection and Assessment , 13 : 25 – 40 .
  • Atwater , L. E. and Yammarino , F. 1997 . Self-other rating agreement: A review and model . Research in Personnel and Human Resources Management , 15 : 141 – 164 .
  • Badjo , L. M. and Dickson , M. W. 2001 . Perception of organizational culture and women's advancement in organizations: A cross-cultural examination . Sex Roles , 45 ( 5/6 ) : 399 – 414 .
  • Bliese , P. D. 2000 . “ Within-group agreement, non-independence, and reliability: Implications for data aggregation and analyses ” . In Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions , Edited by: Klein , K. J. and Kozlowski , S. W. J. 349 – 381 . San Francisco : Jossey-Bass .
  • Bliese , P. D. 2002 . “ Multilevel random coefficient modeling in organizational research: Examples using SAS and S-PLUS ” . In Measuring and analyzing behavior in organizations: Advances in measurement and data analysis , Edited by: Drasgow , F. and Schmitt , N. 401 – 445 . San Francisco : Jossey-Bass .
  • Braddy , P. W. , Fleenor , J. W. and Campbell , M. Methods for reducing the length of 360-degree instruments. Paper presented at the 23rd annual conference of the Society for Industrial and Organizational Psychology . San, Francisco.
  • Brodbeck , F. C. 2000 . Cultural variation of leadership prototypes across 22 European countries . Journal of Occupational and Organizational Psychology , 73 ( 1 ) : 1 – 29 .
  • Brutus , S. , Fleenor , J. W. and London , M. 1998 . Does 360-degree feedback work in different industries? A between-industry comparison of the reliability and validity of multi-source performance ratings . Journal of Management Development , 17 : 177 – 190 .
  • Brutus , S. , Fleenor , J. W. and McCauley , C. D. 1999 . Demographic and personality predictors of congruence in multi-source ratings . Journal of Management Development , 18 : 417 – 435 .
  • Brutus , S. , Leslie , J. B. and McDonald-Mann , D. 2001 . “ Cross-cultural issues in multisource feedback ” . In Handbook of multisource feedback , Edited by: Bracken , D. , Timmreck , C. and Church , A. 433 – 446 . San Francisco : Jossey-Bass .
  • Carl , D. , Gupta , V. and Javidan , M. 2004 . “ Power distance ” . In Culture, leadership, and organizations: The GLOBE study of 62 societies , Edited by: House , R. J. , Hanges , P. J. , Javidan , M. , Dorfman , P. W. and Gupta , V. 513 – 563 . Thousand Oaks, CA : Sage .
  • Carty , H. M. 2003 . “ Review of BENCHMARKS®[revised] ” . In The fifteenth mental measurements yearbook , Edited by: Plake , B. S. , Impara , J. and Spies , R. A. 123 – 124 . Lincoln, NE : Buros Institute of Mental Measurements .
  • Center for Creative Leadership . 2004 . BENCHMARKS® facilitator's manual , Greensboro, NC : Center for Creative Leadership .
  • Conway , J. M. 2000 . Managerial performance development constructs and personality correlates . Human Performance , 13 : 23 – 46 .
  • Dalessio , A. T. 1998 . “ Using multi-source feedback for employee development and personnel decisions ” . In Performance appraisal: State-of-the-art in practice , Edited by: Smither , J. W. 278 – 330 . San Francisco : Jossey-Bass .
  • Dansereau , F. , Graen , G. and Haga , W. J. 1975 . A vertical dyad linkage approach to leadership within formal organizations: A longitudinal investigation of the role making process . Organizational Behavior and Human Performance , 13 : 46 – 78 .
  • Den Hartog , D. N. , House , R. J. , Hanges , P. J. , Ruiz-Quintanilla , S. A. , Dorfman , P. W. and GLOBE co-authors . 1999 . Culture specific and cross-culturally generalizable implicit leadership theories: Are attributes of charismatic/transformational leadership universally endorsed? . Leadership Quarterly , 10 ( 2 ) : 219 – 256 .
  • Douglas , C. A. 2003 . Key events and lessons for managers in a diverse workforce: A report on research and findings , Greensboro, NC : Center for Creative Leadership .
  • Edwards , J. R. 1994 . The study of congruence in organizational behavior research: Critique and proposed alternative . Organizational Behavior and Human Decision Processes , 58 : 51 – 100 .
  • Edwards , J. R. 1995 . Alternatives to difference scores as dependent variables in the study of congruence in organizational research . Organizational Behavior and Human Decision Processes , 64 : 307 – 324 .
  • Ensari , N. and Murphy , S. E. 2003 . Cross-cultural variations in leadership perceptions and attribution of charisma to the leader . Organizational Behavior and Human Decision Processes , 92 ( 1–2 ) : 52 – 66 .
  • Feldman , D. C. and Bolino , M. C. 1999 . The impact of on-site mentoring on expatriate socialisation: A structural equation modelling approach . International Journal of Human Resource Management , 10 ( 1 ) : 54 – 71 .
  • Fleenor , J. W. , McCauley , C. D. and Brutus , S. 1996 . Self-other rating agreement and leader effectiveness . Leadership Quarterly , 7 : 487 – 506 .
  • Gentry , W. A. , Hannum , K. M. , Ekelund , B. Z. and de Jong , A. 2007 . A study of the discrepancy between self- and observer-ratings on managerial derailment characteristics of European managers . European Journal of Work and Organizational Psychology , 16 : 295 – 325 .
  • Gerstner , C. R. and Day , D. V. 1994 . Cross-cultural comparison of leadership prototypes . Leadership Quarterly , 5 ( 2 ) : 121 – 134 .
  • Greguras , G. J. and Robie , C. 1998 . A new look at within-source interrater reliability of 360-degree feedback ratings . Journal of Applied Psychology , 83 : 960 – 968 .
  • Harris , M. M. and Schaubroeck , J. 1988 . A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings . Personnel Psychology , 41 : 43 – 61 .
  • Hofstede , G. 1984 . Culture's consequences: International differences in work-related values, Vol. 2 , Newbury Park, CA : Sage .
  • House R. J. Hanges P. J. Javidan M. Dorfman P. W. Gupta V. Culture, leadership, and organizations: The GLOBE study of 62 societies Thousand Oaks, CA Sage 2004
  • James , L. R. 1988 . “ Organizational climate: Another look at a potentially important construct ” . In Applications of interactionist psychology: Essays in honor of Saul B. Sells , Edited by: Cole , S. G. and Demaree , R. G. 253 – 282 . Hillsdale, NJ : Lawrence Erlbaum Associates, Inc .
  • Johns , G. 1981 . Difference score measures of organizational behavior variables: A critique . Organizational Behavior and Human Performance , 27 : 443 – 463 .
  • Kulas , J. T. and Finkelstein , L. M. 2007 . Content and reliability of discrepancy-defined self-awareness in multisource feedback . Organizational Research Methods , 10 ( 3 ) : 502 – 522 .
  • Lindell , M. K. , Brandt , C. J. and Whitney , D. J. 1999 . A revised index of interrater agreement for multi-item ratings of a single target . Applied Psychological Measurement , 23 : 127 – 135 .
  • Lombardo , M. M. and McCauley , C. D. 1994 . BENCHMARKS®: A manual and trainer's guide , Greensboro, NC : Center for Creative Leadership .
  • Lombardo , M. M. , McCauley , C. D. , McDonald-Mann , D. and Leslie , J. B. 1999 . BENCHMARKS® developmental reference points , Greensboro, NC : Center for Creative Leadership .
  • London , M. and Smither , J. W. 1995 . Can multi-source feedback change self-evaluations, skill development, and performance? Theory-based applications and directions for research . Personnel Psychology , 48 : 375 – 390 .
  • Lord , R. G. and Maher , K. J. 1991 . Leadership and information processing: Linking perceptions and performance , London : Routledge .
  • McCauley , C. , Lombardo , M. and Usher , C. 1989 . Diagnosing management development needs: An instrument based on how managers develop . Journal of Management , 15 : 389 – 403 .
  • Merritt , A. C. 2000 . Culture in the cockpit: Do Hofstede's dimensions replicate . Journal of Cross-Cultural Psychology , 31 : 283 – 301 .
  • Morgeson , F. P. , Mumford , T. V. and Campion , C. A. 2005 . Coming full circle: Using research and practice to address 27 questions about 360-degree feedback programs . Consulting Psychology Journal: Practice and Research , 57 : 196 – 209 .
  • Mount , M. K. , Judge , T. A. , Scullen , T. E. , Sytsma , M. R. and Hezlett , S. A. 1998 . Trait, rater, and level effects in 360-degree performance ratings . Personnel Psychology , 51 : 557 – 576 .
  • Muthén , L. and Muthén , B. 2006 . Mplus (Version 4.0) , Los Angeles : Author . [Computer software]
  • Ostroff , C. , Atwater , L. E. and Feinberg , B. J. 2004 . Understanding self-other agreement: A look at rater and ratee characteristics, context, and outcomes . Personnel Psychology , 57 : 333 – 375 .
  • Sala , F. 2003 . Executive blind spots: Discrepancies between self- and other-ratings . Consulting Psychology Journal , 55 : 222 – 229 .
  • Satorra , A. 2000 . “ Scaled and adjusted restricted tests in multi-sample analysis of moment structures ” . In Innovations in multivariate statistical analysis , Edited by: Heimans , R. D. H. , Pollock , D. S. G. and Satorra , A. 233 – 247 . London : Kluwer Academic Publishers .
  • Schermerhorn , J. R. and Bond , M. H. 1997 . Cross-cultural leadership dynamics in collectivism and high power distance settings . Leadership and Organization Development Journal , 18 ( 4 ) : 187 – 193 .
  • Schyns , B. 2006 . The role of implicit leadership theories in the performance appraisals and promotion recommendations of leaders . Equal Opportunities International , 25 ( 3 ) : 188 – 199 .
  • Shipper , F. , Hoffman , R. C. I. and Rotondo , D. M. 2007 . Does the 360 feedback process create actionable knowledge equally across cultures? . Academy of Management Learning and Education , 6 ( 1 ) : 33 – 50 .
  • Spangler , M. 2003 . “ Review of BENCHMARKS®[revised] ” . In The fifteenth mental measurements yearbook , Edited by: Plake , B S. , Impara , J. and Spies , R A. 124 – 126 . Lincoln, NE : Buros Institute of Mental Measurements .
  • Spector , P. E. , Cooper , C. L. and Sparks , K. 2001 . An international study of the psychometric properties of the Hofstede Values Survey Module 1994: A comparison of individual and country/province level results . Applied Psychology: An International Review , 50 ( 2 ) : 269 – 281 .
  • Stark , E. , Hansen , J. and Thomas , L. T. A field study of accuracy, agreement, and outcomes of multi-source feedback: Implications across international boundaries . Paper presented at the international conference of the Academy of Business and Administrative Sciences .
  • Sullivan , D. M. , Mitchell , M. and Uhl-Bien , M. 2003 . “ The new conduct of business: How LMX can help capitalize on cultural diversity ” . In Dealing with diversity , Edited by: Graen , G. 183 – 218 . Charlotte, NC : Information Age .
  • Sully de Luque , M. F. and Sommer , S. M. 2000 . The impact of culture on feedback-seeking behavior: An integrated model and propositions . Academy of Management Review , 25 : 829 – 849 .
  • Tornow , W. W. 1993 . Perceptions or reality: Is multi-perspective measurement a means or an end . Human Resource Management , 32 : 246 – 264 .
  • Van der Vegt , G. S. , van de Vliert , E. and Huang , X. 2005 . Location-level links between diversity and innovative climate depend on national power distance . Academy of Management Journal , 48 ( 6 ) : 1171
  • Van Velsor , E. and Leslie , J. B. 1991 . Feedback to managers: Vol. 1. A guide to evaluating multi-rater feedback instruments , Greensboro, NC : Center for Creative Leadership .
  • Wohlers , A. and London , M. 1989 . Ratings of managerial characteristics: Evaluation difficulty, co-worker agreement and self-awareness . Personnel Psychology , 42 : 235 – 261 .
  • Yammarino , F. 2003 . Modern data analytic techniques for multisource feedback . Organizational Research Methods , 6 : 6 – 14 .
  • Yammarino , F. and Atwater , L. 1993 . Understanding self-perception accuracy: Implications for human resource management . Human Resource Management , 32 ( 2/3 ) : 231 – 247 .
  • Zedeck , S. 1995 . “ Review of BENCHMARKS® ” . In The twelfth mental measurements yearbook , Edited by: Conoley , J. and Impara , J. Vol. 1 , 128 – 129 . Lincoln, NE : Buros Institute of Mental Measurements .

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.