Extending the Nomological Network of Assessment Center Construct Validity: Prediction of Cross-Situationally Consistent and Specific Aspects of Assessment Center Performance

REFERENCES

• Arthur , W. Jr. , Day , E. A. , McNelly , T. L. and Edens , P. S. 2003 . A meta-analysis of the criterion-related validity of assessment center dimensions. . Personnel Psychology , 56 : 125 – 154 .
   Web of Science ®Google Scholar
• Bagozzi , R. P. and Edwards , J. R. 1998 . A general approach to construct validation in organizational research: Application to the measurement of work values. . Organizational Research Methods , 1 : 45 – 87 .
   Web of Science ®Google Scholar
• Barrick , M. R. and Mount , M. K. 1991 . The Big Five personality dimensions and job performance: A meta-analysis. . Personnel Psychology , 44 : 1 – 26 .
   Web of Science ®Google Scholar
• Barrick , M. R. , Mount , M. K. and Judge , T. A. 2001 . Personality and performance at the beginning of the new millennium: What do we know and where do we go next? . International Journal of Selection and Assessment , 9 : 9 – 30 .
   Web of Science ®Google Scholar
• Borman , W. C. , White , L. A. and Dorsey , D. W. 1995 . Effects of task performance and interpersonal factors on supervisor and peer performance ratings. . Journal of Applied Psychology , 80 : 168 – 177 .
   Web of Science ®Google Scholar
• Bowler , M. C. and Woehr , D. J. 2006 . A meta-analytic evaluation of the impact of dimension and exercise factors on assessment center ratings. . Journal of Applied Psychology , 91 : 1114 – 1124 .
   PubMed Web of Science ®Google Scholar
• Brannick , M. T. and Spector , P. E. 1990 . Estimation problems in the block-diagonal model of the multitrait-multimethod matrix. . Applied Psychological Measurement , 14 : 325 – 339 .
   Web of Science ®Google Scholar
• Bray , D. W. , Campbell , R. J. and Grant , D. L. 1974 . Formative years in business: A long-term AT&T study of managerial lives. , New York : Wiley .
   Google Scholar
• Bray , D. W. and Grant , D. L. 1966 . The assessment center in the measurement of potential for business management. . Psychological Monographs , 80 ( 17, Whole No. 625 ) : 1 – 27 .
   PubMedGoogle Scholar
• Browne , M. W. 1984 . The decomposition of multitrait–multimethod matrices. . British Journal of Mathematical and Statistical Psychology , 33 : 184 – 199 .
   Google Scholar
• Conway , J. M. , Lievens , F. , Scullen , S. E. and Lance , C. E. 2004 . Bias in the correlated uniqueness model for MTMM data. . Structural Equation Modeling , 11 : 535 – 559 .
   Web of Science ®Google Scholar
• Cooper , W. 1981 . Ubiquitous halo. . Psychological Bulletin , 90 : 218 – 244 .
   Web of Science ®Google Scholar
• Craik , K. H. , Ware , A. P. , Kamp , J. , O'Reilly , C. III , Staw , B. and Zedeck , S. 2002 . Explorations of construct validity in a combined managerial and personality assessment programme. . Journal of Occupational and Organizational Psychology , 75 : 171 – 193 .
   Google Scholar
• Digman , J. M. 1990 . “ Personality structure: Emergence of the five-factor model. ” . In Annual review of psychology , Edited by: Rosenzweig , M. R. and Porter , L. W. Vol. 41 , 417 – 440 . Palo Alto, CA : Annual Reviews .
   Google Scholar
• Donahue , L. M. , Truxillo , D. M. , Cornwell , J. M. and Gerrity , M. J. 1997 . Assessment center construct validity and behavioral checklists: Some additional findings. . Journal of Social Behavior and Personality , 12 ( 5 ) : 85 – 108 .
   Google Scholar
• Eurich , T. L. , Krause , D. E. , Cigularov , K. and Thornton , G. C. May 2006 . Assessment centers: Current practices in the United States. May , Paper presented at the meeting of the Society for Industrial and Organizational Psychology, Dallas, TX.
   Google Scholar
• Fleenor , J. W. 1996 . Constructs and developmental assessment centers: Further troubling empirical findings. . Journal of Business and Psychology , 10 : 319 – 335 .
   Web of Science ®Google Scholar
• Gaugler , B. B. , Rosenthal , D. B. , Thornton , G. C. III and Bentson , C. 1987 . Meta-analysis of assessment center validity. . Journal of Applied Psychology , 72 : 493 – 511 .
   Web of Science ®Google Scholar
• Gaugler , B. B. and Thornton , G. C. III . 1989 . Number of assessment center dimensions as a determinant of assessor accuracy. . Journal of Applied Psychology , 74 : 611 – 618 .
   Web of Science ®Google Scholar
• Goffin , R. D. , Rothstein , M. G. and Johnston , N. G. 1996 . Personality testing and the assessment center: Incremental validity for managerial selection. . Journal of Applied Psychology , 81 : 746 – 756 .
   Web of Science ®Google Scholar
• Goldberg , L. R. 1990 . An alternative “description of personality”: The Big-Five factor structure. . Journal of Personality and Social Psychology , 59 : 1216 – 1229 .
   PubMed Web of Science ®Google Scholar
• Goldberg , L. R. 1992 . The development of markers for the Big-Five factor structure. . Psychological Assessment , 4 : 26 – 42 .
   Google Scholar
• Gossling , S. D. , Ko , S. J. , Mannarelli , T. and Morris , M. E. 2002 . A room with a cue: Personality judgments based on offices and bedrooms. . Journal of Personality and Social Psychology , 82 : 379 – 398 .
   Google Scholar
• Haaland , S. and Christiansen , N. D. 2002 . Implications of trait-activation theory for evaluating the construct validity of assessment center ratings. . Personnel Psychology , 55 : 137 – 163 .
   Web of Science ®Google Scholar
• Hardison , C. M. and Sackett , P. R. April 2004 . Assessment center criterion-related validity: A meta-analytic update. April , Paper presented at the meeting of the Society for Industrial and Organizational Psychology, Chicago.
   Google Scholar
• Hennessy , J. , Mabey , B. and Warr , P. 1998 . Assessment center observation procedures: An experimental comparison of traditional, checklist and coding methods. . International Journal of Selection and Assessment , 6 : 222 – 231 .
   Google Scholar
• Howard , A. 1997 . A reassessment of assessment centers: Challenges for the 21st century. . Journal of Social Behavior and Personality , 12 ( 5 ) : 13 – 52 .
   Google Scholar
• Hu , L. T. and Bentler , P. M. 1998 . Fit indices in covariance structure modeling: Sensitivity to underparameterization model misspecification. . Psychological Methods , 3 : 424 – 453 .
   Web of Science ®Google Scholar
• Hu , L. T. and Bentler , P. M. 1999 . Cutoff criteria for fit indexes in covariance structure analysis. . Structural Equation Modeling , 6 : 1 – 55 .
   Web of Science ®Google Scholar
• Hurtz , G. M. and Donovan , J. J. 2000 . Personality and job performance: The Big Five revisited. . Journal of Applied Psychology , 85 : 869 – 879 .
   PubMed Web of Science ®Google Scholar
• Jackson , D. J. R. , Stillman , J. A. and Atkins , S. G. 2005 . Rating tasks versus dimensions in assessment centers: A psychometric comparison. . Human Performance , 18 : 213 – 241 .
   Web of Science ®Google Scholar
• Jöreskog , K. G. and Sörbom , D. 1996 . LISREL 8: User's reference guide. , Chicago : Scientific Software .
   Google Scholar
• Kenny , D. A. and Kashy , D. A. 1992 . Analysis of the multitrait–multimethod matrix by confirmatory factor analysis. . Psychological Bulletin , 112 : 165 – 172 .
   Web of Science ®Google Scholar
• Klimoski , R. and Brickner , M. 1987 . Why do assessment centers work? The puzzle of assessment center validity. . Personnel Psychology , 40 : 243 – 260 .
   Web of Science ®Google Scholar
• Lance , C. E. and Bennett , W. Jr. 2000 . Replication and extension of models of supervisory performance ratings. . Human Performance , 13 : 139 – 158 .
   Web of Science ®Google Scholar
• Lance , C. E. , Foster , M. R. , Gentry , W. A. and Thoresen , J. D. 2004 . Assessor cognitive processes in an operational assessment center. . Journal of Applied Psychology , 89 : 22 – 35 .
   PubMed Web of Science ®Google Scholar
• Lance , C. E. , Lambert , T. A. , Gewin , A. G. , Lievens , F. and Conway , J. M. 2004 . Revised estimates of dimension and exercise variance components in assessment center postexercise dimension ratings. . Journal of Applied Psychology , 89 : 377 – 385 .
   PubMed Web of Science ®Google Scholar
• Lance , C. E. , Newbolt , W. H. , Gatewood , R. D. , Foster , M. R. , French , N. and Smith , D. E. 2000 . Assessment center exercise factors represent cross-situational specificity, not method bias. . Human Performance , 13 : 323 – 353 .
   Web of Science ®Google Scholar
• Lance , C. E. , Noble , C. L. and Scullen , S. E. 2002 . A critique of the correlated trait – correlated method (CTCM) and correlated uniqueness (CU) models for multitrait–multimethod (MTMM) data. . Psychological Methods , 7 : 228 – 244 .
   PubMed Web of Science ®Google Scholar
• Lievens , F. 1998 . Factors which improve the construct validity of assessment centers: A review. . International Journal of Selection and Assessment , 6 : 141 – 152 .
   Web of Science ®Google Scholar
• Lievens , F. 2001 . Assessor training strategies and their effects on accuracy, interrater reliability, and discriminant validity. . Journal of Applied Psychology , 86 : 255 – 264 .
   PubMed Web of Science ®Google Scholar
• Lievens , F. 2002 . Trying to understand the different pieces of the construct validity puzzle of assessment centers: An examination of assessor and assessee effects. . Journal of Applied Psychology , 87 : 675 – 686 .
   PubMedGoogle Scholar
• Lievens , F. , Chasteen , C. S. , Day , E. A. and Christiansen , N. D. 2006 . Large-scale investigation of the role of trait activation theory for understanding assessment center convergent and discriminant validity. . Journal of Applied Psychology , 91 : 247 – 258 .
   PubMed Web of Science ®Google Scholar
• Lievens , F. and Conway , J. M. 2001 . Dimensions and exercise variance in assessment center scores: A large-scale evaluation of multitrait–multimethod studies. . Journal of Applied Psychology , 86 : 1202 – 1222 .
   PubMed Web of Science ®Google Scholar
• Lievens , F. and Klimoski , R. J. 2001 . Understanding the assessment centre process: Where are we now? . International Review of Industrial and Organizational Psychology , 16 : 246 – 286 .
   Google Scholar
• Marsh , H. W. 1994 . Confirmatory factor analyses of factorial invariance: A multifaceted approach. . Structural Equation Modeling , 1 : 5 – 34 .
   Web of Science ®Google Scholar
• Marsh , H. W. and Bailey , M. 1991 . Confirmatory factor analysis of multitrait–multimethod data: A comparison of alternative models. . Applied Psychological Measurement , 15 : 47 – 70 .
   Web of Science ®Google Scholar
• Moses , J. L. and Byham , W. C. 1977 . Applying the assessment center method , New York : Pergamon .
   Google Scholar
• O*NET. (n.d.). Summary report for: 33–3051.01 – Police patrol officers. Retrieved September 7, 2005, from http://online.onetcenter.org/link/summary/33–3051.01
   Google Scholar
• Reilly , R. R. , Henry , S. and Smither , J. W. 1990 . An examination of the effects of using behavior checklists on the construct validity of assessment center dimensions. . Personnel Psychology , 43 : 71 – 84 .
   Web of Science ®Google Scholar
• Sackett , P. R. and Dreher , G. F. 1982 . Constructs and assessment center dimensions: Some troubling findings. . Journal of Applied Psychology , 67 : 401 – 410 .
   Web of Science ®Google Scholar
• Sackett , P. R. and Tuzinski , K. 2001 . “ The role of dimensions and exercises in assessment center judgments. ” . In How people evaluate others in organizations , Edited by: London , M. 111 – 129 . Mahwah, NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Sackett , P. R. and Yang , H. 2003 . Correction for range restriction: An expanded typology. . Journal of Applied Psychology , 85 : 112 – 118 .
   Google Scholar
• Sagie , A. and Magnezy , R. 1997 . Assessor type, number of distinguishable categories, and assessment centre construct validity. . Journal of Occupational and Organizational Psychology , 67 : 401 – 410 .
   Google Scholar
• Schleicher , D. J. , Day , D. V. , Mayes , B. T. and Riggio , R. E. 2002 . A new frame for frame-of-reference training: Enhancing the construct validity of assessment centers. . Journal of Applied Psychology , 87 : 735 – 746 .
   PubMed Web of Science ®Google Scholar
• Schmidt , F. L. , Hunter , J. E. and Outerbridge , A. N. 1986 . Impact of job experience and ability on job knowledge, work sample performance, and supervisory ratings of job performance. . Journal of Applied Psychology , 71 : 423 – 439 .
   Google Scholar
• Schneider , J. R. and Schmitt , N. 1992 . An exercise design approach to understanding assessment center dimension and exercise constructs. . Journal of Applied Psychology , 77 : 32 – 41 .
   Web of Science ®Google Scholar
• Shore , T. H. , Thornton , G. C. , III and Shore , L. M. 1990 . Construct validity of two categories of assessment center dimension ratings. . Personnel Psychology , 43 : 101 – 116 .
   Web of Science ®Google Scholar
• Spector , P. E. , Schneider , J. R. , Vance , C. A. and Hezlett , S. A. 2000 . The relation of cognitive ability and personality traits to assessment center performance. . Journal of Applied Social Psychology , 30 : 1474 – 1491 .
   Web of Science ®Google Scholar
• Spychalski , A. C. , Quiñones , M. A. , Gaugler , B. B. and Pohley , K. 1997 . A survey of assessment center practices in the United States. . Personnel Psychology , 50 : 71 – 91 .
   Web of Science ®Google Scholar
• Tett , R. P. and Burnett , D. D. 2003 . A personality trait-based interactionist model of job performance. . Journal of Applied Psychology , 88 : 500 – 517 .
   PubMed Web of Science ®Google Scholar
• Tett , R. P. , Jackson , D. N. and Rothstein , M. 1991 . Personality measures as predictors of job performance: A meta-analytic review. . Personnel Psychology , 44 : 703 – 742 .
   Web of Science ®Google Scholar
• Thornton , G. C. III and Mueller-Hanson , R. A. 2004 . Developing organizational simulations: A guide for practitioners and students. , Mahwah, NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Vazire , S. and Gosling , S. D. 2004 . E-perceptions: Personality impressions based on personal websites. . Journal of Personality and Social Psychology , 87 : 123 – 132 .
   PubMed Web of Science ®Google Scholar
• Widaman , K. F. 1985 . Hierarchically nested covariance structure models for multitrait–multimethod data. . Applied Psychological Measurement , 9 : 1 – 26 .
   Web of Science ®Google Scholar
• Woehr , D. J. and Arthur , W. Jr. 2003 . The construct-related validity of assessment center ratings: A review and meta-analysis of the role of methodological factors. . Journal of Management , 29 : 231 – 258 .
   Web of Science ®Google Scholar
• Wothke , W. and Browne , M. W. 1990 . The direct product model for the MTMM matrix parameterized as a second order factor analysis model. . Psychometrika , 55 : 255 – 262 .
   Web of Science ®Google Scholar