A Comparison of Method Effects in Two Confirmatory Factor Models for Structurally Different Methods

REFERENCES

• Amador-Campos , J. A. , Forns-Santacana , M. , Guardia-Olmos , J. and Peró-Cebollero , M. 2006 . DSM–IV attention deficit hyperactivity disorder symptoms: Agreement between informants in prevalence and factor structure at different ages . Journal of Psychopathology and Behavioral Assessment , 28 : 23 – 32 .
   Web of Science ®Google Scholar
• Bandalos , D. L. 2002 . The effects of item parceling on goodness-of-fit and parameter estimate bias in structural equation modeling . Structural Equation Modeling , 9 : 78 – 102 .
   Web of Science ®Google Scholar
• Campbell , D. T. and Fiske , D. W. 1959 . Convergent and discriminant validation by the multitrait–multimethod matrix . Psychological Bulletin , 56 : 81 – 105 .
   PubMed Web of Science ®Google Scholar
• Cohen , J. , Cohen , P. , West , S. G. and Aiken , L. S. 2003 . Applied multiple regression/correlation analysis for the behavioral sciences. Mahwah , NJ : Erlbaum. .
   Google Scholar
• Cronbach , L. J. 1995 . “ Giving method variance its due. ” . In Personality research, methods, and theory: A festschrift honoring Donald W. Fiske , Edited by: Shrout , P. E. and Fiske , S. T. 145 – 157 . Mahwah , NJ : Erlbaum. .
   Google Scholar
• Deegan , J. 1978 . On the occurrence of standardized regression coefficients greater than one . Educational and Psychological Measurement , 38 : 873 – 888 .
   Web of Science ®Google Scholar
• Dumenci , L. 2000 . “ Multitrait–multimethod analysis. ” . In Handbook of applied multivariate statistics and mathematical modeling , Edited by: Brown , S. D. and Tinsley , H. E. A. 583 – 611 . San Diego , CA : Academic. .
   Google Scholar
• Eid , M. 1996 . Longitudinal confirmatory factor analysis for polytomous item responses: Model definition and model selection on the basis of stochastic measurement theory . Methods of Psychological Research—Online , 1 : 65 – 85 .
   Google Scholar
• Eid , M. 2000 . A multitrait–multimethod model with minimal assumptions . Psychometrika , 65 : 241 – 261 .
   Web of Science ®Google Scholar
• Eid , M. and Diener , E. 2006 . Handbook of multimethod measurement in psychology. Washington , DC : American Psychological Association. .
   Google Scholar
• Eid , M. , Lischetzke , T. and Nussbeck , F. W. 2006 . “ Structural equation models for multitrait–multimethod data. ” . In Handbook of multimethod measurement in psychology , Edited by: Eid , M. and Diener , E. 283 – 299 . Washington , DC : American Psychological Association. .
   Google Scholar
• Eid , M. , Lischetzke , T. , Nussbeck , F. W. and Trierweiler , L. I. 2003 . Separating trait effects from trait-specific method effects in multitrait–multimethod models: A multiple indicator CT-C(M − 1) model . Psychological Methods , 8 : 38 – 60 .
   PubMed Web of Science ®Google Scholar
• Eid , M. , Nussbeck , F. W. , Geiser , C. , Cole , D. A. , Gollwitzer , M. and Lischetzke , T. 2008 . Structural equation modeling of multitrait–multimethod data: Different models for different types of methods . Psychological Methods , 13 : 230 – 253 .
   PubMed Web of Science ®Google Scholar
• Fiske , D. W. and Campbell , D. T. 1992 . Citations do not solve problems . Psychological Bulletin , 112 : 393 – 395 .
   Web of Science ®Google Scholar
• Gaudron , J.-P. and Vautier , S. 2007 . Analyzing individual differences in vocational, leisure, and family interests: A multitrait–multimethod approach . Journal of Vocational Behavior , 70 : 561 – 573 .
   Web of Science ®Google Scholar
• Geiser , C. , Eid , M. and Nussbeck , F. W. 2008 . On the meaning of the latent variables in the CT-C(M − 1) model: A comment on Maydeu-Olivares and Coffman 2006 . Psychological Methods , 13 : 49 – 57 .
   PubMed Web of Science ®Google Scholar
• Grigorenko , E. L. , Geiser , C. , Slobodskaya , H. R. and Francis , D. J. 2010 . Cross-informant symptoms from CBCL, TRF, and YSR: Trait and method variance in a normative sample of Russian youths . Psychological Assessment , 22 : 893 – 911 .
   PubMed Web of Science ®Google Scholar
• Holland , P. W. 1986 . Statistics and causal inference (with discussion) . Journal of the American Statistical Association , 81 : 945 – 960 .
   Web of Science ®Google Scholar
• Jöreskog , K. G. 1971 . Statistical analysis of sets of congeneric tests . Psychometrika , 36 : 109 – 133 .
   Web of Science ®Google Scholar
• Kenny , D. A. 1976 . An empirical application of confirmatory factor analysis to the multitrait–multimethod matrix . Journal of Experimental Social Psychology , 12 : 247 – 252 .
   Web of Science ®Google Scholar
• Kollmann , D. M. , Brown , T. A. and Barlow , D. H. 2009 . The construct validity of acceptance: A multitrait–multimethod investigation . Behavior Therapy , 40 : 205 – 218 .
   Web of Science ®Google Scholar
• Lischetzke , T. , Eid , M. and Nussbeck , F. W. Unterschiedliche Definitionen von Methodeneffekten in MTMM Modellen und ihre Implikationen für die Analyse der Validität [Different definitions of method effects in MTMM models and their implications for validity analysis] . Paper presented at the 43rd meeting of the German Psychological Association . Berlin , Germany. September .
   Google Scholar
• Marsh , H. W. and Bailey , M. 1991 . Confirmatory factor analysis of multitrait–multimethod data: A comparison of alternative models . Applied Psychological Measurement , 15 : 47 – 70 .
   Web of Science ®Google Scholar
• Marsh , H. W. and Hocevar , D. 1988 . A new, more powerful approach to multitrait–multimethod analyses: Application of second-order confirmatory factor analysis . Journal of Applied Psychology , 73 : 107 – 117 .
   Web of Science ®Google Scholar
• McArdle , J. J. and Hamagami , F. 2001 . “ Latent difference score structural models for linear dynamic analysis with incomplete longitudinal data. ” . In New methods for the analysis of change , Edited by: Collins , L. M. and Sayer , A. G. 137 – 175 . Washington , DC : American Psychological Association. .
   Google Scholar
• Millsap , R. E. 1995 . “ The statistical analysis of method effects in multitrait–multimethod data: A review. ” . In Personality research, methods, and theory: A festschrift honoring Donald W. Fiske. , Edited by: Shrout , P. E. and Fiske , S. T. 93 – 109 . Mahwah , NJ : Erlbaum. .
   Google Scholar
• Mitte , K. and Kämpfe , N. 2008 . Personality and the four faces of positive affect: A multitrait–multimethod analysis using self- and peer-report . Journal of Research in Personality , 42 : 1370 – 1375 .
   Web of Science ®Google Scholar
• Muthén , L. K. and Muthén , B. O. 1998–2007 . Mplus user's guide, , 5th ed. Los Angeles , CA : Muthén & Muthén. .
   Google Scholar
• Novick , M. R. 1966 . The axioms and principal results of classical test theory . Journal of Mathematical Psychology , 3 : 1 – 18 .
   Web of Science ®Google Scholar
• Nussbeck , F. W. , Eid , M. , Geiser , C. , Courvoisier , D. S. and Lischetzke , T. 2009 . A CTC(M − 1) model for different types of raters . Methodology , 5 : 88 – 98 .
   Web of Science ®Google Scholar
• Ozer , D. J. 1989 . “ Construct validity in personality assessment. ” . In Personality psychology: Recent trends and emerging directions , Edited by: Buss , D. M. and Cantor , N. 224 – 234 . New York , NY : Springer. .
   Google Scholar
• Pohl , S. and Steyer , R. 2010 . Modeling common traits and method effects in multitrait–multimethod analysis . Multivariate Behavioral Research , 45 : 45 – 72 .
   PubMed Web of Science ®Google Scholar
• Pohl , S. , Steyer , R. and Kraus , K. 2008 . Modelling method effects as individual causal effects . Journal of the Royal Statistical Society Series A , 171 : 41 – 63 .
   Web of Science ®Google Scholar
• Sechrest , L. , Davis , M. F. , Stickle , T. R. and McKnight , P. E. 2000 . “ Understanding “method” variance. ” . In Research design: Donald Campbell's legacy , Edited by: Bickman , L. 63 – 87 . Thousand Oaks , CA : Sage. .
   Google Scholar
• Steyer , R. 1988 . Conditional expectations: An introduction to the concept and its applications in empirical sciences . Methodika , 2 : 53 – 78 .
   Google Scholar
• Steyer , R. 1989 . Models of classical psychometric test theory as stochastic measurement models: Representation, uniqueness, meaningfulness, identifiability, and testability . Methodika , 3 : 25 – 60 .
   Google Scholar
• Steyer , R. 2001 . “ Classical test theory. ” . In International encyclopedia of the social and behavioural sciences: Logic and inquiry and research design , Edited by: Ragin , C. and Cook , T. 1955 – 1962 . Oxford , , UK : Pergamon. .
   Google Scholar
• Steyer , R. , Eid , M. and Schwenkmezger , P. 1997 . Modeling true intraindividual change: True change as a latent variable . Methods of Psychological Research—Online , 2 : 21 – 33 .
   Google Scholar
• Trierweiler , L. I. , Eid , M. and Lischetzke , T. 2002 . The structure of emotional expressivity: Each emotion counts . Journal of Personality and Social Psychology , 82 : 1023 – 1040 .
   PubMed Web of Science ®Google Scholar
• Vautier , S. and Pohl , S. 2009 . Bipolarity of latent change in STAI Scores . Psychological Assessment , 21 : 187 – 193 .
   PubMed Web of Science ®Google Scholar
• Widaman , K.-F. 1985 . Hierarchically nested covariance structure models for multitrait–multimethod data . Applied Psychological Measurement , 9 : 1 – 26 .
   Web of Science ®Google Scholar
• Wothke , W. 1995 . “ Covariance components analysis of the multitrait–multimethod matrix. ” . In Personality research, methods, and theory: A festschrift honoring Donald W. Fiske , Edited by: Shrout , P. E. 125 – 144 . Mahwah , NJ : Erlbaum. .
   Google Scholar
• Zimmerman , D. W. 1975 . Probability spaces, Hilbert spaces, and the axioms of test theory . Psychometrika , 40 : 395 – 412 .
   Web of Science ®Google Scholar