Convergence and discriminant: assessing multiple traits using multiple methods

References

• Alderson , J.C. 1984 . “ Reading in a foreign language: A reading problem or a language problem? ” . In Reading in a foreign language , Edited by: Alderson , J.C. and Urquhart , A.H. 1 – 24 . New York , NY : Longman .
   Google Scholar
• Alderson , J.C. and Banerjee , J. 2002 . Language testing and assessment (Part 2) . Language Teaching , 35 : 79 – 113 .
   Google Scholar
• Bachman , L.F. 1990 . Fundamental considerations in language testing , New York , NY : Oxford University Press .
   Google Scholar
• Bachman , L.F. 2002 . Some reflections on task-based language performance assessment . Language Testing , 19 : 453 – 476 .
   Google Scholar
• Bachman , L.F. 2004 . Statistical analyses for language assessment , New York , NY : Cambridge University Press .
   Google Scholar
• Bachman , L.F. and Palmer , A.S. 1996 . Language testing in practice , New York , NY : Oxford University Press .
   Google Scholar
• Bennett , R.E. , Rock , D.A. and Wang , M. 1991 . Equivalence of free-response and multiple-choice items . Journal of Educational Measurement , 28 : 77 – 92 .
   Web of Science ®Google Scholar
• Bernhardt , E.B. 1999 . “ If reading is reader-based, can there be a computer-adaptive test of reading? ” . In Issues in computer-adaptive testing of reading proficiency (Studies in Language Testing Series , Edited by: Chalhoub-Deville , M. 1 – 10 . New York , NY : Cambridge University press .
   Google Scholar
• Bollen , K.A. 1989 . Structural equations with latent variables , New York , NY : John Wiley & Sons .
   Google Scholar
• Brown , T.A. 2006 . Confirmatory factor analysis for applied research , New York , NY : Guilford .
   Google Scholar
• Buck , G. 2001 . Assessing listening , Cambridge , , UK : Cambridge University Press .
   Google Scholar
• Campbell , D.T. and Fiske , D.W. 1959 . Covergent and discriminant validation by the multitrait-multimethod matrix . Psychological Bulletin , 56 : 81 – 105 .
   PubMed Web of Science ®Google Scholar
• Chalhoub-Deville , M. 1997 . Theoretical models, assessment frameworks and test construction . Language Testing , 14 : 3 – 22 .
   Google Scholar
• Chappelle , C.A. and Douglas , D. 2006 . Assessing language ability through computer technology , New York , NY : Cambridge University Press .
   Google Scholar
• Chappelle , C.A. , Jamieson , J.M. and Hegelheimer , V. 2003 . Validation of a web-based ESL test . Language Testing , 20 : 409 – 439 .
   Google Scholar
• Clarke , M.A. 1988 . “ The short circuit hypothesis of ESL reading – or when language competence interferes with reading performance ” . In Interactive approaches to second language reading , Edited by: Carrell , P.L. , Devine , J. and Eskey , D.E. 114 – 124 . New York , NY : Cambridge University Press .
   Google Scholar
• Conway , J.M. , Lievens , F. , Scullen , S.E. and Lance , C.E. 2004 . Bias in the correlated uniqueness model for MTMM data . Structural Equation Modeling , 11 : 535 – 559 .
   Web of Science ®Google Scholar
• Doty , D.H. and Glick , W.H. 1998 . Common methods bias: Does common methods variance really bias results? . Organizational Research Methods , 1 : 374 – 406 .
   Web of Science ®Google Scholar
• Hancock , G.R. 1994 . Cognitive complexity and the comparability of multiple-choice and constructed-response test formats . Journal of Experimental Education , 62 : 143 – 157 .
   Web of Science ®Google Scholar
• Jöreskog , J.G. and Sörbom , D. 2007 . LISREL 8.8 [Computer program] , Lincolnwood , IL : Scientific Software International .
   Google Scholar
• Kenny , D.A. and Kashy , D.A. 1992 . Analysis of the multitrait-multimethod matrix by confirmatory factor analysis . Psychological Bulletin , 112 : 165 – 172 .
   Web of Science ®Google Scholar
• Kline , R.B. 1998 . Principles and practice of structural equation modeling , New York , NY : Guilford .
   Google Scholar
• Kunnan , A.J. 2010 . Test fairness and Toulmin's argument structure . Language Testing , 27 : 183 – 189 .
   Web of Science ®Google Scholar
• Leeson , H.V . 2006 . The mode effect: A literature review of human and technological issues in computerized testing . International Journal of Testing , : 1 – 24 .
   Google Scholar
• Linn , R.L. and Miller , M.D. 2005 . Measurement and assessment in teaching , (9th ed.) , Upper Saddle River , NJ : Merrill Prentice Hall .
   Google Scholar
• Marsh , H.W. 1989 . Confirmatory factor analyses of multitrait-multimethod data: Many problems and a few solutions . Applied Psychological Measurement , 13 : 335 – 361 .
   Web of Science ®Google Scholar
• Marsh , H.W. and Hocevar , D. 1988 . A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis . Journal of Applied Psychology , 73 : 107 – 117 .
   Web of Science ®Google Scholar
• McNamara , T.F. 1995 . Modeling performance: Opening Pandora's Box . Applied Linguistics , 16 : 159 – 175 .
   Web of Science ®Google Scholar
• McNamara , T.F. 1996 . Measuring second language performance , New York , NY : Addison Wesley Longman .
   Google Scholar
• Messick , S. 1989 . “ Validity ” . In Educational measurement , Edited by: Linn , R. 13 – 103 . New York , NY : American Council on Education and Macmillan .
   Google Scholar
• Messick , S. 1996 . Validity and washback in language testing . Language Testing , 13 : 241 – 256 .
   Google Scholar
• O'Loughlin , K. 1995 . Lexical density in candidate output on direct and semi-direct versions of an oral proficiency test . Language Testing , 12 : 217 – 237 .
   Google Scholar
• Oltman , P.K. , Stricker , L.J. and Barrows , T.S. 1990 . Analyzing test structure by multidimensional scaling . Journal of Applied Psychology , 75 : 21 – 27 .
   Web of Science ®Google Scholar
• Pae , H.K. 2012 . A psychometric measurement model for adult English language learners: Pearson Test of English Academic . Educational Research and Evaluation , 18 : 211 – 229 .
   Google Scholar
• Schmitt , N. and Stults , D.M. 1986 . Methodology review: Analysis of multitrait-multimethod matrices . Applied Psychological Measurement , 10 : 1 – 22 .
   Web of Science ®Google Scholar
• Schumacker , R.E. and Lomax , R.G. 2004) . A beginner's guide to structural equation modeling , (2nd ed.) , New York , NY : Taylor & Francis Group .
   Google Scholar
• Shohamy , E. 1990 . Language testing priorities: A different perspective . Foreign Language Annals , 23 : 385 – 394 .
   Web of Science ®Google Scholar
• Stoynoff , S. 2009 . Recent developments in language assessment and the case of four large-scale tests of ESOL ability . Language Teaching , 42 : 1 – 40 .
   Web of Science ®Google Scholar
• Swain , M. 2001 . Examining dialogue: Another approach to content specification and to validating inference drawn from test scores . Language Testing , 18 : 275 – 302 .
   Google Scholar
• Thissen , D. , Wainer , H. and Wang , X.-B. 1993 . How unidimensional are tests comprising both multiple-choice and free-response items? An analysis of two tests , Princeton , NJ : Educational Testing Service . (Tech. Rep. No. 93–28)
   Google Scholar
• Wainer , H. and Thissen , D. 1993 . Combining multiple-choice and constructed-response test scores: Toward a Marxist theory of test construction . Applied Measurement in Education , 6 : 103 – 118 .
   Google Scholar
• Widaman , K.F. 1985 . Hierarchically nested covariance structure models for multitrait-multimethod data . Applied Psychological Measurement , 9 : 1 – 26 .
   Web of Science ®Google Scholar