Exploratory Structural Equation Modeling, Integrating CFA and EFA: Application to Students' Evaluations of University Teaching

REFERENCES

• Abrami , P. C. and d'Apollonia , S. 1991 . Multidimensional students' evaluations of teaching effectiveness: Generalizability of N = 1 research. Comment on Marsh (1991). . Journal of Educational Psychology , 30 : 221 – 227 .
   Google Scholar
• Asparohov , T. and Muthén , B. 2009 . Exploratory structural equation modeling. . Structural Equation Modeling , 16 ( 3 ) : 397 – 438 .
   Web of Science ®Google Scholar
• Bentler , P. M. 1990 . Comparative fit indices in structural models. . Psychological Bulletin , 107 : 238 – 246 .
   PubMed Web of Science ®Google Scholar
• Braskamp , L. A. , Brandenburg , D. C. and Ory , J. C. 1985 . Evaluating teaching effectiveness: A practical guide. , Beverly Hills, CA : Sage .
   Google Scholar
• Browne , M. W. 2000 . Cross-validation methods. . Journal of Mathematical Psychology , 44 : 108 – 132 .
   PubMed Web of Science ®Google Scholar
• Browne , M. W. 2001 . An overview of analytic rotation in exploratory factor analysis. . Multivariate Behavioral Research , 36 : 111 – 150 .
   Web of Science ®Google Scholar
• Carroll , J. B. 1953 . An analytical solution for approximating simple structure in factor analysis. . Psychometrika , 18 : 23 – 38 .
   Google Scholar
• Cashin , W. E. 1988 . Student ratings of teaching: A summary of research. (IDEA Paper No. 20). , Manhattan, KS : Kansas State University, Division of Continuing Education . (ERIC Document Reproduction Service No. ED 302 567)
   Google Scholar
• Centra , J. A. 1993 . Reflective faculty evaluation. , San Francisco, CA : Jossey-Bass .
   Google Scholar
• Chen , F. F. 2007 . Sensitivity of goodness of fit indexes to lack of measurement invariance. . Structural Equation Modeling , 14 : 464 – 504 .
   Web of Science ®Google Scholar
• Cheung , G. W. and Rensvold , R. B. 2001 . The effects of model parsimony and sampling error on the fit of structural equation models. . Organizational Research Methods , 4 : 236 – 264 .
   Web of Science ®Google Scholar
• Cliff , N. 1966 . Orthogonal rotation to congruence. . Psychometrika , 31 : 33 – 42 .
   Web of Science ®Google Scholar
• Cohen , J. , Cohen , P. , West , S. G. and Aiken , L. S. 2003 . Applied multiple regression/correlation analysis for the behavioral sciences , 3rd ed. , Mahwah, NJ : Lawrence Erlbaum Associates, Inc. .
   Google Scholar
• Cohen , P. A. 1980 . Effectiveness of student-rating feedback for improving college instruction: A meta-analysis. . Research in Higher Education , 13 : 321 – 341 .
   Web of Science ®Google Scholar
• Cohen , P. A. 1981 . Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies. . Review of Educational Research , 51 : 281 – 309 .
   Web of Science ®Google Scholar
• Costin , F. , Greenough , W. T. and Menges , R. J. 1971 . Student ratings of college teaching: Reliability, validity and usefulness. . Review of Educational Research , 41 : 511 – 536 .
   Web of Science ®Google Scholar
• de Wolf , W. A. 1974 . Student ratings of instruction in post secondary institutions: A comprehensive annotated bibliography of research reported since 1968 , Vol. 1 , Seattle : University of Washington Educational Assessment Center .
   Google Scholar
• Feldman , K. A. 1976 . The superior college teacher from the student's view. . Research in Higher Education , 5 : 243 – 288 .
   Google Scholar
• Feldman , K. A. 1977 . Consistency and variability among college students in rating their teachers and courses. . Research in Higher Education , 6 : 223 – 274 .
   Google Scholar
• Feldman , K. A. 1978 . Course characteristics and college students' ratings of their teachers and courses: What we know and what we don't. . Research in Higher Education , 9 : 199 – 242 .
   Google Scholar
• Feldman , K. A. 1989a . Association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies. . Research in Higher Education , 30 : 583 – 645 .
   Web of Science ®Google Scholar
• Feldman , K. A. 1989b . Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers. . Research in Higher Education , 30 : 137 – 194 .
   Web of Science ®Google Scholar
• Feldman , K. A. 1997 . “ Identifying exemplary teachers and teaching: Evidence from student ratings. ” . In Effective teaching in higher education: Research and practice , Edited by: Perry , R. P. and Smart , J. C. 368 – 395 . New York : Agathon .
   Google Scholar
• Grayson , D. A. , Mackinnon , A. , Jorm , A. F. , Creasey , H. and Broe , G. A. 2000 . Item bias in the Center for Epidemiologic Studies Depression scale: Effects of physical disorders and disability in an elderly community sample. . Journals of Gerontology Series B: Psychological Sciences and Social Sciences , 5 : 273 – 282 .
   Google Scholar
• Holzinger , K. J. and Harman , H. H. 1941 . Factor analysis. , Chicago : University of Chicago Press .
   Google Scholar
• Hu , L. and Bentler , P. M. 1999 . Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. . Structural Equation Modeling , 6 : 1 – 55 .
   Web of Science ®Google Scholar
• Jackson , D. L. , Teal , C. R. , Raines , S. J. , Nansel , T. R. , Force , R. C. and Burdsal , C. A. 1999 . The dimensions of students' perceptions of teaching effectiveness. . Educational and Psychological Measurement , 59 : 580 – 596 .
   Web of Science ®Google Scholar
• Jöreskog , K. G. and Sörbom , D. 1979 . Advances in factor analysis and structural equation models. , Cambridge, MA : Abt Books .
   Google Scholar
• Jöreskog , K. G. and Sörbom , D. 1988 . LISREL 7—A guide to the program and applications , 2nd ed. , Chicago : SPSS .
   Google Scholar
• Kaiser , H. F. 1958 . The varimax criterion for analytic rotation in factor analysis. . Psychometrika , 23 : 187 – 200 .
   Web of Science ®Google Scholar
• Kaplan , D. 2000 . Structural equation modeling: Foundations and extensions. , Newbury Park, CA : Sage .
   Google Scholar
• Marsh , H. W. 1982a . SEEQ: A reliable, valid, and useful instrument for collecting students' evaluations of university teaching. . British Journal of Educational Psychology , 52 : 77 – 95 .
   Web of Science ®Google Scholar
• Marsh , H. W. 1982b . Validity of students' evaluations of college teaching: A multitrait-multimethod analysis. . Journal of Educational Psychology , 74 : 264 – 279 .
   Web of Science ®Google Scholar
• Marsh , H. W. 1983 . Multidimensional ratings of teaching effectiveness by students from different academic settings and their relation to student/course/instructor characteristics. . Journal of Educational Psychology , 75 : 150 – 166 .
   Web of Science ®Google Scholar
• Marsh , H. W. 1984 . Students' evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility. . Journal of Educational Psychology , 76 : 707 – 754 .
   Web of Science ®Google Scholar
• Marsh , H. W. 1987 . Students' evaluations of university teaching: Research findings, methodological issues, and directions for future research. . International Journal of Educational Research , 11 : 253 – 388 .
   Google Scholar
• Marsh , H. W. 1991a . A multidimensional perspective on students' evaluations of teaching effectiveness: A reply to Abrami and d'Apollonia (1991). . Journal of Educational Psychology , 83 : 416 – 421 .
   Web of Science ®Google Scholar
• Marsh , H. W. 1991b . Multidimensional students' evaluations of teaching effectiveness: A test of alternative higher-order structures. . Journal of Educational Psychology , 83 : 285 – 296 .
   Web of Science ®Google Scholar
• Marsh , H. W. 1994 . Confirmatory factor analysis models of factorial invariance: A multifaceted approach. . Structural Equation Modeling , 1 : 5 – 34 .
   Web of Science ®Google Scholar
• Marsh , H. W. 2007a . “ Application of confirmatory factor analysis and structural equation modeling in sport/exercise psychology. ” . In Handbook of on sport psychology , 3rd ed. , Edited by: Tenenbaum , G. and Eklund , R. C. 774 – 798 . New York : Wiley .
   Google Scholar
• Marsh , H. W. 2007b . Do university teachers become more effective with experience? A multilevel growth model of students' evaluations of teaching over 13 years. . Journal of Educational Psychology , 99 : 775 – 790 .
   Web of Science ®Google Scholar
• Marsh , H. W. 2007c . “ Students' evaluations of university teaching: A multidimensional perspective. ” . In The scholarship of teaching and learning in higher education: An evidence-based perspective , Edited by: Perry , R. P. and Smart , J. C. 319 – 384 . New York : Springer .
   Google Scholar
• Marsh , H. W. and Bailey , M. 1993 . Multidimensionality of students' evaluations of teaching effectiveness: A profile analysis. . Journal of Higher Education , 64 : 1 – 18 .
   Web of Science ®Google Scholar
• Marsh , H. W. , Balla , J. R. and Hau , K.-T. 1996 . “ An evaluation of incremental fit indices: A clarification of mathematical and empirical processes. ” . In Advanced structural equation modeling techniques , Edited by: Marcoulides , G. A. and Schumacker , R. E. 315 – 353 . Mahwah, NJ : Lawrence Erlbaum Associates, Inc. .
   Google Scholar
• Marsh , H. W. , Balla , J. R. and McDonald , R. P. 1988 . Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. . Psychological Bulletin , 103 : 391 – 410 .
   Web of Science ®Google Scholar
• Marsh , H. W. and Dunkin , M. J. 1992 . “ Students' evaluations of university teaching: A multidimensional perspective. ” . In Higher education: Handbook on theory and research , Edited by: Smart , J. Vol. 8 , 143 – 234 . New York : Agathon .
   Google Scholar
• Marsh , H. W. and Dunkin , M. J. 1997 . “ Students' evaluations of university teaching: A multidimensional perspective. ” . In Effective teaching in higher education: Research and practice , Edited by: Perry , R. P. and Smart , J. C. 241 – 320 . New York : Agathon .
   Google Scholar
• Marsh , H. W. , Ellis , L. , Parada , L. , Richards , G. and Heubeck , B. G. 2005 . A short version of the Self Description Questionnaire II: Operationalizing criteria for short-form evaluation with new applications of confirmatory factor analyses. . Psychological Assessment , 17 : 81 – 102 .
   PubMed Web of Science ®Google Scholar
• Marsh , H. W. and Grayson , D. 1994 . Longitudinal stability of latent means and individual differences: A unified approach. . Structural Equation Modeling , 1 : 317 – 359 .
   Web of Science ®Google Scholar
• Marsh , H. W. and Hau , K.-T. 2007 . Applications of latent-variable models in educational psychology: The need for methodological-substantive synergies. . Contemporary Educational Psychology , 32 : 151 – 171 .
   Web of Science ®Google Scholar
• Marsh , H. W. , Hau , K.-T. , Balla , J. R. and Grayson , D. 1998 . Is more ever too much? The number of indicators per factor in confirmatory factor analysis. . Multivariate Behavioral Research , 33 : 181 – 220 .
   PubMed Web of Science ®Google Scholar
• Marsh , H. W. , Hau , K.-T. and Grayson , D. 2005 . “ Goodness of fit evaluation in structural equation modeling. ” . In Psychometrics: A festschrift to Roderick P. McDonald , Edited by: Maydeu-Olivares , A. and McCardle , J. 275 – 340 . Mahwah, NJ : Lawrence Erlbaum Associates, Inc. .
   Google Scholar
• Marsh , H. W. , Hau , K.-T. and Wen , Z. 2004 . In search of golden rules: Comment on hypothesis testing approaches to setting cutoff values for fit indexes and dangers in overgeneralising Hu & Bentler's (1999) findings. . Structural Equation Modeling , 11 : 320 – 341 .
   Web of Science ®Google Scholar
• Marsh , H. W. and Hocevar , D. 1991a . The multidimensionality of students' evaluations of teaching effectiveness: The generality of factor structures across academic discipline, instructor level, and course level. . Teaching and Teacher Education , 7 : 9 – 18 .
   Web of Science ®Google Scholar
• Marsh , H. W. and Hocevar , D. 1991b . Students' evaluations of teaching effectiveness: The stability of mean ratings of the same teachers over a 13-year period. . Teaching and Teacher Education , 7 : 303 – 314 .
   Web of Science ®Google Scholar
• Marsh , H. W. and Overall , J. U. 1979 . Long-term stability of students' evaluations. . Research in Higher Education , 10 : 139 – 147 .
   Google Scholar
• Marsh , H. W. , Overall , J. U. and Kesler , S. P. 1979 . Validity of student evaluations of instructional effectiveness: A comparison of faculty self-evaluations and evaluations by their students. . Journal of Educational Psychology , 71 : 149 – 160 .
   Web of Science ®Google Scholar
• Marsh , H. W. and Roche , L. A. 1993 . The use of students' evaluations and an individually structured intervention to enhance university teaching effectiveness. . American Educational Research Journal , 30 : 217 – 251 .
   Web of Science ®Google Scholar
• Marsh , H. W. and Roche , L. A. 1994 . The use of students' evaluations of university teaching to improve teaching effectiveness. , Canberra, , Australia : Australian Department of Employment, Education, and Training .
   Google Scholar
• Marsh , H. W. and Roche , L. A. 1997 . Making students' evaluations of teaching effectiveness effective. . American Psychologist , 52 : 1187 – 1197 .
   Web of Science ®Google Scholar
• Marsh , H. W. and Roche , L. A. 2000 . Effects of grading leniency and low workloads on students' evaluations of teaching: Popular myth, bias, validity or innocent bystanders? . Journal of Educational Psychology , 92 : 202 – 228 .
   Web of Science ®Google Scholar
• Marsh , H. W. , Tracey , D. K. and Craven , R. G. 2005 . Multidimensional self-concept structure for preadolescents with mild intellectual disabilities: A hybrid multigroup-MIMIC approach to factorial invariance and latent mean differences. , Sydney, , Australia : SELF Research Centre, University of Western Sydney .
   Google Scholar
• Marsh , H. W. , Wen , Z. and Hau , K.-T. 2004 . Structural equation models of latent interactions: Evaluation of alternative estimation strategies and indicator construction. . Psychological Methods , 9 : 275 – 300 .
   PubMed Web of Science ®Google Scholar
• Marsh , H. W. , Wen , Z. and Hau , K.-T. 2006 . “ Structural equation models of latent interaction and quadratic effects. ” . In Structural equation modeling: A second course , Edited by: Hancock , G. R. and Mueller , R. O. 225 – 265 . Mahwah, NJ : Lawrence Erlbaum Associates, Inc. .
   Google Scholar
• McDonald , R. P. 1985 . Factor analysis and related methods. , Hillsdale, NJ : Lawrence Erlbaum Associates, Inc. .
   Google Scholar
• McKeachie , W. J. 1997 . Student ratings: The validity of use. . American Psychologist , 52 : 1218 – 1225 .
   Web of Science ®Google Scholar
• Meredith , W. 1964 . Rotation to achieve factorial invariance. . Psychometrika , 29 : 187 – 206 .
   Web of Science ®Google Scholar
• Meredith , W. 1993 . Measurement invariance, factor analysis and factorial invariance . Psychometrika , 58 : 525 – 543 .
   Web of Science ®Google Scholar
• Meredith , W. and Teresi , J. 2006 . An essay on measurement and factorial invariance. . Medical Care , 44 ( Suppl. 3 ) : S69 – S77 .
   PubMed Web of Science ®Google Scholar
• Muthén , B. 1989 . Latent variable modeling in heterogeneous populations. . Psychometrika , 54 : 557 – 585 .
   Web of Science ®Google Scholar
• Muthén , L. K. and Muthén , B. 2008 . Mplus user's guide. , Los Angeles : Muthén & Muthén .
   Google Scholar
• Remmers , H. H. 1963 . “ Rating methods in research on teaching. ” . In Handbook of research on teaching , Edited by: Gage , N. L. 329 – 378 . Chicago : Rand McNally .
   Google Scholar
• Renaud , R. D. and Murray , H. G. 2005 . Factorial validity of student ratings of instruction. . Research in Higher Education , 46 : 929 – 953 .
   Web of Science ®Google Scholar
• Richardson , J. T. E. 2005 . Instruments for obtaining student feedback: A review of the literature. . Assessment and Evaluation in Higher Education , 30 : 387 – 415 .
   Google Scholar
• Rindermann , H. 1996 . On the quality of students' evaluations of university teaching: An answer to evaluation critique. . Zeitschrift Für Padagogische Psychologie , 10 ( 3–4 ) : 129 – 145 .
   Web of Science ®Google Scholar
• Thurstone , L. L. 1947 . Multiple factor analysis. , Chicago : University of Chicago .
   Google Scholar
• Toland , M. D. and De Ayala , R. J. 2005 . A multilevel factor analysis of students' evaluations of teaching. . Educational and Psychological Measurement , 65 : 272 – 296 .
   Web of Science ®Google Scholar
• Watkins , D. 1994 . Student evaluations of teaching effectiveness: A cross-cultural perspective. . Research in Higher Education , 35 : 251 – 266 .
   Web of Science ®Google Scholar