Multilevel Factor Analysis: Reporting Guidelines and a Review of Reporting Practices

References

• Allodi, M. W. (2002). A two-level analysis of classroom climate in relation to social context, group composition, and organization of special support. Learning Environments Research, 5, 253–274.
   Google Scholar
• American Educational Research Association. (2006). Standards for reporting on empirical social science research in AERA publications. Educational Researcher, 35(6), 33–40.
   Google Scholar
• Asparouhov, T., & Muthén, B. (2006). Multilevel modeling of complex survey data. Proceedings of the Joint Statistical Meeting, Seattle, WA, ASA section on Survey Research Methods, 2718–2726.
   Google Scholar
• Bakali, J., Baldwin, S., & Lorentzen, S. (2009). Modeling group process constructs at three stages in group psychotherapy. Psychotherapy Research, 19, 332–343.
   PubMed Web of Science ®Google Scholar
• Bandalos, D. L, & Finney, S.J. (2010). Factor analysis: Exploratory and confirmatory. In G. R. Hancock & R. O. Muller (Eds.), The reviewer's guide to quantitative methods in the social sciences (pp. 93–114). New York, NY: Routledge Taylor & Francis.
   Google Scholar
• Barile, J., Darnell, A., Erickson, S., & Weaver, S. (2012). Multilevel measurement of dimensions of collaborative functioning in a network of collaboratives that promote child and family well-being. American Journal of Community Psychology, 49, 270–282.
   PubMed Web of Science ®Google Scholar
• Beadnell, B., Carlisle, S. K., Hoppe, M. J., Mariano, K. A., Wilsdon, A., Morrison, D. M., &... Higa, D. (2007). The Reliability and validity of a group-based measure of adolescents' friendship closeness. Research on Social Work Practice, 17, 707–719.
   Web of Science ®Google Scholar
• Beauducel, A., & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling: A Multidisciplinary Journal, 13, 186–203.
   Web of Science ®Google Scholar
• Bentler, P. M. (2000-2008). EQS: Structural equations program manual. Encino, CA: Multivariate Software.
   Google Scholar
• Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In: K. J. Klein, & S. W. Kozlowski (Eds.), Multilevel theory, research, and methods in organization. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Boomsma, A. (2013). Reporting Monte Carlo studies in structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 20, 518–540.
   Web of Science ®Google Scholar
• Boonen, T., Pinxten, M., Van Damme, J., & Onghena, P. (2014). Should schools be optimistic? An investigation of the association between academic optimism of schools and student achievement in primary education. Educational Research and Evaluation, 20, 3–24.
   Google Scholar
• Branum-Martin, L., Mehta, P. D., Fletcher, J. M., Carlson, C. D., Ortiz, A., Carlo, M., & Francis, D. J. (2006). Bilingual phonological awareness: Multilevel construct validation among Spanish-speaking kindergarteners in transitional bilingual education classroom. Journal of Educational Psychological, 98, 170–181.
   Web of Science ®Google Scholar
• Breevaart, K., Bakker, A. B., Demerouti, E., & Hetland, J. (2012). The measurement of state work engagement: A multilevel factor analytic study. European Journal of Psychological Assessment, 28, 305–312.
   Web of Science ®Google Scholar
• Brondino, M., Pasini, M., & Silva, S. A. (2013). Development and validation of an Integrated Organizational Safety Climate Questionnaire with multilevel confirmatory factor analysis. Quality and Quantity, 47, 2191–2223.
   Web of Science ®Google Scholar
• Brown, E., Hawkins, J., Arthur, M., Abbott, R., & Van Horn, M. (2008). Multilevel analysis of a measure of community prevention collaboration. American Journal of Community Psychology, 41, 115–126.
   PubMed Web of Science ®Google Scholar
• Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In: K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Beverly Hills, CA: Sage.
   Google Scholar
• Byman, R., Lavonen, J., Juuti, K., & Meisalo, V. (2012). Motivational orientation in physics learning: A self-determination theory approach. Journal of Baltic Science Education, 12, 379–392.
   Google Scholar
• Can, S., Van de Schoot, R., Hox  (2015). Collinear latent variables in multilevel confirmatory factor analysis: A comparison of maximum likelihood and Bayesian estimation. Educational and Psychological Measurement, 75(3) 406–427.
   PubMed Web of Science ®Google Scholar
• Cerin, E., Leslie, E., Owen, N., & Bauman, A. (2008). An Australian version of the neighborhood environment walkability scale: Validity evidence. Measurement in Physical Education & Exercise Science, 12, 31–51.
   Google Scholar
• Cerin, E., Saelens, B. E., Sallis, J. F., & Frank, L. D. (2006). Neighborhood environment walkability scale: Validity and development of a short form. Medicine & Science in Sports & Exercise, 38, 1682–1691.
   PubMed Web of Science ®Google Scholar
• Cerin, E., Conway, T., Saelens, B., Frank, L., & Sallis, J. (2009). Cross-validation of the factorial structure of the Neighborhood Environment Walkability Scale (NEWS) and its abbreviated form (NEWS-A). International Journal of Behavioral Nutrition and Physical Activity, 6, 32–42.
   PubMed Web of Science ®Google Scholar
• Chen, Y., & Johantgen, M. E. (2010). Magnet hospital attributes in European hospitals: A multilevel model of job satisfaction. International Journal of Nursing Studies, 47, 1001–1012.
   PubMed Web of Science ®Google Scholar
• Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9, 233–255.
   Web of Science ®Google Scholar
• Cheung, M. W., Leung, K., & Au, K. (2006). Evaluating multilevel models in cross-cultural research: An illustration with social axioms. Journal of Cross-Cultural Psychology, 5, 522–541.
   Web of Science ®Google Scholar
• Church, A. T., Katigbak, M. S., Ching, C. M., Zhang, H., Shen, J., Arias, R. M., &... Alvarez, J. M. (2013). Within-individual variability in self-concepts and personality states: Applying density distribution and situation-behavior approaches across cultures. Journal of Research in Personality, 47, 922–935.
   Web of Science ®Google Scholar
• Coromina, L., & Coenders, G. (2006). Reliability and validity of egocentered network data collected via web. A meta-analysis of multilevel multitrait multimethod studies. Social Networks, 28, 209–231.
   Web of Science ®Google Scholar
• Coromina Soler, L., Coenders, G., & Kogovsek, T. (2004). Multilevel multitrait-multimethod model: Application to the measurement of egocentered social networks. Metodološki zvezki, 1, 323–349.
   Google Scholar
• Corsi, D. J., Subramanian, S. V., McKee, M., Wei, L., Swaminathan, S., Lopez-Jaramillo, P., &... Schooling, C. M. (2012). Environmental profile of a community's health (EPOCH): An ecometric assessment of measures of the community environment based on individual perception, Plos One, 7, 1–7.
   Web of Science ®Google Scholar
• Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometika, 16, 297–334.
   Web of Science ®Google Scholar
• Dedrick, R. F., Ferron, J. M., Hess, M. R., Hogarty, K. Y., Kromrey, J. D., Lang, T. R., Niles, J., & Lee, R. (2009). Multilevel modeling: A review of methodological issues and applications. Review of Educational Research, 79, 69–102.
   Web of Science ®Google Scholar
• Dedrick, R. F., & Greenbaum, P. E. (2011). Multilevel confirmatory factor analysis of a scale measuring interagency collaboration of children's mental health agencies. Journal of Emotional and Behavioral Disorders, 19, 27–40.
   PubMed Web of Science ®Google Scholar
• den Brok, P., Bergen, T., Stahl, R. J., & Brekelmans, M. (2004). Students’ perceptions of teacher control behaviors. Learning and Instruction, 14, 425–443.
   Web of Science ®Google Scholar
• D'Haenens, E., Van Damme, J., & Onghena, P. (2010). Constructing measures for school process variables: The potential of multilevel confirmatory factor analysis. Quality & Quantity, 46, 155–188.
   Web of Science ®Google Scholar
• Dolan, C. V. (1994). Factor analysis of variables with 2, 3, 5, and 7 response categories: A comparison of categorical variable estimators using simulated data. British Journal of Mathematical and Statistical Psychology, 47, 309–326.
   Web of Science ®Google Scholar
• DiStefano, C., & Hess, B. (2005). Using confirmatory factor analysis for construct validation: An empirical review. Journal of Psychoeducational Assessment, 23, 225–241.
   Web of Science ®Google Scholar
• Diya, L., Li, B., Heede, K., Sermeus, W., & Lesaffre, E. (2014). Multilevel factor analytic models for assessing the relationship between nurse-reported adverse events and patient safety. Journal of the Royal Statistical Society: Series A (Statistics in Society), 177, 237–257.
   Web of Science ®Google Scholar
• Doss, B. D., Atkins, D. C., & Christensen, A. (2003). Who's dragging their feet? Husbands and wives seeking marital therapy. Journal of Marital & Family Therapy, 29, 165–177.
   PubMed Web of Science ®Google Scholar
• Droseltis, O., & Vignoles, V. L. (2010). Towards an integrative model of place identification: Dimensionality and predictors of intrapersonal-level place preferences. Journal of Environmental Psychology, 30, 23–34.
   Web of Science ®Google Scholar
• Dyer, N., Sorra, J., Smith, S., Cleary, P., & Hays, R. (2012). Psychometric properties of the consumer assessment of healthcare providers and systems (CAHPS (R)) clinician and group adult visit survey. Medical Care, 50, S28–S34.
   PubMed Web of Science ®Google Scholar
• Fauth, B., Decristan, J., Rieser, S., Klieme, E., & Büttner, G. (2014). Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes. Learning and Instruction, 29, 1–9.
   Web of Science ®Google Scholar
• Ferron, J., Hogarty, K., Dedrick, R., Hess, M., Niles, J., & Kromrey, J. (2008). Reporting results from multilevel analyses. In A. O'Connell & D. B. McCoach (Eds.). Multilevel analysis of educational data (pp. 391–426). Charlotte, NC: Information Age Publishing.
   Google Scholar
• Fox, J.P., & Glas, C. A. W. (2001). Bayesian estimation of multilevel IRT modeling using Gibbs sampling. Psychometrika, 66, 271–288.
   Web of Science ®Google Scholar
• Geldhof, G. J., Preacher, K. J., & Zyphur, M. J. (2014). Reliability estimation in a multilevel confirmatory factor analysis framework. Psychological Methods, 19, 72–91.
   PubMed Web of Science ®Google Scholar
• Goetz, T., Lüdtke, O., Nett, U. E., Keller, M. M., & Lipnevich, A. A. (2013). Characteristics of teaching and students’ emotions in the classroom: Investigating differences across domains. Contemporary Educational Psychology, 38, 383–394.
   Web of Science ®Google Scholar
• Goldstein, J., & McCoach, D. B. (2011). The starting line: Developing a structure for teacher ratings of students’ skills at kindergarten entry. Early Childhood Research & Practice, 13(2). Retrieved from http://files.eric.ed.gov/fulltext/EJ956366.pdf.
   Google Scholar
• Graves, S. L., & Frohwerk, A. (2009). Multilevel modeling and school psychology: A review and practical example. School Psychology Review, 24, 84–94.
   Web of Science ®Google Scholar
• Greenbaum, P., Wang, W., Boothroyd, R., Kutash, K., & Friedman, R. (2011). Multilevel confirmatory factor analysis of the Systems of Care Implementation Survey (SOCIS). Journal of Behavioral Health Services & Research, 38, 303–326.
   PubMed Web of Science ®Google Scholar
• Haller, C. S., Courvoisier, D. S., & Cropley, D. H. (2011). Perhaps there is accounting for taste: Evaluating the creativity of products. Creativity Research Journal, 23, 99–109.
   Web of Science ®Google Scholar
• Hammer, L. B., Kossek, E., Bodner, T., & Crain, T. (2013). Measurement development and validation of the Family Supportive Supervisor Behavior Short-Form (FSSB-SF). Journal of Occupational Health Psychology, 18, 285–296.
   PubMed Web of Science ®Google Scholar
• Hammer, L., Kossek, E., Yragui, N., Bodner, T., & Hanson, G. (2013). Development and validation of a multidimensional measure of Family Supportive Supervisor Behaviors (FSSB). Journal of Management, 35, 837–856.
   Web of Science ®Google Scholar
• Hansson, A. (2012). Instructional responsibility in mathematics education: Modeling classroom teaching using Swedish data. Educational Studies in Mathematics, 75, 171–189.
   Web of Science ®Google Scholar
• Harnqvist, K., Gustafsson, J., Muthen, B. O., & Nelson, G. (1994). Hierarchical models of ability at individual and class levels. Intelligence, 18, 165–187.
   Web of Science ®Google Scholar
• Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66, 393–416.
   Web of Science ®Google Scholar
• Holfve-Sabel, M., & Gustafsson, J. E. (2005). Attitudes towards school, teacher, and classmates at classroom and individual levels: An application of two-level confirmatory factor analysis. Scandinavian Journal of Educational Research, 49, 187–202.
   Google Scholar
• Hox, J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Hox, J., & Maas, C. J. M. (2001). The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation Modeling: A Multidisciplinary Journal, 8, 157–174.
   Web of Science ®Google Scholar
• Hsu, H-Y., Kwok, O., Acosta, S., & Lin, J-H. (2015). Detecting misspecified multilevel SEMS using common fit indices: A Monte Carlo study. Multivariate Behavioral Research, 50, 197–215.
   PubMed Web of Science ®Google Scholar
• Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55.
   Web of Science ®Google Scholar
• Hulpia, H, Devos, G., Rosseel, Y., & Vlerick, P. (2012). Dimensions of distributed leadership and the impact on teachers’ organizational commitment: A study in secondary education. Journal of Applied Social Psychology, 7, 1745–1784.
   Web of Science ®Google Scholar
• Intanam, N., Wongwanich, S., & Lawthong, N. (2012). Development of a model for building professional learning communities in schools: Teachers’ perspectives in Thai educational context. Journal of Case Studies in Education, 3, 1–11.
   Google Scholar
• Jackson, D. L., Gillaspy , & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14, 6–23.
   PubMed Web of Science ®Google Scholar
• Jackson, D. L. (2010). Reporting results of latent growth modeling and multilevel modeling analyses: Some recommendations for rehabilitation. Rehabilitation Psychology, 55, 272–285.
   PubMed Web of Science ®Google Scholar
• Jak, S., Oort, F. J., & Dolan, C. V. (2013). A test for cluster bias: Detecting violations of measurement invariance across clusters in multilevel data. Structural Equation Modeling: A Multidisciplinary Journal, 20, 265–282.
   Web of Science ®Google Scholar
• Kamata, A., Bauer, D. J., & Miyazaki, Y. (2008). Multilevel measurement modeling. In A. A. O Connell & D. B. McCoach (Eds.), Multilevel modeling of educational data. Charlotte, NC: Information Age Publishing.
   Google Scholar
• Kamata, A., & Vaughn, B. K. (2011). Multilevel IRT modeling. In J. J. Hox & J. K. Roberts (Eds.), Handbook of advanced multilevel analysis (pp. 41–57). New York: Taylor and Francis Group.
   Google Scholar
• Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S., Cribbie, R. A., Donahue, B., et al. (1998). Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA, and ANCOVA analyses. Review of Educational Research, 68, 350–386.
   Web of Science ®Google Scholar
• Kim. E. S., & Cao, C. (2015). Testing group mean differences of latent variables in multilevel data using multiple-group multilevel CFA and multilevel MIMIC modeling. Multivariate Behavioral Research, 50, 436–456.
   PubMed Web of Science ®Google Scholar
• Klangphahol, K., Traiwichitkhun, D., & Kanchanawasi, S. (2010). Applying multilevel confirmatory factor analysis techniques to perceived homework quality. Research in Higher Education Journal, 6, 1–10.
   Google Scholar
• Kuhlemeier, H., van den Bergh, H., & Rijlaarsdam, G. (2002). The dimensionality of speaking and writing: A multilevel factor analysis of situational, task and school effects. British Journal of Educational Psychology, 72, 467–482.
   PubMed Web of Science ®Google Scholar
• Li, F., Duncan, T. E., Duncan, S. C., Harmer, P., & Acock, A. (1997). Latent variable modeling of multilevel intrinsic motivation data. Measurement in Physical Education & Exercise Science, 1, 223–224.
   Google Scholar
• Little, J. (2013). Multilevel confirmatory ordinal factor analysis of the Life Skills Profile–16. Psychological Assessment, 25, 810–825.
   PubMed Web of Science ®Google Scholar
• Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2008). The multilevel latent covariate model: A new more reliable approach to group-level effects in contextual studies. Psychological Methods, 13, 203–229.
   PubMed Web of Science ®Google Scholar
• Mackinnon, S. P., Battista, S. R., Sherry, S. B., & Stewart, S. H. (2014). Perfectionistic self-presentation predicts social anxiety using daily diary methods. Personality and Individual Differences, 56, 143–148.
   Web of Science ®Google Scholar
• Martin, A. J., Malmberg, L.-E., & Liem, G. A. D. (2010). Multilevel motivation and engagement: Assessing construct validity across students and schools. Educational and Psychological Measurement, 70, 973–989.
   Web of Science ®Google Scholar
• Mathisen, G. E., Torsheim, T., & Einarsen, S. (2006). The team-level model of climate for innovation: A two-level confirmatory factor analysis. Journal of Occupational and Organizational Psychology, 79, 23–35.
   Web of Science ®Google Scholar
• Mauno, S., Kiuru, N., & Kinnunen, U. (2011). Relationships between work-family culture and work attitudes at both the individual and the departmental level. Work and Stress, 25, 147–166.
   Web of Science ®Google Scholar
• McCoach, D. B. (2010). Hierarchical linear modeling. In G.R. Hancock & R. O. Muller (Eds.), The reviewer's guide to quantitative methods in the social sciences (pp. 93–114). New York, NY: Routledge Taylor & Francis.
   Google Scholar
• McCoach, D. B., & Colbert, R. D. (2010). Factors underlying the collective teacher efficacy scale and their mediating role in the effect of socioeconomic status on academic achievement at the school level. Measurement and Evaluation in Counseling and Development, 43, 31–47.
   Web of Science ®Google Scholar
• McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum
   Google Scholar
• McDonald, R. P., & Ho, M. R. (2002). Principles and practice in reporting structural equation analysis. Psychological Methods, 7, 68–82.
   Web of Science ®Google Scholar
• Mehta, P. D., Foorman, B. R., Branum-Martin, L., & Taylor, W. P. (2005). Literacy as a unidimensional multilevel construct: Validation, sources of influence, and implications in a longitudinal study in grades 1 to 4. Scientific Studies of Reading, 9, 85–116.
   Web of Science ®Google Scholar
• Merz, E. L., & Roesch, S. C. (2011). Modeling trait and state variation using multilevel factor analysis with PANAS daily diary data. Journal of Research in Personality, 45, 2–9.
   PubMed Web of Science ®Google Scholar
• Jöreskog, K. G., & Sörbom, D. (2006). LISREL 8.8 for Windows [Computer software]. Skokie, IL: Scientific Software International, Inc.
   Google Scholar
• Miller, A. D., & Murdock, T. B. (2007). Modeling latent true scores to determine the utility of aggregate student perceptions as classroom indicators in HLM: The case of classroom goal structures. Contemporary Educational Psychology, 32, 83–104.
   Web of Science ®Google Scholar
• Muthén, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338–354.
   Web of Science ®Google Scholar
• Muthén, B. O. (1994). Multilevel covariance structure analysis. Sociological Methods & Research, 22, 376–398.
   Web of Science ®Google Scholar
• Muthén, L. K., & Muthén, B. O. (1998–2012). Mplus user's guide (6th ed.). Los Angeles, CA: Muthén & Muthén.
   Google Scholar
• Muthén, B. O., & Satorra, A. (1995). Complex sample data in structural equation modeling. In P. Marsden (Ed.), Sociological methodology (pp. 216–316). Washington, DC: American Sociological Association.
   Google Scholar
• Myers, N. D., Chase, M. A., Beauchamp, M. R., Jackson, B. (2010). Athletes’ perceptions of coaching competency scale II-high school teams. Educational and Psychological Measurement, 70, 477–494.
   Web of Science ®Google Scholar
• Nixdorf, D. R., John, M. T., Wall, M. M., Friction, J. R., & Schiffman, E. L. (2010). Psychometric properties of the modified Symptom Severity Index (SSI). Journal of Oral Rehabilitation, 37, 11–20.
   PubMed Web of Science ®Google Scholar
• O'Malley, A. J., Zaslavsky, A. M., Hays, R. D., Hepner, K. A., Keller, S., & Cleary P. D. (2005). Exploratory factor analysis of the CAHPS® hospital pilot survey responses across and within medical, surgical, and obstetric services. Health Service Research, 40, 2078–2095.
   PubMed Web of Science ®Google Scholar
• Paxton, P., Curran, P. J., Bollen, K. A., Kirby, J., & Chen, F. (2001). Monte Carlo experiments: Design and implementation. Structural Equation Modeling: A Multidisciplinary Journal, 8, 287–312.
   Web of Science ®Google Scholar
• Peters, C., Algina, J., Smith, S. W., & Daunic, A. P. (2012). Factorial validity of the behavior rating inventory of executive function (BRIEF)-Teacher form. Child Neuropsychology, 18, 168–181.
   PubMed Web of Science ®Google Scholar
• Radtke, T., Scholz, U., Keller, R., Knäuper, B., & Hornung, R. (2011). Smoking-specific compensatory health beliefs and the readiness to stop smoking in adolescents. British Journal of Health Psychology, 16, 610–625.
   PubMed Web of Science ®Google Scholar
• Rasbash, J., Steele, F., Browne, W. J. & Goldstein, H. (2012). A User's Guide to MLwiN, v2.26. Bristolk, UK: Centre for Multilevel Modelling, University of Bristol.
   Google Scholar
• Raudenbush, S. W., Rowan, B., & Kang, S. J. (1991). A multilevel, multivariate model for studying school climate with estimation via the EM algorithm and application to U.S. high-school data. Journal of Educational Statistics, 16, 295–330.
   Google Scholar
• Reise, S. P., Ventura, J., Nuechterlein, K. H., & Kim, K. H. (2005). An illustration of multilevel factor analysis. Journal of Personality Assessment, 84, 126–136.
   PubMed Web of Science ®Google Scholar
• Rush, J., & Hofer, S. M. (2014). Differences in within-and between-person factor structure of positive and negative affect: Analysis of two intensive measurement studies using multilevel structural equation modeling. Psychological Assessment, 26, 462–473.
   PubMed Web of Science ®Google Scholar
• Ryu, E., & West, S. G. (2009). Level-specific evaluation of model fit in multilevel structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 16, 583–601.
   Web of Science ®Google Scholar
• Schreiber, J. B., & Griffin, B. W. (2004). Review of multilevel modeling and multilevel studies in The Journal of Educational Research (1992–2002). The Journal of Educational Research, 98, 24–33.
   Web of Science ®Google Scholar
• Schneider, S., Choi, S. W., Junghaenel, D. U., Schwartz, J. E., & Stone, A. A. (2013). Psychometric characteristics of daily diaries for the Patient-Reported Outcomes Measurement Information System (PROMIS®): A preliminary investigation. Quality of Life Research, 22, 1859–1869.
   PubMed Web of Science ®Google Scholar
• Sexton, J., Helmreich, R., Neilands, T., Rowan, K., Vella, K., Boyden, J., & Thomas, E. (2006). The Safety Attitudes Questionnaire: Psychometric properties, benchmarking data, and emerging research. BMC Health Services Research, 6, 44–53.
   PubMed Web of Science ®Google Scholar
• Sexton, J., Makary, M., Tersigni, A., Pryor, D., Hendrich, A., Thomas, E., &... Pronovost, P. (2006). Teamwork in the operating room: Frontline perspectives among hospitals and operating room personal. Anesthesiology, 105, 877–884.
   PubMed Web of Science ®Google Scholar
• Siriparp, T., Traiwichitkhun, D., & Kanjanawasee, S. (2012). Using multilevel confirmatory factor analysis to study student well-being in Thailand. Journal of International Education Research, 8, 367–372.
   Google Scholar
• Sirotnik, K. (1980). Psychometric implications of the unit-of-analysis problem (with examples from the measurement of organizational climate). Journal of Educational Measurement, 17, 245–282.
   Web of Science ®Google Scholar
• Sorra, J., & Dyer, N. (2010). Multilevel psychometric properties of the AHRQ hospital survey on patient safety culture. BMC Health Services Research, 10, 199–211.
   PubMed Web of Science ®Google Scholar
• Stankov, L., & Lee, J. (2009). Dimensions of cultural differences: Pancultural, ETIC/EMIC, and ecological approaches. Learning and Individual Differences, 19, 339–354.
   Web of Science ®Google Scholar
• Stapleton, L. M., Yang, J. S., & Hancock, G. R. (2016). Construct meaning in multilevel settings. Journal of Educational and Behavioral Statistics, 41(5), 481–520.
   Web of Science ®Google Scholar
• Stawarczyk, D., Cassol, H., & D'Argembeau, A. (2013). Phenomenology of future-oriented mind-wandering episodes. Frontiers in Psychology, 4, 425–436.
   PubMed Web of Science ®Google Scholar
• Steele, F., & Goldstein, H. (2006). A multilevel factor model for mixed binary and ordinal indicators of women's status. Sociological Methods & Research, 35, 137–153.
   Web of Science ®Google Scholar
• Thoemmes, F. J., & Kim, E. S. (2011). A systematic review of propensity score methods in the social sciences. Multivariate Behavioral Research, 46, 90–118.
   PubMed Web of Science ®Google Scholar
• Toland, M. D., & De Ayala, R. J. (2005). A multilevel factor analysis of students’ evaluations of teaching. Educational and Psychological Measurement, 65, 272–296.
   Web of Science ®Google Scholar
• van de Vijver, F. J., & Poortinga, Y. H. (2002). Structural equivalence in multilevel research. Journal of Cross-Cultural Psychology, 33, 141–156.
   Web of Science ®Google Scholar
• van Hemert, D. A., van de Vijver, F. J., Poortinga, Y. H., & Georgas, J. (2002). Structural and functional equivalence of the Eysenck Personality Questionnaire within and between countries. Personality and Individual Differences, 33, 1229–1249.
   Web of Science ®Google Scholar
• Van Horn, M., Hawkins, J., Arthur, M., & Catalano, R. (2007). Assessing community effects on adolescent substance use and delinquency. Journal of Community Psychology, 35, 925–946.
   Web of Science ®Google Scholar
• Wagner, W., Gollner, R, Helmke, A., Trautwein, U., & Lüdtke, O. (2013). Construct validity of student perceptions of instructional quality is high, but not perfect: Dimensionality and generalizability of domain-independent assessments. Learning and Instruction, 28, 1–11.
   Web of Science ®Google Scholar
• Whitton, S. M., & Fletcher, R. B. (2014). The group environment questionnaire: A multilevel confirmatory factor analysis. Small Group Research, 45, 68–88.
   Web of Science ®Google Scholar
• Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future direction. Psychological Methods, 12, 58–79.
   PubMed Web of Science ®Google Scholar
• Wu, C. (2009). Factor analysis of the general self-efficacy scale and its relationship with individualism/collectivism among twenty-five countries: Application of multilevel confirmatory factor analysis. Personality and Individual Differences, 46, 699–703.
   Web of Science ®Google Scholar
• Zhang, N., & Wan, T. (2005). The measurement of nursing home quality: Multilevel confirmatory factor analysis of panel data. Journal of Medical Systems, t, 401–411.
   Web of Science ®Google Scholar
• Zimprich, D., Perren, S., & Hornung, R. (2005). A two-level confirmatory factor analysis of a modified Rosenberg Self-Esteem Scale. Educational and Psychological Measurement, 65, 465–481.
   Web of Science ®Google Scholar
• Zumbo, B. D., & Forer, B. (2010, May). A multilevel view of measurement validity: Some concepts and foundations. Paper presented at the meeting of the American Educational Research Association, Denver, CO.
   Google Scholar
• Zumbo, B. D., Liu, Y., Forer, B., & Shear, B. (2010, May). National and international educational achievement testing: A case of multi-level validation. Paper presented at the meeting of the American Educational Research Association, Denver, CO.
   Google Scholar
• Zúñiga, F., Schwappach, D., De Geest, S., & Schwendimann, R. (2013). Psychometric properties of the Swiss version of the nursing home survey on patient safety culture. Safety Science, 55, 88–118.
   Web of Science ®Google Scholar
• Zyphur, M. J., Kaplan, S. A., & Christian, M. S. (2008). Assumptions of cross-level measurement and structural invariance in the analysis of multilevel data: Problems and solutions. Group Dynamics: Theory, Research, and Practice, 12, 127–140.
   Web of Science ®Google Scholar