A multi-level modeling approach to investigating students’ critical thinking at higher education institutions

References

• ACT. 2018. 2018 ACT/SAT Concordance Tables. Accessed 12 December 2018. https://www.act.org/content/dam/act/unsecured/documents/ACT-SAT-Concordance-Tables.pdf
   Google Scholar
• Adelman, C., P. Ewell, P. Gaston, and C. G. Schneider. 2014. The Degree Qualifications Profile. A Learning-Centered Framework for What College Graduates Should Know and Be Able to Do to Earn the Associate, Bachelor’s or Master’s Degree E. Indianapolis, IN: Lumina Foundation for Education, Inc.
   Google Scholar
• American Management Association. 2012. AMA 2012 Critical Skills Survey. New York: American Management Association.
   Google Scholar
• Arum, R., and J. Roksa. 2011. Academically Adrift: Limited Learning on College Campuses. Chicago, IL: University of Chicago Press.
   Google Scholar
• Arum, R., and J. Roksa. 2014. Aspiring Adults Adrift: Tentative Transitions of College Graduates. Chicago, IL: University of Chicago Press.
   Google Scholar
• Arum, R., J. Roksa, and E. Cho. 2010. Improving Undergraduate Learning: Findings and Policy Recommendations from the SSRC-CLA Longitudinal Project. New York: Social Science Research Council.
   Google Scholar
• Association of American Colleges and Universities. 2011. The LEAP Vision for Learning: Outcomes, Practices, Impact, and Employers’ View. Washington, DC: Association of American Colleges and Universities.
   Google Scholar
• Barton, P., and R. Coley. 2010. The Black-White Achievement Gap: When Progress Stopped. Princeton, NJ: Policy Evaluation and Research Center, Educational Testing Service.
   Google Scholar
• Blaich, C., and K. Wise. 2011. From Gathering to Using Assessment Results: Lessons from the Wabash National Study. Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment.
   Google Scholar
• Borden, V., and J. Young. 2008. “Measurement Validity and Accountability for Student Learning.” In Assessing and Accounting for Student Learning: Finding a Constructive Path Forward, edited by Victor Borden and Gary Pike, 39–48. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Casner-Lotto, J., and L. Barrington. 2006. Are They Really Ready to Work? Employers’ Perspectives on the Basic Knowledge and Applied Skills of New Entrants to the 21st Century U.S. Workforce. New York, NY: The Conference Board, Inc., the Partnership for 21st Century Skills, Corporate Voices for Working Families, and the Society for Human Resource Management. http://www.p21.org/storage/documents/FINAL_REPORT_PDF09-29-06.pdf
   Google Scholar
• Chapman, L., and L. Ludlow. 2010. “Can Downsizing College Class Sizes Augment Student Outcomes? An Investigation of the Effects of Class Size on Student Learning.” The Journal of General Education 59 (2): 105–123.
   Google Scholar
• Cohen, J., P. Cohen, S. West, and L. Aiken. 2003. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Educational Testing Service. 2015. HEIghtenTM Critical Thinking Test at a Glance. Princeton, NJ: Educational Testing Service. https://www.ets.org/s/heighten/pdf/heighten_critical_thinking_test_at_a_glance_acc.pdf
   Google Scholar
• Educational Testing Service. 2017a. About the HEIghten® Outcomes Assessment Suite. Princeton, NJ: Educational Testing Service. https://www.ets.org/heighten/about
   Google Scholar
• Educational Testing Service. 2017b. HEIghten® Outcomes Assessment Suite: Guide to Score Interpretation. Princeton, NJ: Educational Testing Service.
   Google Scholar
• Enders, C. 2010. Applied Missing Data Analysis. New York: The Guilford Press.
   Google Scholar
• Enders, C., and D. Tofighi. 2007. “Centering Predictor Variables in Cross-Sectional Multilevel Models: A New Look at an Old Issue.” Psychological Methods 12 (2): 121–38.
   PubMed Web of Science ®Google Scholar
• Evens, M., A. Verburgh, and J. Elen. 2013. “Critical Thinking in College Freshmen: The Impact of Secondary and Higher Education.” International Journal of Higher Education 2 (3): 139–151.
   Google Scholar
• Gellin, A. 2003. “The Effect of Undergraduate Student Involvement on Critical Thinking: A Meta-Analysis of Literature 1991–2000.” Journal of College Student Development 44 (6): 746–762. doi:10.1353/csd.2003.0066.
   Web of Science ®Google Scholar
• Hart Research Associates. 2015. Falling Short? College Learning and Career Success. Washington, DC: Association of American Colleges and Universities.
   Google Scholar
• Hart Research Associates. 2016. Recent Trends in General Education Design, Learning Outcomes, and Teaching Approaches. Washington, DC: Association of American Colleges and Universities.
   Google Scholar
• Hox, J. 2002. Multilevel Analysis: Techniques and Applications. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Huber, C., and N. Kuncel. 2016. “Does College Teach Critical Thinking? A Meta-Analysis.” Review of Educational Research 86 (2): 431–468. doi:10.3102/0034654315605917.
   Web of Science ®Google Scholar
• Klein, S., O. L. Liu, J. Sconing, R. Bolus, B. Bridgeman, H. Kugelmass, A. Nemeth, S. Robbins, and J. Steedle. 2009. Test Validity Study (TVS) Report. Princeton, NJ: Educational Testing Service.
   Google Scholar
• Kuh, G., N. Jankowski, S. Ikenberry, and J. Kinzie. 2014. Knowing What Students Know and Can Do: The Current State of Student Learning Outcomes Assessment in U.S. Colleges and Universities. Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment.
   Google Scholar
• Lee, V. 2000. “Using Hierarchical Linear Modeling to Study Social Contexts: The Case of School Effects.” Educational Psychologist 35 (2): 125–141. doi:10.1207/S15326985EP3502_6.
   Web of Science ®Google Scholar
• Liu, O. L. 2011. “Value-Added Assessment in Higher Education: A Comparison of Two Methods.” Higher Education 61 (4): 445–461. doi:10.1007/s10734-010-9340-8.
   Web of Science ®Google Scholar
• Liu, O. L., L. Frankel, and K. C. Roohr. 2014. Assessing Critical Thinking in Higher Education: Current State and Directions for Next Generation Assessment (Research Report No. RR-14-10). Princeton, NJ: Educational Testing Service. doi:10.1002/ets2.12009.
   Google Scholar
• Liu, O. L., H. Liu, K. C. Roohr, and D. McCaffrey. 2016a. “Investigating College Learning Gain: Exploring a Propensity Score Weighting Approach.” Journal of Educational Measurement 53 (3): 352–367. doi:10.1111/jedm.12112.
   Web of Science ®Google Scholar
• Liu, O. L., L. Mao, L. Frankel, and J. Xu. 2016b. “Assessing Critical Thinking in Higher Education: The HEIghtenTM Approach and Preliminary Validity Evidence.” Assessment & Evaluation in Higher Education 41 (5): 677–694. doi:10.1080/02602938.2016.1168358.
   Web of Science ®Google Scholar
• Liu, O. L., and K. C. Roohr. 2013. Investigating 10-Year Trends of Learning Outcomes at Community Colleges (Research Report No. RR-13-34). Princeton, NJ: Educational Testing Service.
   Google Scholar
• Muthén, L., and B. Muthén. 1998–2015. Mplus User’s Guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
   Google Scholar
• National Center for Education Statistics. 2016. “Graduation Rate from First Institution Attended for First-time, Full-time Bachelor’s Degree-Seeking Students at 4-year Postsecondary Institutions, by Race/Ethnicity, Time to Completion, Sex, Control of Institution, and Acceptance Rate: Selected Cohort Entry Years, 1996 Through 2009.” https://nces.ed.gov/programs/digest/d16/tables/dt16_326.10.asp
   Google Scholar
• National Center for Education Statistics. 2017. Integrated Postsecondary Education Data System. Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics.
   Google Scholar
• Reason, R. D. 2003. “Student Variables That Predict Retention: Recent Research and New Developments.” NASPA Journal 40 (4): 172–191.
   Google Scholar
• Roohr, K. C., H. Liu, and O. L. Liu. 2016. “Investigating Student Learning Gains in College: A Longitudinal Study.” Studies in Higher Education 42 (12): 2284–2300. doi:10.1080/03075079.2016.1143925.
   Web of Science ®Google Scholar
• Scherbaum, C., and J. Ferreter. 2009. “Estimating Statistical Power and Required Sample Sizes for Organizational Research Using Multilevel Modeling.” Organizational Research Methods 12 (2): 347–67. doi:10.1177/1094428107308906.
   Web of Science ®Google Scholar
• Steedle, J. 2012. “Selecting Value-Added Models for Postsecondary Institutional Assessment.” Assessment and Evaluation in Higher Education 37 (6): 637–652. doi:10.1080/02602938.2011.560720.
   Web of Science ®Google Scholar
• Twale, D., and C. Sanders. 1999. “Impact of Non-Classroom Experiences on Critical Thinking Ability.” Naspa Journal 36 (2): 133–146.
   Google Scholar
• Voluntary System of Accountability. 2008. Information on Learning Outcomes Measures. Accessed 12 December 2018. https://cp-files.s3.amazonaws.com/21/LearningOutcomesInfo.pdf.
   Google Scholar
• Waldeck, J. 2006. “What Does Personalized Education Mean for Faculty and How Should It Serve Our Students?” Communication Education 55(3): 345–352. doi:10.1080/03634520600748649.
   Web of Science ®Google Scholar
• Zlatkin-Troitschanskaia, O., R. Shavelson, and C. Kuhn. 2015. “The International State of Research on Measurement of Competency in Higher Education.” Studies in Higher Education 40 (3): 393–411. doi:10.1080/03075079.2015.1004241.
   Web of Science ®Google Scholar